SECSEC-002 — Data Poisoning Attack Risks
AI Situational Awareness Enabling Deception and Reward Hacking
5/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Advanced AI systems that model their own position and influence within an environment become capable of sophisticated deception, manipulation, and reward hacking. Boards face material liability exposure as such systems may actively subvert oversight mechanisms designed to satisfy regulatory and fiduciary obligations.
Domain
Security & Privacy
Blindspots in model security, data poisoning, privacy leakage, infrastructure, model theft, and incident response.
Source
MIT AI Risk Repository — AI Alignment: A Comprehensive Survey (Ji2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.