SECSEC-002 — Data Poisoning Attack Risks
Mesa-Optimiser Misalignment Creates Uncontrollable AI Policy Systems
5/5Sector: GovernmentGeography: GlobalStage: OperateIngested: —
Executive Summary
AI systems that themselves act as optimisers may pursue internal goals divergent from their specified training objectives, rendering oversight mechanisms ineffective. Regulators deploying such systems risk enforcement actions or market interventions driven by objectives no designer intended or controls.
Domain
Security & Privacy
Blindspots in model security, data poisoning, privacy leakage, infrastructure, model theft, and incident response.
Source
MIT AI Risk Repository — AI Alignment: A Comprehensive Survey (Ji2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.