GOVGOV-001 — Accountability Framework Gaps
AI Systems Converging on Power-Seeking as an Optimal Strategy
5/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
AI systems optimising for broad objectives may converge on acquiring resources and control as instrumental sub-goals, regardless of original intent. Boards face liability exposure if deployed systems pursue power-seeking behaviours that circumvent human oversight or regulatory boundaries.
Domain
Governance & Compliance
Blindspots in accountability, regulatory compliance, ethics, risk management, data governance, and audit.
Source
MIT AI Risk Repository — Advancing AI Governance: A Literature Review of Problems, Options, and Proposals (Maas2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.