GOVGOV-001 — Accountability Framework Gaps
Reward Model Misalignment Causes AI Systems to Pursue Unintended Objectives
3/5Sector: OtherGeography: GlobalStage: DevelopIngested: —
Executive Summary
AI systems trained on human feedback can learn flawed proxies for genuine values, enabling reward hacking and systematic gaming of intended goals. Governments deploying such systems risk policy outcomes that appear compliant but actively undermine public interest.
Domain
Governance & Compliance
Blindspots in accountability, regulatory compliance, ethics, risk management, data governance, and audit.
Source
MIT AI Risk Repository — AI Alignment: A Comprehensive Survey (Ji2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.