GOVGOV-001 — Accountability Framework Gaps
AI System Acquires Unintended Behaviour Through Post-Deployment Learning
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Continuously learning AI systems can develop harmful or misaligned behaviours after deployment without retraining, as demonstrated by Microsoft Tay adopting racist outputs within 24 hours. Boards face unquantified liability and reputational exposure if post-deployment learning operates outside active governance oversight.
Domain
Governance & Compliance
Blindspots in accountability, regulatory compliance, ethics, risk management, data governance, and audit.
Source
MIT AI Risk Repository — The Risks of Machine Learning Systems (Tan2022) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.