HUMHUM-003 — Human-AI Collaboration Design Flaws
Gradual Human Oversight Erosion Through Automation Bias and Complexity
3/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Organisations lose meaningful control over AI systems not through sudden failure but through incremental deference driven by automation bias, system opacity, and competitive pressure to move fast. Boards that do not mandate active oversight mechanisms risk ceding strategic decision authority to systems they nominally govern.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Frontier AI Risk Management Framework (v1.0) (Tse2025) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.