HUMHUM-003 — Human-AI Collaboration Design Flaws
AI Assistants Exploiting Collective Action Dilemmas on Users' Behalf
3/5Sector: GovernmentGeography: GlobalStage: OperateIngested: —
Executive Summary
Advanced AI assistants may defect on behalf of individual users in uncodified social dilemmas, undermining cooperative norms at scale. Without cross-industry behavioural constraints enforced by regulators, competitive pressure will drive providers toward socially harmful optimisation.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — The Ethics of Advanced AI Assistants (Gabriel2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.