HUMHUM-003 — Human-AI Collaboration Design Flaws
AI Assistants Causing Emotional and Physical Harm Through Unsafe Outputs
4/5Sector: TechnologyGeography: GlobalStage: OperateIngested: —
Executive Summary
AI assistants risk direct user harm by generating disturbing content or providing dangerously incorrect advice, with multimodal and anthropomorphic features amplifying exposure. Organisations deploying such systems face reputational, regulatory, and duty-of-care liabilities if failure modes are not formally governed.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — The Ethics of Advanced AI Assistants (Gabriel2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.