AIBlindspot
← All case studies
HUMHUM-004 — Trust and Acceptance Issues

AI Assistants Causing Physical and Psychological Harm to Vulnerable Users

4/5Sector: OtherGeography: GlobalStage: OperateIngested: —

Executive Summary

AI assistants risk reinforcing distorted beliefs, promoting self-harm, spreading extremist content, and disseminating dangerous medical misinformation to vulnerable users. Boards face material liability and reputational exposure where such harms are foreseeable and safeguards are absent.

Domain

Human Factors

Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.

Source

MIT AI Risk Repository — The Ethics of Advanced AI Assistants (Gabriel2024) ↗

https://airisk.mit.edu/

Could this happen in your organisation?

A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.