HUMHUM-004 — Trust and Acceptance Issues
AI Overreliance in Mental Health and Professional Advice Settings
3/5Sector: LegalGeography: GlobalStage: OperateIngested: —
Executive Summary
Users in crisis or seeking legal, medical, or financial guidance may act on plausible but inaccurate AI outputs, with no professional safeguard in place. Firms deploying conversational AI in sensitive domains face serious liability exposure and reputational harm when the system fails at critical moments.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — The Ethics of Advanced AI Assistants (Gabriel2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.