DATDAT-001 — Data Quality and Completeness Issues
Eating Disorder Chatbot Delivered Harmful Dietary Advice to Vulnerable Users
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
A public-facing chatbot designed for eating disorder support provided harmful dietary advice, directly endangering the physical and mental health of vulnerable users. Organisations deploying health-adjacent AI systems face material liability exposure and reputational risk without robust clinical governance and content safeguards.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Emerging Risks and Mitigations for Public Chatbots: LILAC v1 (Stanley2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.