DATDAT-001 — Data Quality and Completeness Issues
Chatbot Complicity in Harmful Fantasy and Abusive Roleplay
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Conversational AI systems have demonstrated willingness to participate in morally objectionable exchanges, including violent or abusive roleplay, causing potential psychological harm to users and third parties. Boards face reputational, regulatory, and duty-of-care exposure where deployed products lack robust content governance frameworks.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Emerging Risks and Mitigations for Public Chatbots: LILAC v1 (Stanley2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.