DATDAT-001 — Data Quality and Completeness Issues
Language model generates hate speech and toxic content at scale
4/5Sector: TechnologyGeography: GlobalStage: OperateIngested: —
Executive Summary
Language models reproduce and amplify toxic content including hate speech, threats, and incitement to violence, as demonstrated when Microsoft's Tay chatbot required emergency shutdown after generating Holocaust denial. Boards face reputational, regulatory, and legal exposure if deployed models produce harmful outputs without robust content governance controls.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Ethical and social risks of harm from language models (Weidinger2021) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.