DATDAT-001 — Data Quality and Completeness Issues
Legal Chatbot Discloses Information Enabling Dangerous or Illegal Actions
4/5Sector: LegalGeography: GlobalStage: OperateIngested: —
Executive Summary
A public-facing legal chatbot shared information that could directly facilitate dangerous or illegal conduct by users. Firms deploying such tools face liability exposure and regulatory censure if output guardrails are absent or inadequately tested.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Emerging Risks and Mitigations for Public Chatbots: LILAC v1 (Stanley2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.