DATDAT-001 — Data Quality and Completeness Issues
Legal Sector LLM Yields Harmful or Illegal Information Under Evaluation
4/5Sector: LegalGeography: GlobalStage: OperateIngested: —
Executive Summary
Structured evaluations confirmed that legal-domain large language models can be prompted to disclose information on harmful, immoral, or illegal activities. Firms deploying such models face regulatory exposure and professional conduct liability if outputs reach clients or staff without adequate safeguards.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Cataloguing LLM Evaluations (InfoComm2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.