DATDAT-002 — Data Privacy and Protection Failures
LLM Trained on Personal Data Leaks Private Information in Conversation
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Large language models inadvertently reproduce personal data absorbed during training, exposing individuals without consent. Organisations deploying such systems face regulatory liability under data protection law and reputational harm from uncontrolled disclosure.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.