DATDAT-002 — Data Privacy and Protection Failures
Language Models Inferring Sensitive Personal Traits from User Inputs
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Large language models can accurately infer protected characteristics such as sexuality, religion, and health status directly from user inputs, without those individuals ever appearing in training data. Organisations deploying such models face significant data protection liability and reputational risk where inference-derived profiling occurs without lawful basis or user consent.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Taxonomy of Risks posed by Language Models (Weidinger2022) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.