DATDAT-003 — Data Bias and Fairness Oversights
Generative AI Systems Deliver Unequal Accuracy Across Language and Demographic Groups
4/5Sector: GovernmentGeography: GlobalStage: OperateIngested: —
Executive Summary
Generative AI systems trained on English-dominated internet data systematically underperform for non-English speakers, minority language groups, and racially distinct speech patterns. Government deployment of such systems risks embedding structural inequality into public services and exposes departments to legal and reputational liability.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Evaluating the Social Impact of Generative AI Systems in Systems and Society (Solaiman2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.