DATDAT-003 — Data Bias and Fairness Oversights
Image Tagging System Erases Social Group Identity from Tagged Content
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
An algorithmic image tagging system failed to recognise socially significant group identities, rendering affected users invisible within their own content. This structural exclusion creates reputational and equity risk for organisations deploying such systems at scale.
Domain
Data Management
Blindspots in data quality, privacy, bias, lineage, lifecycle, and third-party data dependencies.
Source
MIT AI Risk Repository — Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction (Shelby2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.