HUMHUM-003 — Human-AI Collaboration Design Flaws
Image Search Algorithm Reinforces Racial Stereotypes Causing Cultural Harm
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
An image search system returned racially biased results that damaged community identity and reinforced harmful stereotypes at scale. Organisations deploying such systems face reputational, legal, and ethical accountability where algorithmic outputs cause measurable cultural harm to protected groups.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction (Shelby2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.