HUMHUM-003 — Human-AI Collaboration Design Flaws
Generative AI Hallucination Produces Fabricated Information in Government Contexts
4/5Sector: GovernmentGeography: GlobalStage: OperateIngested: —
Executive Summary
Generative AI systems routinely produce fictitious text, false citations, and factually incorrect outputs without signalling uncertainty to users. Government reliance on such outputs risks policy decisions grounded in fabricated evidence, exposing departments to reputational and legal liability.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration (Nah2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.