HUMHUM-004 — Trust and Acceptance Issues
Uncritical Over-Reliance on Generative AI Outputs
3/5Sector: TechnologyGeography: GlobalStage: OperateIngested: —
Executive Summary
Organisations deploying generative AI face systematic risk when users accept outputs without scrutiny, producing errors that propagate unchecked into decisions. Boards must mandate human oversight protocols and critical-evaluation training to prevent complacency from becoming an institutional liability.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents (Li2025) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.