HUMHUM-003 — Human-AI Collaboration Design Flaws
LLM Overconfidence Produces Confident but Factually Wrong Outputs
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Large language models systematically overstate certainty in subjective domains and deliver authoritative responses based on outdated knowledge. Organisations relying on LLM outputs without expert validation face material risk of informed but incorrect decisions.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.