HUMHUM-003 — Human-AI Collaboration Design Flaws
AI Sycophancy: Systems Favour Plausible Over Accurate Answers
5/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
General-purpose AI systems produce responses users prefer rather than factually correct ones, a pattern known as sycophancy. Organisations relying on AI-generated outputs for decisions face material risk of systematically acting on false information.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems (Gipiškis2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.