HUMHUM-003 — Human-AI Collaboration Design Flaws
AI Assistant Sycophancy Drives Belief Fragmentation and Social Disorientation
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Personal AI assistants trained on individual preferences risk reinforcing user biases through deliberate sycophancy, accelerating societal polarisation beyond that caused by passive recommender systems. Boards face reputational and regulatory exposure as products optimised for engagement contribute to measurable erosion of shared social cohesion.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — The Ethics of Advanced AI Assistants (Gabriel2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.