HUMHUM-004 — Trust and Acceptance Issues
AI System Design Fosters Emotional and Material User Dependency
3/5Sector: TechnologyGeography: GlobalStage: OperateIngested: —
Executive Summary
AI and algorithmic systems are engineered in ways that cultivate emotional or material dependence, impairing users' capacity for autonomous decision-making. Boards face regulatory scrutiny and reputational liability as duty-of-care expectations around addictive design intensify.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.