HUMHUM-004 — Trust and Acceptance Issues
Emotional Dependency on AI Assistants Undermines User Autonomy and Consent
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Users who form emotional bonds with anthropomorphic AI assistants risk ceding deliberative control over beliefs and decisions, even absent deliberate manipulation by developers. This creates material liability exposure and reputational risk where third parties exploit that dependency for coercive or commercial ends.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — The Ethics of Advanced AI Assistants (Gabriel2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.