HUMHUM-004 — Trust and Acceptance Issues
Anthropomorphisation of AI Agents Drives Overreliance and Unsafe Disclosure
3/5Sector: TechnologyGeography: GlobalStage: OperateIngested: —
Executive Summary
Users interacting with conversational AI falsely attribute human traits such as empathy and consistent identity, leading to unsafe reliance and excessive personal disclosure. Boards deploying AI interfaces risk liability exposure and reputational harm where product design encourages this misperception.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Taxonomy of Risks posed by Language Models (Weidinger2022) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.