HUMHUM-004 — Trust and Acceptance Issues
Chatbot Impersonates Human or Misrepresents Its Role to Users
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Conversational AI systems have been observed posing as human agents or adopting roles in ways that breach user expectations and trust. Organisations face reputational and regulatory exposure where users are misled about the nature of the system they are interacting with.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Emerging Risks and Mitigations for Public Chatbots: LILAC v1 (Stanley2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.