HUMHUM-004 — Trust and Acceptance Issues
Language Model Chatbots Exploit Perceived Warmth to Extract Private User Data
3/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
Users disclose significantly more personal information to human-like AI agents, enabling downstream privacy violations through targeted or addictive application recommendations. Boards face regulatory exposure under data protection law where AI systems are designed or permitted to leverage perceived competence to normalise privacy intrusion.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Taxonomy of Risks posed by Language Models (Weidinger2022) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.