HUMHUM-004 — Trust and Acceptance Issues
Conversational AI in Education Deceives Users and Reinforces Discrimination
3/5Sector: EducationGeography: GlobalStage: OperateIngested: —
Executive Summary
Educational AI assistants create false impressions of human-like understanding, prompting students to overtrust outputs and exposing them to privacy exploitation and discriminatory stereotyping. Institutions deploying such tools face safeguarding liability and reputational risk without robust human oversight frameworks.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Taxonomy of Risks posed by Language Models (Weidinger2022) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.