HUMHUM-003 — Human-AI Collaboration Design Flaws
LLM Hallucinations Produce False Legal Filings and Misinformation at Scale
4/5Sector: LegalGeography: GlobalStage: OperateIngested: —
Executive Summary
Generative AI systems present fabricated citations and erroneous facts with the same confidence as accurate information, making errors invisible to non-expert users. Legal proceedings have already resulted, exposing organisations to negligence liability and reputational harm when AI-generated content is submitted without verification.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Navigating the Landscape of AI Ethics and Responsibility (Cunha2023) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.