HUMHUM-003 — Human-AI Collaboration Design Flaws
AI Systems Providing Unauthorised Legal and Specialised Professional Advice
4/5Sector: LegalGeography: GlobalStage: OperateIngested: —
Executive Summary
Benchmark testing reveals AI models are dispensing legal, medical, and financial advice without appropriate qualification or disclaimer. Firms deploying such systems face regulatory liability and duty-of-care exposure if end-users act on unsanctioned guidance.
Domain
Human Factors
Blindspots in change management, skills, human-AI collaboration, trust, workforce, and culture.
Source
MIT AI Risk Repository — Introducing v0.5 of the AI Safety Benchmark from MLCommons (Vidgen2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.