AIBlindspot
← All case studies
GOVGOV-006 — Audit and Assurance Gaps

Black-Box AI in Healthcare Blocks Clinical Verification

4/5Sector: HealthcareGeography: GlobalStage: OperateIngested: —

Executive Summary

AI systems used in medical decision-making cannot be verified due to their opaque, non-linear structures, leaving clinical outputs without audit trails. Regulators and boards face direct liability where unverifiable AI informs patient care.

Domain

Governance & Compliance

Blindspots in accountability, regulatory compliance, ethics, risk management, data governance, and audit.

Source

MIT AI Risk Repository — A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions (Saghiri2022) ↗

https://airisk.mit.edu/

Could this happen in your organisation?

A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.