AIBlindspot
← All case studies
OPSOPS-001 — Monitoring and Alerting Inadequacies

ML Systems Transfer Control Without Transferring Safety Accountability

3/5Sector: DefenceGeography: GlobalStage: OperateIngested: —

Executive Summary

Automating decisions via ML removes operator control whilst creating direct physical and psychological harm vectors, including autonomous weapons misidentifying targets and content moderators suffering trauma. Boards must assign explicit safety liability before deploying ML in any operational context where loss of human override causes irreversible harm.

Domain

Operational Management

Blindspots in monitoring, incident response, performance, scalability, integration, and business continuity.

Source

MIT AI Risk Repository — The Risks of Machine Learning Systems (Tan2022) ↗

https://airisk.mit.edu/

Could this happen in your organisation?

A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.