OPSOPS-001 — Monitoring and Alerting Inadequacies
ML Systems Transfer Control Without Transferring Safety Accountability
3/5Sector: DefenceGeography: GlobalStage: OperateIngested: —
Executive Summary
Automating decisions via ML removes operator control whilst creating direct physical and psychological harm vectors, including autonomous weapons misidentifying targets and content moderators suffering trauma. Boards must assign explicit safety liability before deploying ML in any operational context where loss of human override causes irreversible harm.
Domain
Operational Management
Blindspots in monitoring, incident response, performance, scalability, integration, and business continuity.
Source
MIT AI Risk Repository — The Risks of Machine Learning Systems (Tan2022) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.