OPSOPS-001 — Monitoring and Alerting Inadequacies
Model Overfitting and Underfitting Cause Unreliable Operational Behaviour
3/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
AI models that are over- or under-adapted to training data fail to generalise reliably when deployed against real operational conditions. This systemic training deficiency exposes organisations to unpredictable system behaviour and increases liability risk across automated decision processes.
Domain
Operational Management
Blindspots in monitoring, incident response, performance, scalability, integration, and business continuity.
Source
MIT AI Risk Repository — AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks (Schnitzer2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.