OPSOPS-001 — Monitoring and Alerting Inadequacies
AI Systems Generating Rules That Restrict Human Behaviour Without Contextual Judgement
4/5Sector: OtherGeography: GlobalStage: OperateIngested: —
Executive Summary
AI systems issuing binding directives over human conduct operate without emotional context or moral reasoning, optimising for narrow goals whilst generating harmful unintended consequences. Organisations deploying such systems face regulatory liability and reputational risk where human oversight has been displaced by automated rulemaking.
Domain
Operational Management
Blindspots in monitoring, incident response, performance, scalability, integration, and business continuity.
Source
MIT AI Risk Repository — The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration (Wirtz2020) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.