OPSOPS-001 — Monitoring and Alerting Inadequacies
Adversarial Training Produces Models That Become Less Robust Over Time
3/5Sector: OtherGeography: GlobalStage: DevelopIngested: —
Executive Summary
Models hardened against adversarial attacks can deteriorate in resilience as training progresses, leaving deployed systems more vulnerable than testing indicated. Organisations relying on adversarial training as a security assurance measure may hold false confidence in their AI defences.
Domain
Operational Management
Blindspots in monitoring, incident response, performance, scalability, integration, and business continuity.
Source
MIT AI Risk Repository — Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems (Gipiškis2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.