GOVGOV-001 — Accountability Framework Gaps
AI Evaluation Frameworks Systematically Underweight Hard-to-Measure Human Values
3/5Sector: OtherGeography: GlobalStage: DevelopIngested: —
Executive Summary
Benchmark-driven AI assessments favour values that are easy to quantify, crowding out harder-to-measure but equally important human values from model development priorities. Governance frameworks built on such evaluations produce a distorted picture of AI alignment, exposing public-sector deployers to undetected ethical risk.
Domain
Governance & Compliance
Blindspots in accountability, regulatory compliance, ethics, risk management, data governance, and audit.
Source
MIT AI Risk Repository — Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems (Gipiškis2024) ↗https://airisk.mit.edu/
Could this happen in your organisation?
A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.