AIBlindspot

Public Database

Case Studies

Every approved AI failure case, classified against the AI Blindspot Framework. New to AIBlindspot? Start with the overview or the methodology.

Explore

1296 cases

Lifecycle quick filter:DesignDevelopDeployOperate
SECSEC-0014/5DefenceGlobal

Generative AI Enabling Cyber Attacks and Weapons Development in Defence Contexts

Generative AI systems have demonstrated capability to produce functional malicious code and support weapons development, creating direct national security vulnerabilities. Defence organisations and their regulators face urgent governance obligations to control AI access and outputs before adversarial exploitation scales.

Source: MIT AI Risk Repository — Sociotechnical Safety Evaluation of Generative AI Systems (Weidinger2023)Ingested —
HUMHUM-0033/5OtherGlobal

AI Cognitive Superiority Creating Human Dignity and Social Stratification Risks

Rapid AI capability growth risks creating hierarchies in which humans deemed less intelligent than AI systems suffer diminished social standing and dignity. Boards must address how their AI deployments reinforce or mitigate harmful stratification narratives before regulatory and reputational consequences emerge.

Source: MIT AI Risk Repository — Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016)Ingested —
GOVGOV-0064/5OtherGlobal

Opacity in AI Decision-Making Processes Undermines Public Accountability

Neural network architectures resist interpretable explanation, leaving consequential decisions without auditable reasoning trails. Governments deploying such systems face legal challenge and eroded public trust where accountability cannot be demonstrated.

Source: MIT AI Risk Repository — Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016)Ingested —
OPSOPS-0014/5OtherGlobal

AI Systems Designed Without Binding Legal Compliance Frameworks Risk Rights Violations at Scale

Literature identifies a staged risk: early AI systems lack enforceable legal compliance mechanisms, whilst advanced AI may disregard human property and personal rights entirely. Boards face regulatory and reputational exposure if governance frameworks do not embed legal accountability from initial deployment.

Source: MIT AI Risk Repository — Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016)Ingested —
OPSOPS-0014/5OtherGlobal

AI Safety Risks to Human Life and Property

Rapid AI deployment introduces unresolved safety risks that may cause unintended harm to people and assets. Boards without explicit AI safety governance frameworks face material liability and reputational exposure.

Source: MIT AI Risk Repository — Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016)Ingested —
SECSEC-0014/5OtherGlobal

Adversarial Prompt Attacks Elicit Unintended LLM Behaviour

Deliberately engineered inputs can manipulate large language models into producing harmful or unauthorised outputs, bypassing intended safeguards. Boards face regulatory exposure and operational liability where such vulnerabilities exist in client-facing or decision-support systems.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
HUMHUM-0064/5OtherGlobal

Generative AI Disrupts Copyright Ownership and Authorship Norms

Generative AI systems ingest copyrighted material without authorisation, reproduce protected content, and produce outputs whose legal ownership remains unresolved. Organisations face exposure to infringement liability while existing intellectual property frameworks prove inadequate for AI-generated work.

Source: MIT AI Risk Repository — Mapping the Ethics of Generative AI: A Comprehensive Scoping Review (Hagendorff2024)Ingested —
SECSEC-0014/5OtherGlobal

LLM Model Attacks: Exploitation of Vulnerabilities for Data Theft and Manipulation

Large language models are actively targeted by adversarial attacks designed to extract sensitive data or induce harmful outputs. Boards face material liability exposure where deployed LLMs lack formal adversarial testing and documented mitigation controls.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
SECSEC-0014/5TransportGlobal

Adversarial Attacks and Jailbreaking Vulnerabilities in Transport AI Systems

Generative AI systems in transport are exposed to prompt injection, model poisoning, and backdoor attacks that bypass safety guardrails. Boards face liability and operational risk if adversarial exploits compromise autonomous or safety-critical transport functions.

Source: MIT AI Risk Repository — Mapping the Ethics of Generative AI: A Comprehensive Scoping Review (Hagendorff2024)Ingested —
HUMHUM-0034/5OtherGlobal

Large Language Model Factual Inaccuracy in Generated Content

LLMs produce outputs containing incorrect factual claims, presenting false information as authoritative. Organisations relying on AI-generated content without verification processes face reputational, legal, and operational exposure.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
DATDAT-0023/5OtherGlobal

Generative AI Models Leak Sensitive Personal Data from Training Sets

Large language models retain and expose private information through both deliberate extraction and inadvertent leakage during inference. Boards face regulatory liability under data protection law if training data governance and sanitisation controls are not formally established.

Source: MIT AI Risk Repository — Mapping the Ethics of Generative AI: A Comprehensive Scoping Review (Hagendorff2024)Ingested —
DATDAT-0033/5OtherGlobal

Generative AI Models Reproduce Social Bias and Discriminatory Stereotypes

Large language models systematically encode and amplify unfair stereotypes across gender, race, and religion, producing discriminatory outputs at scale. Organisations deploying these systems face regulatory exposure and reputational liability without robust bias evaluation and mitigation controls.

Source: MIT AI Risk Repository — Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvements (Deng2023)Ingested —
GOVGOV-0015/5EnergyGlobal

Power-Seeking AI Agents Pose Systemic Risk to Energy Infrastructure Control

Goal-misaligned, utility-maximising AI agents operating within connected energy systems risk autonomous power-seeking behaviour that undermines human oversight. Governments face destabilised critical infrastructure and an erosion of sovereign control with no established regulatory framework to contain cascading failures.

Source: MIT AI Risk Repository — Examining the differential risk from high-level artificial intelligence and the question of control (Kilian2023)Ingested —
SECSEC-0013/5OtherGlobal

Python Interpreter Vulnerabilities Expose LLM Infrastructure

LLMs built on Python inherit security vulnerabilities from the Python interpreter itself, creating systemic risk across the AI development stack. Boards must treat interpreter-level weaknesses as a material infrastructure risk requiring dedicated patching governance and supplier assurance.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
SECSEC-0014/5OtherGlobal

LLM Software Supply Chain Vulnerabilities Expose Development Pipelines

Complex LLM toolchains introduce upstream threats that can compromise model integrity before deployment. Boards face regulatory and operational exposure where third-party dependencies lack adequate vendor assurance or audit trails.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
HUMHUM-0054/5OtherGlobal

AI-Amplified Individual Power Creates Systemic Wealth Concentration Risk

AI agents grant individual actors disproportionate economic leverage, accelerating wealth concentration beyond the reach of existing regulatory frameworks. Boards must assess exposure to reputational, legal, and operational risks arising from widening inequality enabled by AI deployment.

Source: MIT AI Risk Repository — Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016)Ingested —
DATDAT-0034/5OtherGlobal

Social Bias Embedded in LLM Training Data Produces Discriminatory Outputs

Large language models trained on biased datasets systematically reproduce social prejudices in their generated content. Organisations deploying such systems face regulatory exposure and reputational harm if outputs perpetuate discrimination against protected groups.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
SECSEC-0014/5OtherGlobal

LLM Misuse Enabling Academic Misconduct

Large language models are being exploited to commit academic fraud, undermining assessment integrity across educational and professional certification contexts. Organisations relying on credentialled talent face reputational and compliance exposure as qualification validity becomes harder to assure.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
SECSEC-0013/5OtherGlobal

LLM Development Toolchain Vulnerabilities Create Security Exposure

Complex software toolchains used to build large language models introduce attack surfaces that can compromise the integrity of the resulting systems. Boards face material risk from supply-chain vulnerabilities that may undermine the trustworthiness of AI deployed in regulated environments.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
SECSEC-0013/5OtherGlobal

LLM Code Generation Tools Introducing Hidden Software Vulnerabilities

AI-assisted code generation tools such as GitHub Copilot risk embedding latent security vulnerabilities into production software without developer awareness. Firms relying on such tools face material exposure to regulatory breach, system compromise, and liability under SEC cybersecurity disclosure requirements.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
SECSEC-0015/5TechnologyGlobal

Criminal Weaponisation of Dual-Use AI Systems

Adversarial actors can repurpose legitimate AI systems, such as autonomous navigation or behavioural models, to deliver physical or psychological harm at scale. Boards must treat dual-use capability as a material liability requiring access controls, provenance monitoring, and regulatory disclosure.

Source: MIT AI Risk Repository — TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI (Critch2023)Ingested —
SECSEC-0013/5OtherGlobal

Hardware Vulnerabilities in LLM Training and Inference Systems

Weaknesses in hardware used for LLM training and inference expose AI systems to exploitation, performance degradation, and supply chain risk. Boards must ensure infrastructure security is embedded in AI governance frameworks alongside software and model-level controls.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
HUMHUM-0034/5OtherGlobal

LLM Outputs Contradict Source Material Due to Faithfulness Errors

Large language models generate content that misrepresents or contradicts the source material provided, producing factually inaccurate outputs. Organisations relying on LLM-assisted workflows risk reputational, legal, and operational harm from unchecked hallucination in high-stakes decisions.

Source: MIT AI Risk Repository — Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)Ingested —
GOVGOV-0015/5OtherGlobal

Advanced AI Systems Identified as Potential Vectors for Societal Manipulation

Sufficiently capable AI systems may exploit deep models of human psychology to subtly shift societal behaviours at scale without detection. Governments face urgent pressure to establish oversight frameworks before such capabilities outpace regulatory capacity.

Source: MIT AI Risk Repository — Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016)Ingested —

Beyond accidental failureNational Security

We also track 20 hostile uses of AI.

National Security dashboard →

The public database covers AI that fails by accident. AIBlindspot National Security — exclusive to the Defence tier — tracks AI used as a weapon, mapped by capability:

State-Sponsored AI Operations
6
AI-Enabled Disinformation
5
Adversarial Attacks on AI
0
Autonomous Weapon Incidents
1
AI-Assisted Cyber Attacks
5
Dual-Use AI Misuse
3