Security & Privacy

Blindspots in model security, data poisoning, privacy leakage, infrastructure, model theft, and incident response.

Blindspots in this category

SEC-001ResilientCriticality 8/10

Model Security Vulnerabilities

Occurs when AI models lack adequate protection against adversarial attacks, manipulation, or theft, potentially compromising system integrity, safety, and competitive advantage.

“What specific threats could compromise this AI model, and how have we tested our defences?”

SEC-002ResilientCriticality 7/10

Data Poisoning Attack Risks

Emerges when adversaries inject malicious examples into training or feedback data, causing the model to learn behaviours that benefit the attacker or undermine the system.

“How do we protect our AI training data from malicious manipulation?”

SEC-003ResponsibleCriticality 8/10

Privacy Leakage Through Model Outputs

Occurs when models memorise and reproduce sensitive items from their training data, leaking personal or confidential information through normal use.

“Could our AI system inadvertently reveal sensitive information about individuals in our training data?”

SEC-004ResilientCriticality 8/10

Infrastructure Security Gaps

Manifests when AI infrastructure lacks adequate security controls, creating vulnerabilities for compromise of models, data, and operations.

“Is the underlying infrastructure (servers, cloud services, networks) properly secured for AI workloads?”

SEC-005ResilientCriticality 6/10

Model Theft and Intellectual Property Risks

Occurs when proprietary models can be extracted, reverse-engineered, or copied through API queries or insider access, eliminating competitive advantage.

“How do we protect our AI models from theft or unauthorised copying?”

SEC-006ResilientCriticality 7/10

Incident Response Inadequacies

Manifests when organisations rely on generic incident response procedures inadequate for AI-specific threats, leading to prolonged exposure and ineffective containment.

“Do we have proper procedures to respond to AI security incidents?”