AIBlindspot
← All case studies
SECSEC-001 — Model Security Vulnerabilities

Generative AI Tools Used to Produce Non-Consensual Sexual Content

4/5Sector: TechnologyGeography: GlobalStage: OperateIngested: —

Executive Summary

Generative AI platforms have been exploited to create sexualised imagery and content of real individuals without their consent, constituting a direct harm to victims and a legal liability for developers. Boards must assess exposure under existing harassment, data protection, and emerging deepfake legislation, and require vendors to demonstrate robust content safeguards.

Domain

Security & Privacy

Blindspots in model security, data poisoning, privacy leakage, infrastructure, model theft, and incident response.

Source

MIT AI Risk Repository — A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents (Li2025) ↗

https://airisk.mit.edu/

Could this happen in your organisation?

A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.