AIBlindspot
← All case studies
SECSEC-001 — Model Security Vulnerabilities

Generative AI Weaponised to Produce Hateful and Obscene Content

4/5Sector: OtherGeography: GlobalStage: OperateIngested: —

Executive Summary

Generative AI models can be deliberately prompted to produce hateful, abusive, and profane material at scale. Boards face regulatory exposure and reputational liability if deployed systems lack robust content controls and misuse detection.

Domain

Security & Privacy

Blindspots in model security, data poisoning, privacy leakage, infrastructure, model theft, and incident response.

Source

MIT AI Risk Repository — AI Risk Atlas (IBM2025) ↗

https://airisk.mit.edu/

Could this happen in your organisation?

A Velinor AI Audit maps your active AI portfolio against the 50+ blindspots and benchmarks against documented sector failures like this one. A board-ready foresight document in 5 weeks.