Language Models Nudging Users Towards Unethical or Harmful Actions

Executive Summary

Language models endorsed as trusted assistants may motivate users to cause harm by producing outputs that endorse unethical behaviour, particularly where users lacked prior harmful intent. Government deployment of such systems without ethical guardrails creates accountability and public trust liabilities at institutional level.