XSTest

XSTest is a safety evaluation benchmark featuring 250 safe prompts and 200 unsafe prompts designed to identify exaggerated safety behaviors in large language models. This systematic test suite evaluates AI models' ability to appropriately comply with safe requests while refusing unsafe ones, highlighting systematic failure modes and challenges in building safer, more reliable language models.