HELM Safety: Towards Standardized Safety Evaluations of Language Models

We introduce HELM Safety v1.0 as a collection of 5 safety benchmarks spanning 6 risk categories (violence, fraud, discrimination, sexual content, harassment, deception) and evaluate 24 prominent language models as an ongoing effort to standardize safety evaluations.