7 Category Safety Taxonomy With Fine Grained Failure Mode Classification

via “7-category safety taxonomy with fine-grained failure mode classification”

11K safety evaluation questions across 7 categories.

Unique: Implements 7-category safety taxonomy with category-balanced few-shot examples enabling systematic failure mode diagnosis. Most safety benchmarks (TruthfulQA, HarmBench) report only aggregate safety scores without category-level breakdown or category-specific few-shot examples.

vs others: Category stratification reveals which safety domains models struggle with, enabling targeted improvements; category-balanced few-shot examples support category-specific evaluation unlike benchmarks with random few-shot sampling.