Factual Correctness Ground Truth Validation

via “factual-correctness-ground-truth-validation”

OpenAI's factuality benchmark for hallucination detection.

Unique: Uses human-curated ground truth with explicit fact-checking to ensure answer correctness, rather than relying on crowdsourced labels or automatic extraction, reducing noise in factuality evaluation

vs others: More reliable than crowdsourced QA benchmarks (like SQuAD) because answers are verified for factual accuracy rather than just extracted from source documents, eliminating cases where the source itself contains errors