Verified record · from the answer index

nemo-evaluator-sdk

Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on local Docker, Slurm HPC, or cloud platforms. NVIDIA's enterprise-grade plat

skill:orchestra-research/ai-research-skills/nemo-evaluator-sdk · published by orchestra-research · source repository