Category Specific Leaderboard Segmentation

via “category-specific leaderboard segmentation”

Crowdsourced LLM evaluation — side-by-side blind voting, Elo ratings, most trusted LLM benchmark.

Unique: Enables multi-dimensional model evaluation by computing independent Elo ratings per category rather than collapsing all votes into a single global ranking. This reveals capability variation across domains that a single leaderboard would obscure.

vs others: More nuanced than single-metric leaderboards because it exposes domain-specific strengths/weaknesses; more practical than separate benchmarks because it reuses the same voting infrastructure

via “multi-tier model leaderboard organization with category-based filtering”

ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大

Unique: Implements multi-dimensional leaderboard organization (commercial/open-source primary split, then price tier or parameter size secondary split) with separate ranked lists for reasoning-specialized models. Uses markdown-based leaderboard storage (commerce2.md, reasonmodel.md, alldata.md) enabling version control and community contributions. Maintains model metadata (provider, parameters, pricing) alongside evaluation scores for context-aware comparison.

vs others: More granular category-based filtering than MMLU leaderboards (which use single global ranking) and explicit price-tier organization vs Hugging Face Model Hub (which lacks domain-specific performance context)

via “prompt categorization and stratified evaluation tracking”

arena-leaderboard — AI demo on HuggingFace

Unique: Stratifies leaderboard rankings by prompt category, revealing domain-specific model strengths that aggregate rankings obscure. Enables users to find best-fit models for specific applications rather than relying on single overall score.

vs others: More actionable than single-score leaderboards because it shows which models excel at specific tasks, and more representative than category-agnostic benchmarks because it captures real-world use case diversity.