Evals
Evals covers tools and platforms that score model, RAG and agent outputs (offline suites, LLM-as-judge, online evals).
In brief
Evals, in brief.
What it isEvals covers tools and platforms that score model, RAG and agent outputs (offline suites, LLM-as-judge, online evals).
Where it sitsOne of 16 categories in the Safety and trust layer. Safety and trust covers the tools that check, test and control AI systems: evaluations, guardrails, security, red-teaming, monitoring, and the platforms that handle governance and compliance.
What we track37 products, including Agenta, Amazon Bedrock Evaluations, Arize Phoenix, Atla (Selene evaluator models) and Azure AI Foundry evaluations.
The products
37 products in Evals.
Each name opens a search for that product in our index.
ProductMakerIts own site
From our census of 2026-11-08. A product listed here is one that belongs in this category; the search answer says whether we have checked it.
Questions
Evals, answered.
What is Evals in AI infrastructure?Evals covers tools and platforms that score model, RAG and agent outputs (offline suites, LLM-as-judge, online evals).
Which layer of AI infrastructure is Evals in?Evals is in the Safety and trust layer. Safety and trust covers the tools that check, test and control AI systems: evaluations, guardrails, security, red-teaming, monitoring, and the platforms that handle governance and compliance.
Which products are in Evals?We track 37 products in Evals, including Agenta, Amazon Bedrock Evaluations, Arize Phoenix, Atla (Selene evaluator models), Azure AI Foundry evaluations, Braintrust, Coval (voice and chat agent simulation) and Deepchecks LLM Evaluation. The full list is on this page.
Safety and trust
The other categories in Safety and trust.
AI agent management platformsAI governance & compliance platformsAI incident & risk databasesAI securityAI-generated content & deepfake detectionBias, fairness & explainabilityConfidential AI & private inferenceContent provenanceGuardrailsInterpretability & model internals toolingLLM & agent observabilityModeration & guard classifiersPrompt managementRed-teamingVoice & conversational agent simulation testing