LLM & agent observability
LLM & agent observability covers tracing, cost, latency, tool-call and usage analytics for LLM apps and agents.
In brief
LLM & agent observability, in brief.
What it isLLM & agent observability covers tracing, cost, latency, tool-call and usage analytics for LLM apps and agents.
Where it sitsOne of 16 categories in the Safety and trust layer. Safety and trust covers the tools that check, test and control AI systems: evaluations, guardrails, security, red-teaming, monitoring, and the platforms that handle governance and compliance.
What we track35 products, including AgentOps, Arize AX, Arize Phoenix, Braintrust (logging and tracing) and Coze Loop.
The products
35 products in LLM & agent observability.
Each name opens a search for that product in our index.
ProductMakerIts own site
From our census of 2026-11-08. A product listed here is one that belongs in this category; the search answer says whether we have checked it.
Questions
LLM & agent observability, answered.
What is LLM & agent observability in AI infrastructure?LLM & agent observability covers tracing, cost, latency, tool-call and usage analytics for LLM apps and agents.
Which layer of AI infrastructure is LLM & agent observability in?LLM & agent observability is in the Safety and trust layer. Safety and trust covers the tools that check, test and control AI systems: evaluations, guardrails, security, red-teaming, monitoring, and the platforms that handle governance and compliance.
Which products are in LLM & agent observability?We track 35 products in LLM & agent observability, including AgentOps, Arize AX, Arize Phoenix, Braintrust (logging and tracing), Coze Loop, Datadog LLM Observability, Dynatrace AI Observability and Elastic LLM Observability. The full list is on this page.
Safety and trust
The other categories in Safety and trust.
AI agent management platformsAI governance & compliance platformsAI incident & risk databasesAI securityAI-generated content & deepfake detectionBias, fairness & explainabilityConfidential AI & private inferenceContent provenanceEvalsGuardrailsInterpretability & model internals toolingModeration & guard classifiersPrompt managementRed-teamingVoice & conversational agent simulation testing