Best AI Agent Evals, Tracing & Observability Tools

Trajectory tracing, automated evaluation suites, cost tracking, and runtime guardrails for production agents.

11 verified tools on file · 6 open source

HE

Helicone

helicone.ai

Open-source LLM proxy and observability platform for cost tracking, caching, and logs

Evals & TracingFreemium
PL

Pydantic Logfire

pydantic.dev

OpenTelemetry-native observability platform with first-class PydanticAI agent tracing

Evals & TracingFreemium
CO

Comet Opik

comet.com

Open-source LLM evaluation and high-volume agent trace logging platform

Evals & TracingFreemium
LA

Langfuse

langfuse.com

Open-source LLM engineering platform for agent tracing, prompt management, and evals

Evals & TracingFreemium
PR

Promptfoo

promptfoo.dev

Open-source CLI for automated LLM evals, agent regression tests, and security red-teaming

Evals & TracingFree / OSS
LG

Lakera Guard

lakera.ai

Real-time prompt-injection, jailbreak, and data-leakage firewall for AI agents

Evals & TracingFreemium
GA

Galileo

galileo.ai

Agent reliability platform for hallucination detection, tool-call scoring, and guardrails

Evals & TracingFreemium
LA

LangSmith

langchain.com

Tracing, dataset curation, online evals, and prompt playground for multi-step agents

Evals & TracingFreemium
BR

Braintrust

braintrust.dev

End-to-end evals, trace logging, and PR regression diffs for production AI agents

Evals & TracingFreemium
AP

Arize Phoenix

phoenix.arize.com

Open-source OpenTelemetry tracing and evaluation suite for LLM and agent trajectories

Evals & TracingFree / OSS
WW

W&B Weave

wandb.ai

Lightweight tracing, evaluation, and model comparison toolkit from Weights & Biases

Evals & TracingFreemium

Explore nearby categories