Helicone
Open-source LLM proxy and observability platform for cost tracking, caching, and logs
Trajectory tracing, automated evaluation suites, cost tracking, and runtime guardrails for production agents.
11 verified tools on file · 6 open source
Open-source LLM proxy and observability platform for cost tracking, caching, and logs
OpenTelemetry-native observability platform with first-class PydanticAI agent tracing
Open-source LLM evaluation and high-volume agent trace logging platform
Open-source LLM engineering platform for agent tracing, prompt management, and evals
Open-source CLI for automated LLM evals, agent regression tests, and security red-teaming
Real-time prompt-injection, jailbreak, and data-leakage firewall for AI agents
Agent reliability platform for hallucination detection, tool-call scoring, and guardrails
Tracing, dataset curation, online evals, and prompt playground for multi-step agents
End-to-end evals, trace logging, and PR regression diffs for production AI agents
Open-source OpenTelemetry tracing and evaluation suite for LLM and agent trajectories
Lightweight tracing, evaluation, and model comparison toolkit from Weights & Biases