# LLM observability developer tools

> 9 developer and vibe-coding tools tagged llm-observability in the Digidle Tools directory, across categories, A to Z, each with its official link.

- Tag page: https://digidle.com/tags/llm-observability/
- All tags: https://digidle.com/tags/

## Tools (A to Z, not a ranking)

- [Arize Phoenix](https://digidle.com/tools/arize-phoenix.md) (Analytics & Monitoring): Arize's AI observability platform, source-available under the Elastic License 2.0: OpenTelemetry tracing through OpenInference for OpenAI, Anthropic, LangGraph, the Vercel AI SDK and more, with LLM evals, datasets, experiments and a prompt playground; runs locally, in Docker or on Kubernetes. Official site: https://arize.com/phoenix/.
- [Braintrust](https://digidle.com/tools/braintrust.md) (Analytics & Monitoring): Observability and evals platform for AI agents: trace production calls from OpenAI, Anthropic, Gemini, the Vercel AI SDK, LangChain and more, run experiments scored by LLM judges, Autoevals or your own code, review in playgrounds and human annotation queues, and let the built-in Loop agent generate test cases and build evals. MCP server and a bt CLI. Free Starter plan with unlimited users; Pro $249 a month. Official site: https://www.braintrust.dev.
- [Helicone](https://digidle.com/tools/helicone.md) (Analytics & Monitoring): Open-source (Apache-2.0) AI gateway and LLM observability platform: point an OpenAI-compatible client at one URL to reach 100+ models with routing and automatic fallbacks, and every request is logged with cost, latency, sessions and agent traces. Prompt versioning, a playground, and scores and datasets for evaluating outputs. Self-host with Docker Compose or use the cloud, free for 10,000 requests a month. Official site: https://www.helicone.ai.
- [Laminar](https://digidle.com/tools/laminar.md) (Analytics & Monitoring): Open-source (Apache-2.0) observability for AI agents, written in Rust: one-line OpenTelemetry tracing for the Vercel AI SDK, Browser Use, Stagehand, LangChain, OpenAI, Anthropic and more, Signals that flag behaviour you describe in plain English, evals from an SDK and CLI, browser session recordings, SQL over traces and MCP access for coding agents. Self-host with Docker Compose, or use the cloud, free for 1 GB of data. Official site: https://laminar.sh.
- [Langfuse](https://digidle.com/tools/langfuse.md) (Analytics & Monitoring): Open-source LLM engineering platform: traces and sessions for LLM apps and agents with token and cost tracking, prompt management, datasets, LLM-as-judge and human evals; OpenTelemetry-based, self-host free or use Langfuse Cloud in the US, EU or Japan. Official site: https://langfuse.com.
- [LangSmith](https://digidle.com/tools/langsmith.md) (Analytics & Monitoring): LangChain's platform for agents: tracing and online and offline evals for any framework, plus managed agent deployment, sandboxes and an LLM gateway; cloud in the US or EU, hybrid or self-hosted on Enterprise. Official site: https://www.langchain.com/langsmith/observability.
- [Latitude](https://digidle.com/tools/latitude.md) (Analytics & Monitoring): Open-source (MIT) observability and quality platform for AI agents: traces production runs, groups failures into tracked issues with evals attached, dispatches your coding agent to fix them and replays the fix against the failing traces. MCP server and CLI. Free Starter plan with 20K credits a month; Pro $99 a month. Official site: https://latitude.so.
- [Opik](https://digidle.com/tools/opik.md) (Analytics & Monitoring): Comet's open-source (Apache-2.0) LLM observability and evaluation platform: traces for agents and multi-turn conversations, datasets and experiments with 30+ LLM-as-a-judge and heuristic metrics, pass/fail test suites, a PyTest integration for CI, online evaluation rules on production traces, guardrails and an agent optimizer. The full platform, backend included, self-hosts free; Opik Cloud is free for 25K spans a month. Official site: https://www.comet.com/site/products/opik/.
- [W&B Weave](https://digidle.com/tools/wandb-weave.md) (Analytics & Monitoring): Weights & Biases' toolkit for tracing and evaluating AI agents: sessions, turns, tool calls and sub-agents as first-class traces, an evaluation framework with comparisons and leaderboards, built-in signals with Slack alerts, guardrail scorers for toxicity, PII and hallucinations, a playground, and an MCP server so coding agents can read traces and run evals. SDK is open source (Apache-2.0); free plan with 1 GB of trace data a month, Pro from $60 a month. Official site: https://wandb.ai/site/weave/.

---
Source: Digidle Tools (https://digidle.com/), a curated directory of developer and vibe-coding tools. Pricing is not verified by Digidle unless stated in a description; check the official site. Full index: https://digidle.com/llms.txt