# LLM evals developer tools

> 9 developer and vibe-coding tools tagged evals in the Digidle Tools directory, across categories, A to Z, each with its official link.

- Tag page: https://digidle.com/tags/evals/
- All tags: https://digidle.com/tags/

## Tools (A to Z, not a ranking)

- [Arize Phoenix](https://digidle.com/tools/arize-phoenix.md) (Analytics & Monitoring): Arize's AI observability platform, source-available under the Elastic License 2.0: OpenTelemetry tracing through OpenInference for OpenAI, Anthropic, LangGraph, the Vercel AI SDK and more, with LLM evals, datasets, experiments and a prompt playground; runs locally, in Docker or on Kubernetes. Official site: https://arize.com/phoenix/.
- [Braintrust](https://digidle.com/tools/braintrust.md) (Analytics & Monitoring): Observability and evals platform for AI agents: trace production calls from OpenAI, Anthropic, Gemini, the Vercel AI SDK, LangChain and more, run experiments scored by LLM judges, Autoevals or your own code, review in playgrounds and human annotation queues, and let the built-in Loop agent generate test cases and build evals. MCP server and a bt CLI. Free Starter plan with unlimited users; Pro $249 a month. Official site: https://www.braintrust.dev.
- [Laminar](https://digidle.com/tools/laminar.md) (Analytics & Monitoring): Open-source (Apache-2.0) observability for AI agents, written in Rust: one-line OpenTelemetry tracing for the Vercel AI SDK, Browser Use, Stagehand, LangChain, OpenAI, Anthropic and more, Signals that flag behaviour you describe in plain English, evals from an SDK and CLI, browser session recordings, SQL over traces and MCP access for coding agents. Self-host with Docker Compose, or use the cloud, free for 1 GB of data. Official site: https://laminar.sh.
- [Langfuse](https://digidle.com/tools/langfuse.md) (Analytics & Monitoring): Open-source LLM engineering platform: traces and sessions for LLM apps and agents with token and cost tracking, prompt management, datasets, LLM-as-judge and human evals; OpenTelemetry-based, self-host free or use Langfuse Cloud in the US, EU or Japan. Official site: https://langfuse.com.
- [LangSmith](https://digidle.com/tools/langsmith.md) (Analytics & Monitoring): LangChain's platform for agents: tracing and online and offline evals for any framework, plus managed agent deployment, sandboxes and an LLM gateway; cloud in the US or EU, hybrid or self-hosted on Enterprise. Official site: https://www.langchain.com/langsmith/observability.
- [Latitude](https://digidle.com/tools/latitude.md) (Analytics & Monitoring): Open-source (MIT) observability and quality platform for AI agents: traces production runs, groups failures into tracked issues with evals attached, dispatches your coding agent to fix them and replays the fix against the failing traces. MCP server and CLI. Free Starter plan with 20K credits a month; Pro $99 a month. Official site: https://latitude.so.
- [Opik](https://digidle.com/tools/opik.md) (Analytics & Monitoring): Comet's open-source (Apache-2.0) LLM observability and evaluation platform: traces for agents and multi-turn conversations, datasets and experiments with 30+ LLM-as-a-judge and heuristic metrics, pass/fail test suites, a PyTest integration for CI, online evaluation rules on production traces, guardrails and an agent optimizer. The full platform, backend included, self-hosts free; Opik Cloud is free for 25K spans a month. Official site: https://www.comet.com/site/products/opik/.
- [Promptic](https://digidle.com/tools/promptic.md) (Analytics & Monitoring): Optimization platform for GenAI apps: OpenTelemetry-native LLM tracing, model benchmarking and one-click prompt and agent tuning scored on your own quality and cost metrics; free tier, team plans from €149/month. Official site: https://promptic.eu.
- [W&B Weave](https://digidle.com/tools/wandb-weave.md) (Analytics & Monitoring): Weights & Biases' toolkit for tracing and evaluating AI agents: sessions, turns, tool calls and sub-agents as first-class traces, an evaluation framework with comparisons and leaderboards, built-in signals with Slack alerts, guardrail scorers for toxicity, PII and hallucinations, a playground, and an MCP server so coding agents can read traces and run evals. SDK is open source (Apache-2.0); free plan with 1 GB of trace data a month, Pro from $60 a month. Official site: https://wandb.ai/site/weave/.

---
Source: Digidle Tools (https://digidle.com/), a curated directory of developer and vibe-coding tools. Pricing is not verified by Digidle unless stated in a description; check the official site. Full index: https://digidle.com/llms.txt