Opik
Comet's open-source (Apache-2.0) LLM observability and evaluation platform: traces for agents and multi-turn conversations, datasets and experiments with 30+ LLM-as-a-judge and heuristic metrics, pass/fail test suites, a PyTest integration for CI, online evaluation rules on production traces, guardrails and an agent optimizer. The full platform, backend included, self-hosts free; Opik Cloud is free for 25K spans a month.
- Category
- Analytics & MonitoringProduct analytics, error tracking and observability.
- Website
- comet.comOfficial site, opens in a new tab.
- Pricing
- See official siteWe only list verified pricing.
Part of the AI Agent Infrastructure collection.
On the LLM observability and eval tools list.
Built Opik? Get featured
Similar tools.
PostHog
Open-source product analytics suite with session replay, feature flags and experiments.
Sentry
Application monitoring for error tracking, tracing and performance.
Plausible
Lightweight, privacy-friendly, open-source web analytics.
Kerno
AI runtime QA for backends: tests user flows against your real stack from inside MCP-capable coding agents.
The 2 biggest AI stories, every morning.
One short email: the two stories that matter, and why.
You're in.
The Daily AI Brief will land in your inbox soon. If you don't see it, check Promotions or Spam and move it to your main inbox.