Opik
Opik is an open-source LLM evaluation, testing, and tracing platform developed by Comet ML that enables developers to debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows. The platform provides a REST API for logging traces and spans, running automated evaluations with LLM-as-a-judge metrics, managing datasets and experiments, and tracking production performance. Opik supports over 40 framework integrations including LangChain, LlamaIndex, and OpenAI, and is available as a self-hosted open-source deployment or as a managed cloud service on Comet's platform.
APIs
Opik REST API
The Opik REST API provides programmatic access to all platform capabilities including logging traces and spans from LLM applications, managing datasets and experiment items, run...