AgentOps logo

AgentOps

AgentOps is an observability, evaluation, and debugging platform for AI agents. Its open-source Python SDK (with TypeScript support for OpenAI Agents) instruments agent runs in two lines of code, capturing LLM calls, tool invocations, costs, latencies, and multi-agent interactions. Sessions are visualized in a hosted dashboard at app.agentops.ai with time-travel debugging, waterfall views, and replay. AgentOps offers native integrations with 400+ LLMs and frameworks including CrewAI, AutoGen / AG2, LangChain, LangGraph, LlamaIndex, OpenAI Agents, Haystack, and Camel AI.

3 APIs 8 Features
AI AgentsObservabilityEvaluationTracingPython SDKOpen SourceAgent Frameworks

AgentOps publishes 3 APIs on the APIs.io network. Tagged areas include AI Agents, Observability, Evaluation, Tracing, and Python SDK.

AgentOps’ developer surface includes documentation, engineering blog, pricing, and 8 more developer resources.

APIs

AgentOps Python SDK

The AgentOps Python SDK is the primary entry point, installable via pip install agentops and initialized with two lines of code. It auto-instruments supported agent frameworks a...

AgentOps TypeScript SDK

AgentOps' TypeScript SDK provides instrumentation for the OpenAI Agents SDK in Node.js applications, surfacing the same traces and metrics as the Python SDK inside the AgentOps ...

AgentOps Dashboard

The hosted dashboard at app.agentops.ai visualizes agent sessions with waterfall views, time-travel replay, LLM cost tracking, and multi-agent interaction graphs. Supports sessi...

Features

Two-Line Instrumentation

Initialize observability with agentops.init() and automatic framework instrumentation.

Session Replay

Time-travel debugging with full session and event replay in the dashboard.

LLM Cost Tracking

Token counting and cost tracking across foundation model providers and agents.

Multi-Agent Visualization

Visualize interactions between agents in CrewAI, AutoGen, LangGraph, and custom systems.

Waterfall Traces

Time-based waterfall views of all events in a session.

Custom Traces

Use the @trace decorator and OTel-aligned spans to instrument custom code paths.

Self-Hosting

Self-hosted deployment available on Enterprise plans.

SOC 2 / HIPAA

Enterprise compliance with SOC 2 and HIPAA available on the Enterprise tier.

Use Cases

Agent Debugging

Inspect multi-step agent runs, tool calls, and intermediate reasoning to find failures.

Cost Monitoring

Track token usage and cost per agent, framework, and provider.

Agent Evaluation

Evaluate agent performance across sessions and compare versions.

Production Observability

Monitor production agents with dashboards, alerts, and exports.

Multi-Agent Systems

Visualize and debug coordination between agents in multi-agent frameworks.

Integrations

OpenAI

Native instrumentation for OpenAI Chat Completions and Responses APIs.

OpenAI Agents SDK

First-class support for OpenAI Agents in Python and TypeScript.

Anthropic

Instrumentation for Anthropic Claude models.

CrewAI

Native CrewAI integration with multi-agent visualization.

AG2 (AutoGen)

Native integration with AG2, formerly AutoGen.

LangChain

Instrumentation for LangChain chains and agents.

LangGraph

Trace and visualize LangGraph stateful agents.

LlamaIndex

Trace LlamaIndex RAG and agent applications.

Haystack

Instrumentation for Haystack pipelines.

Camel AI

Native integration with Camel AI multi-agent system.

Cohere

Instrumentation for Cohere model calls.

LiteLLM

Capture calls routed through LiteLLM across providers.

Mistral

Instrumentation for Mistral models.

Google Generative AI

Instrumentation for Gemini and Vertex AI.

xAI

Instrumentation for xAI Grok models.

Resources

🔗
Website
Website
🔗
Documentation
Documentation
📰
Blog
Blog
💰
Pricing
Pricing
🔗
Login
Login
👥
GitHubOrganization
GitHubOrganization
👥
GitHubRepository
GitHubRepository
🔗
LinkedIn
LinkedIn
🔗
Discord
Discord
🔗
Courses
Courses
🔗
License
License

Sources

apis.yml Raw ↑
aid: agentops
url: https://raw.githubusercontent.com/api-evangelist/agentops/refs/heads/main/apis.yml
name: AgentOps
type: Index
image: https://kinlane-productions.s3.amazonaws.com/apis-json/apis-json-logo.jpg
tags:
- AI Agents
- Observability
- Evaluation
- Tracing
- Python SDK
- Open Source
- Agent Frameworks
description: AgentOps is an observability, evaluation, and debugging platform for AI agents. Its open-source Python SDK
  (with TypeScript support for OpenAI Agents) instruments agent runs in two lines of code, capturing LLM calls, tool invocations,
  costs, latencies, and multi-agent interactions. Sessions are visualized in a hosted dashboard at app.agentops.ai with
  time-travel debugging, waterfall views, and replay. AgentOps offers native integrations with 400+ LLMs and frameworks
  including CrewAI, AutoGen / AG2, LangChain, LangGraph, LlamaIndex, OpenAI Agents, Haystack, and Camel AI.
created: '2026-05-23'
modified: '2026-05-23'
specificationVersion: '0.19'
apis:
- aid: agentops:agentops-python-sdk
  name: AgentOps Python SDK
  tags:
  - SDK
  - Python
  - Tracing
  - Instrumentation
  humanURL: https://docs.agentops.ai/
  properties:
  - url: https://docs.agentops.ai/
    type: Documentation
  - url: https://github.com/AgentOps-AI/agentops
    type: SourceCode
  - url: https://pypi.org/project/agentops/
    type: SDK
  description: The AgentOps Python SDK is the primary entry point, installable via pip install agentops and initialized
    with two lines of code. It auto-instruments supported agent frameworks and LLM providers, supports custom traces via
    the @trace decorator, and ships events to the AgentOps backend or a self-hosted deployment.
- aid: agentops:agentops-typescript-sdk
  name: AgentOps TypeScript SDK
  tags:
  - SDK
  - TypeScript
  - JavaScript
  - OpenAI Agents
  humanURL: https://docs.agentops.ai/v2/integrations/openai-agents-js
  properties:
  - url: https://docs.agentops.ai/v2/integrations/openai-agents-js
    type: Documentation
  - url: https://github.com/AgentOps-AI/agentops-node
    type: SourceCode
  description: AgentOps' TypeScript SDK provides instrumentation for the OpenAI Agents SDK in Node.js applications, surfacing
    the same traces and metrics as the Python SDK inside the AgentOps dashboard.
- aid: agentops:agentops-dashboard
  name: AgentOps Dashboard
  tags:
  - Dashboard
  - Observability
  - SaaS
  - Replay
  humanURL: https://app.agentops.ai/
  properties:
  - url: https://app.agentops.ai/
    type: ApplicationURL
  - url: https://docs.agentops.ai/v2/usage/dashboard
    type: Documentation
  description: The hosted dashboard at app.agentops.ai visualizes agent sessions with waterfall views, time-travel replay,
    LLM cost tracking, and multi-agent interaction graphs. Supports session export and team collaboration features in paid
    tiers.
common:
- type: Website
  url: https://www.agentops.ai/
- type: Documentation
  url: https://docs.agentops.ai/
- type: Blog
  url: https://www.agentops.ai/blog
- type: Pricing
  url: https://www.agentops.ai/pricing
- type: Login
  url: https://app.agentops.ai/
- type: GitHubOrganization
  url: https://github.com/AgentOps-AI
- type: GitHubRepository
  url: https://github.com/AgentOps-AI/agentops
- type: LinkedIn
  url: https://www.linkedin.com/company/agentops-ai/
- type: Discord
  url: https://discord.gg/FagdcwwXRR
- type: Courses
  url: https://agentops.ai/courses
- type: License
  url: https://github.com/AgentOps-AI/agentops/blob/main/LICENSE
- type: Features
  data:
  - name: Two-Line Instrumentation
    description: Initialize observability with agentops.init() and automatic framework instrumentation.
  - name: Session Replay
    description: Time-travel debugging with full session and event replay in the dashboard.
  - name: LLM Cost Tracking
    description: Token counting and cost tracking across foundation model providers and agents.
  - name: Multi-Agent Visualization
    description: Visualize interactions between agents in CrewAI, AutoGen, LangGraph, and custom systems.
  - name: Waterfall Traces
    description: Time-based waterfall views of all events in a session.
  - name: Custom Traces
    description: Use the @trace decorator and OTel-aligned spans to instrument custom code paths.
  - name: Self-Hosting
    description: Self-hosted deployment available on Enterprise plans.
  - name: SOC 2 / HIPAA
    description: Enterprise compliance with SOC 2 and HIPAA available on the Enterprise tier.
- type: UseCases
  data:
  - name: Agent Debugging
    description: Inspect multi-step agent runs, tool calls, and intermediate reasoning to find failures.
  - name: Cost Monitoring
    description: Track token usage and cost per agent, framework, and provider.
  - name: Agent Evaluation
    description: Evaluate agent performance across sessions and compare versions.
  - name: Production Observability
    description: Monitor production agents with dashboards, alerts, and exports.
  - name: Multi-Agent Systems
    description: Visualize and debug coordination between agents in multi-agent frameworks.
- type: Integrations
  data:
  - name: OpenAI
    description: Native instrumentation for OpenAI Chat Completions and Responses APIs.
  - name: OpenAI Agents SDK
    description: First-class support for OpenAI Agents in Python and TypeScript.
  - name: Anthropic
    description: Instrumentation for Anthropic Claude models.
  - name: CrewAI
    description: Native CrewAI integration with multi-agent visualization.
  - name: AG2 (AutoGen)
    description: Native integration with AG2, formerly AutoGen.
  - name: LangChain
    description: Instrumentation for LangChain chains and agents.
  - name: LangGraph
    description: Trace and visualize LangGraph stateful agents.
  - name: LlamaIndex
    description: Trace LlamaIndex RAG and agent applications.
  - name: Haystack
    description: Instrumentation for Haystack pipelines.
  - name: Camel AI
    description: Native integration with Camel AI multi-agent system.
  - name: Cohere
    description: Instrumentation for Cohere model calls.
  - name: LiteLLM
    description: Capture calls routed through LiteLLM across providers.
  - name: Mistral
    description: Instrumentation for Mistral models.
  - name: Google Generative AI
    description: Instrumentation for Gemini and Vertex AI.
  - name: xAI
    description: Instrumentation for xAI Grok models.
maintainers:
- FN: Kin Lane
  email: [email protected]