Agents, LLMs, vector stores, custom logic—visibility can’t stop at the model call.
Get the context you need to debug failures, optimize performance, and keep AI features reliable.
Tolerated by 4 million developers
Full LLM Observability
See everything on one pane of glass
Track all agent runs, error rates, LLM calls, tokens used, and tool executions. Monitor traffic patterns and duration metrics across your AI-powered features.
Track Model Costs & Tokens
Monitor spending across models.
Compare costs across different models. See token usage breakdown by model, track input vs output tokens, and identify expensive operations.
Monitor tool execution
Track agent tool calls and errors.
See which tools your agents call, their error rates, average duration, and P95 latency. Identify slow or failing tool executions before they impact users.
Deep Trace Analysis
Debug with full context.
Dive into individual requests with full prompt and response context. See AI spans with agent invocations, tool executions, token counts, costs, and timing.
Getting started with Sentry is simple
We support every technology (except the ones we don't).
Get started with just a few lines of code.
Install sentry-sdk from PyPI:
Click to Copy
pip install "sentry-sdk"
Add OpenAIAgentsIntegration() to your integrations list:
Click to Copy
import sentry_sdk from sentry_sdk.integrations.openai_agents import OpenAIAgentsIntegration sentry_sdk.init( # Configure your DSN dsn="https://examplePublicKey@o0.ingest.sentry.io/0", # Add data like inputs and responses to/from LLMs and tools; # see https://docs.sentry.io/platforms/python/data-management/data-collected/ for more info send_default_pii=True, integrations=[ OpenAIAgentsIntegration(), ], )
That's it. Check out our documentation to ensure you have the latest instructions.
"Sentry played a significant role in helping us develop [Claude] Sonnet"
Since adopting Sentry, Anthropic has seen:
10-15%
increase in developer productivity
600+
engineers rely on Sentry to ship code
20-30%
faster incident resolution
Fix what's broken with LLM Observability
Get started with the only LLM observability platform that gives developers tools to fix application problems without compromising on velocity.