AUDR
An open record format for attributing AI-agent usage and costs
Observability
Understand internal system behavior through outputs such as logs, metrics, traces, and operational events.
Superlog
Automate engineering triage, operational reviews, and support workflows
Polylane
Investigate production issues and propose fixes as pull requests
guilds.run
Run inspectable AI agent teams with shared memory and workflows
Prefactor
Observe, evaluate, and control AI agent runs in production
Grafana
Explore production telemetry with dashboards, monitoring and incident investigation tools.
MLflow
Trace, evaluate and manage models, LLM applications and agents
PromptLayer
Version prompts, evaluate changes, and trace AI applications in production
Arize
Observe, evaluate, and debug AI agents in production
LangSmith
Trace AI agents and inspect quality, cost, and latency
DevCycle
Feature flag management built around the OpenFeature standard
Honeycomb
Explore production traces and investigate unusual behavior
Datadog
Monitoring for applications, infrastructure, logs, and security
New Relic
Application monitoring with connected telemetry and traces
Comet
Track experiments and evaluate AI applications
Sentry
Connect application errors with the context to fix them.
Better Stack
Bring monitoring and incident response into one view.