MLflow

Meet MLflow

MLflow is an open-source platform for developing and operating machine learning models, LLM applications, and agents. Teams can record experiment parameters and metrics, inspect application traces, and evaluate behavior across changes. OpenTelemetry-based tracing connects calls and agent steps so developers can examine what happened during a run.

Prompt management records versions and lineage, while evaluation and optimization tools support testing revisions. An AI gateway centralizes model requests, routing, rate limits, and fallbacks. The agent server provides hosting with streaming and tracing support. Together, these tools help a team compare experiments and investigate production behavior using recorded runs, evaluations, and traces.