LangSmith

Trace AI agents and inspect quality, cost, and latency

Website

Meet LangSmith

LangSmith traces and evaluates applications using language models or agents. A trace shows the steps of a run, including tool calls and multi-turn messages, for examining response quality, latency, or cost. SDKs and OpenTelemetry connect different frameworks to the platform.

Production dashboards follow usage, errors, and feedback. Code-based and model-based evaluations score the characteristics a team selects, with alerts for configured thresholds. Trace analysis groups common behaviors and failures. Developers can inspect a particular run or compare a recurring pattern, then use evaluations to examine the application's behavior after a change.

Discussion

Tried it? Share a useful thought or ask a question.

Product details

Status
Launched
Listed

Explore related topics