ARBR

Route and govern AI model requests through a self-hosted gateway.

Website

Meet ARBR

ARBR is an open-source gateway that gives applications one OpenAI-compatible endpoint for requests to different model providers. Teams can choose models through routing rules, task characteristics, and fallback policies instead of wiring each decision into application code. The gateway can be self-hosted and used with existing provider accounts.

Budgets, rate limits, and a kill switch help control execution before a request runs. Logs, metrics, and OpenTelemetry support make cost and behavior visible afterward. Evaluation features include model-based judging, canary traffic, and shadow runs for comparing changes. ARBR brings these controls together so developers can manage model selection and operational limits in one place.

Discussion

Tried it? Share a useful thought or ask a question.

Product details

Status
Launched
Listed

Explore related topics