OpenLLM

Route coding agents across cloud APIs, subscriptions, and local models

Website

Meet OpenLLM

OpenLLM adds a routing layer between your AI tools and the models you can access. It connects cloud APIs, supported subscriptions, and local model servers, allowing tools such as Claude Code, Codex, and OpenCode to use a common setup. You install the Mac app or command-line tool, then run an agent through OpenLLM.

Fallback chains can move a request to another model when a provider becomes unavailable or reaches a limit. Shared memory and integrations help carry project context between agents, reducing repeated setup across clients. Accounts include an initial inference allowance, so you can try the workflow before connecting your own providers. The service also supports using models and connections across your devices.

Discussion

Tried it? Share a useful thought or ask a question.

Product details

Website
openllm.sh
Status
Launched
Listed

Explore related topics