BaseRT

Run supported language models locally on Apple Silicon

Website

Meet BaseRT

BaseRT is a runtime for running supported AI models on Apple Silicon. Developers can serve a model locally and connect compatible applications or coding agents to that local endpoint. The official setup includes an example integration with the Pi coding agent, making it useful for experimenting with an on-device development workflow.

The supported model list includes selected families from Qwen, Llama, Gemma, Mistral, Phi, and Nomic. Documentation and technical reports explain the runtime and its performance measurements. Published benchmarks compare particular model, quantization, and hardware combinations, so those results should not be read as a universal speed guarantee. Users still need a compatible Mac and sufficient resources for the model they choose.

Discussion

Tried it? Share a useful thought or ask a question.

Product details

Status
Launched
Listed

Explore related topics