LLM Test Server

Test AI integrations with predictable mock provider responses

Website

Meet LLM Test Server

LLM Test Server provides a local HTTP server that behaves like supported AI provider APIs, allowing developers to test an integration without depending on a live model response. Define replies, streaming chunks, tool calls, delays, or failures, then run the application's real SDK against those scenarios. Deterministic responses make it easier to reproduce a bug and verify the same behavior in continuous integration.

The server supports multiple provider families and can run with Docker or .NET Aspire. A dashboard exposes captured requests, scenario activity, and token statistics. Assertions help check what the application sent and how it handled the response, including error paths that can be difficult to trigger reliably against a production service.

Discussion

Tried it? Share a useful thought or ask a question.

Product details

Status
Launched
Listed

Explore related topics