LLM router

Wyolet Relay is a self-hosted LLM router that exposes OpenAI- and Anthropic-compatible endpoints in front of multiple providers. It pools API keys, handles failover and rate limits, tracks usage and cost, and includes a quickstart plus Docker-based deployment.

Millwright is a self-hosted Rust LLM router that sits between apps and model providers to enforce policy-based routing, control spend, and preserve provider/model affinity for cache reuse.

Brick is an AI model routing gateway that sends each query to the most suitable LLM based on capability and complexity. The repository includes quickstart steps, Claude Code integration, an OpenAI-compatible endpoint, and a short explanation of when to use it.