failover

Wyolet Relay is a self-hosted LLM router that exposes OpenAI- and Anthropic-compatible endpoints in front of multiple providers. It pools API keys, handles failover and rate limits, tracks usage and cost, and includes a quickstart plus Docker-based deployment.

Open-source terminal coding agent in Rust with LLM-native code understanding, shell safety, multi-provider support, and automatic failover.

AISBF is a self-hostable AI service broker and OpenAI-compatible proxy/router for routing requests across multiple providers, adding prompt-aware model selection, failover, quotas, analytics, and privacy-focused deployment options.

Open-source Rust coding agent with LLM-native code understanding, shell safety, and support for multiple LLM providers with automatic failover.

Bifrost is a high-performance AI gateway that provides a single OpenAI-compatible API across 23+ model providers, with automatic failover, load balancing, semantic caching, and enterprise deployment features.