ai gateway

Open-source identity-based remote access platform built on WireGuard, combining reverse proxy, VPN, SSO, and access control. The page also shows an AI gateway use case for putting cloud and self-hosted model access behind a single authenticated URL.

ModelPlane is an OpenAI-compatible AI gateway that routes requests across multiple model providers through one endpoint. It includes model groups, fallback and weighted routing, multiple provider support, reasoning output normalization, and usage/billing tracking.

Self-hosted AI gateway in Go that routes requests across 30+ LLM providers through a single OpenAI- and Anthropic-compatible API.

Open-source tool that runs on a machine to intercept, inspect, and optionally route Claude and ChatGPT traffic through an AI gateway for logging, policy checks, and governance.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

Bifrost is a high-performance AI gateway that provides a single OpenAI-compatible API across 23+ model providers, with automatic failover, load balancing, semantic caching, and enterprise deployment features.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.