ai gateway

Open-source identity-based remote access platform built on WireGuard, combining reverse proxy, VPN, SSO, and access control. The page also shows an AI gateway use case for putting cloud and self-hosted model access behind a single authenticated URL.

Portus is a Rust-based API and AI gateway for Kubernetes that handles HTTP, LLM, and MCP traffic on one data plane. The page shows Gateway API conformance, performance benchmarks, AI key and budget controls, and MCP routing examples.

ModelPlane is an OpenAI-compatible AI gateway that routes requests across multiple model providers through one endpoint. It includes model groups, fallback and weighted routing, multiple provider support, reasoning output normalization, and usage/billing tracking.

Self-hosted AI gateway in Go that routes requests across 30+ LLM providers through a single OpenAI- and Anthropic-compatible API.

Open-source tool that runs on a machine to intercept, inspect, and optionally route Claude and ChatGPT traffic through an AI gateway for logging, policy checks, and governance.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

Bifrost is a high-performance AI gateway that provides a single OpenAI-compatible API across 23+ model providers, with automatic failover, load balancing, semantic caching, and enterprise deployment features.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.

A Vercel tutorial showing how to wire Jev into a TanStack Start app using TanStack AI and the Vercel Gateway adapter, with typed decision routing and server-side validation examples.