API Gateway

Portus is a Rust-based API and AI gateway for Kubernetes that handles HTTP, LLM, and MCP traffic on one data plane. The page shows Gateway API conformance, performance benchmarks, AI key and budget controls, and MCP routing examples.

Subpool is a self-hosted control plane for managing AI subscription and API capacity across teams. It pools authorized accounts, issues employee-specific keys, exposes OpenAI-compatible endpoints, and tracks usage without storing prompts or responses.

Self-hosted LLM gateway for cost-aware model routing, spend tracking, and policy-based traffic control across multiple providers.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

A small Rust-based LLM proxy for forwarding chat, messages, and responses requests to providers with gateway-key handling and optional protocol translation between Anthropic and OpenAI styles.