ai gateway

Open-source tool that runs on a machine to intercept, inspect, and optionally route Claude and ChatGPT traffic through an AI gateway for logging, policy checks, and governance.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.