llm-proxy

Self-hosted LLM proxy that redacts personal data before requests reach model providers, including inside tool-call arguments and multimodal content. It supports OpenAI-compatible clients, runs locally with zero telemetry, and uses Presidio plus an optional privacy filter for broader PII and secret detection.

A model router for agentic systems that proxies Anthropic, OpenAI, Gemini, and OSS models through one endpoint, with hosted and self-hosted setup paths and direct integrations for Claude Code, Codex, Cursor, and opencode.

An OpenAI-compatible LLM proxy that routes requests to the fastest healthy provider. It runs as a small sidecar, supports latency/error-aware routing, session affinity, and Vertex AI, and can be deployed as a single static binary or Docker container.

Kotro is a local control plane for coding agents that governs MCP tool actions and LLM traffic with one binary. The page shows install options, supported clients, dashboard access, and concrete controls like schema pinning, redaction, cache, budget, and circuit breaker behavior.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.