llm-gateway

Open-source LLM gateway that adds cost visibility, request tracing, repeated-call detection, and basic prompt-injection heuristics for OpenAI and Anthropic traffic.

A C++ OpenAI-compatible LLM gateway designed for very low latency, with support for translating requests to providers like Anthropic, Gemini, and Cohere.

A non-destructive compression gateway for AI coding agents that sits between the agent and the LLM API to reduce token usage while keeping original content recoverable on demand.

Open-source Rust LLM gateway for AI agents with full-fidelity traces, a tamper-evident audit ledger, offline verification, and in-request guardrails.

GreyFox Community Edition is a self-hosted AI traffic proxy and admin console for teams that want to control LLM usage, enforce per-user quotas, reuse cached responses, and keep traffic inside their own infrastructure.

Self-hosted OpenAI-compatible AI gateway with a CLI, server mode, and web UI for text, image, and audio workflows across many models and providers.

Self-hosted LLM gateway and model router with OpenAI and Anthropic API compatibility, outbound provider routing, and eval-gated smart routing. It’s presented as a single static Go binary with zero telemetry and support for failover, caching, metrics, and local deployment.

Self-hosted LLM gateway for cost-aware model routing, spend tracking, and policy-based traffic control across multiple providers.