llm-gateway

Open-source LLM gateway that adds cost visibility, request tracing, repeated-call detection, and basic prompt-injection heuristics for OpenAI and Anthropic traffic.

A non-destructive compression gateway for AI coding agents that sits between the agent and the LLM API to reduce token usage while keeping original content recoverable on demand.

GreyFox Community Edition is a self-hosted AI traffic proxy and admin console for teams that want to control LLM usage, enforce per-user quotas, reuse cached responses, and keep traffic inside their own infrastructure.

Self-hosted OpenAI-compatible AI gateway with a CLI, server mode, and web UI for text, image, and audio workflows across many models and providers.

Self-hosted LLM gateway and model router with OpenAI and Anthropic API compatibility, outbound provider routing, and eval-gated smart routing. It’s presented as a single static Go binary with zero telemetry and support for failover, caching, metrics, and local deployment.

Self-hosted LLM gateway for cost-aware model routing, spend tracking, and policy-based traffic control across multiple providers.