openai-compatible

Self-hosted LLM proxy that redacts personal data before requests reach model providers, including inside tool-call arguments and multimodal content. It supports OpenAI-compatible clients, runs locally with zero telemetry, and uses Presidio plus an optional privacy filter for broader PII and secret detection.

Wizard is a self-extending autonomous agent shipped as a single Rust binary. It supports local and hosted models, live provider switching, MCP tools, self-modification, a messaging gateway, and built-in benchmarking.

A model router for agentic systems that proxies Anthropic, OpenAI, Gemini, and OSS models through one endpoint, with hosted and self-hosted setup paths and direct integrations for Claude Code, Codex, Cursor, and opencode.

Local-first AI memory layer for LLM apps with persistent knowledge graph storage, entity extraction, semantic retrieval, and API endpoints for ingesting and retrieving context.

A Swedish AI inference API offering GLM 5.1 on owned H200 hardware in Stockholm, with OpenAI-compatible endpoints, SEK pricing, and an emphasis on EU data residency.

An OpenAI-compatible AI router that sends requests across 12+ providers and 100+ models with automatic fallback and multimodal routing.

An AI model gateway for builders offering 35+ models through a single OpenAI-compatible API, with instant API key delivery and pay-as-you-go credits starting at €1.

A minimal, provider-agnostic agent loop for building custom AI agents with swappable memory, model, tools, and stop-condition seams.

Wattfare is an OAuth-style way for apps to let users connect and fund their own AI usage with a monthly cap. It offers an SDK, OpenAI-compatible model access, and support for Vercel AI SDK workflows.

A local Rust API gateway that lets tools like Claude Code and OpenAI/Anthropic SDKs talk to OAuth-backed providers through OpenAI- and Anthropic-compatible endpoints.

SmolSignal is an AI signal copilot for Flipper Zero files. It explains common capture formats, classifies safety risk, supports local and cloud model backends, and can generate safe consumer IR files.

GreyFox Community Edition is a self-hosted AI traffic proxy and admin console for teams that want to control LLM usage, enforce per-user quotas, reuse cached responses, and keep traffic inside their own infrastructure.

A VS Code AI sidebar for focused coding help, with voice input, file and selection chat, Git and debugger context, and support for OpenAI-compatible, local, and budget models.

An OpenAI-compatible LLM proxy that routes requests to the fastest healthy provider. It runs as a small sidecar, supports latency/error-aware routing, session affinity, and Vertex AI, and can be deployed as a single static binary or Docker container.

AI agent that runs plain-text manual test cases in a real browser. It pastes step-by-step tests into Chrome, executes them live, and reports pass, fail, or warn per step with support for captcha and OTP pauses.

Brick is an AI model routing gateway that sends each query to the most suitable LLM based on capability and complexity. The repository includes quickstart steps, Claude Code integration, an OpenAI-compatible endpoint, and a short explanation of when to use it.

Cachet is a local semantic cache for LLM APIs that sits in front of OpenAI- or Anthropic-compatible endpoints and serves repeated or rephrased requests from cache. It includes a dashboard for hit rate and estimated savings, supports streaming responses, and is implemented as a single Rust binary.

AISBF is a self-hostable AI service broker and OpenAI-compatible proxy/router for routing requests across multiple providers, adding prompt-aware model selection, failover, quotas, analytics, and privacy-focused deployment options.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

A fail-closed execution firewall for AI agents that quarantines MCP tools, proxies OpenAI-compatible requests, and emits signed receipts for offline verification.

A Node.js proxy server that rotates API keys for LLM APIs like OpenAI and Gemini when rate limits are hit. It also includes an admin panel, request logging, provider management, and a Telegram bot for chatting with configured models.

OpenAI-compatible LLM API with a flat $6/month plan, unlimited tokens, and no prompt storage. It’s aimed at developers running coding agents, automation, and other high-volume workflows.

relaxAI is a UK sovereign LLM inference API with OpenAI-compatible endpoints and official SDKs for Python, TypeScript, and Go. The docs page covers installation, REST usage, and links into models, pricing, authentication, and endpoint sections.

An OpenAI-compatible API proxy for using DeepSeek models with standard OpenAI SDKs, billed pay-as-you-go and accessible without phone verification.