openai-compatible

Self-hosted LLM proxy that redacts personal data before requests reach model providers, including inside tool-call arguments and multimodal content. It supports OpenAI-compatible clients, runs locally with zero telemetry, and uses Presidio plus an optional privacy filter for broader PII and secret detection.

Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents. It connects files, databases, vector stores, APIs, and MCP tools through one backend with auth, observability, and governance features.

Wizard is a self-extending autonomous agent shipped as a single Rust binary. It supports local and hosted models, live provider switching, MCP tools, self-modification, a messaging gateway, and built-in benchmarking.

A model router for agentic systems that proxies Anthropic, OpenAI, Gemini, and OSS models through one endpoint, with hosted and self-hosted setup paths and direct integrations for Claude Code, Codex, Cursor, and opencode.

Local-first AI memory layer for LLM apps with persistent knowledge graph storage, entity extraction, semantic retrieval, and API endpoints for ingesting and retrieving context.

A Swedish AI inference API offering GLM 5.1 on owned H200 hardware in Stockholm, with OpenAI-compatible endpoints, SEK pricing, and an emphasis on EU data residency.

An OpenAI-compatible AI router that sends requests across 12+ providers and 100+ models with automatic fallback and multimodal routing.

An AI model gateway for builders offering 35+ models through a single OpenAI-compatible API, with instant API key delivery and pay-as-you-go credits starting at €1.

Cadre is a local-first Kanban board for orchestrating coding agents, including Claude Code, Codex, Grok, Opencode, and OpenAI-compatible setups. It routes tasks, handles blockers and approvals, and keeps agent runs, diffs, and command control in one workspace.

ModelPlane is an OpenAI-compatible AI gateway that routes requests across multiple model providers through one endpoint. It includes model groups, fallback and weighted routing, multiple provider support, reasoning output normalization, and usage/billing tracking.

A minimal, provider-agnostic agent loop for building custom AI agents with swappable memory, model, tools, and stop-condition seams.

Wattfare is an OAuth-style way for apps to let users connect and fund their own AI usage with a monthly cap. It offers an SDK, OpenAI-compatible model access, and support for Vercel AI SDK workflows.

A local Rust API gateway that lets tools like Claude Code and OpenAI/Anthropic SDKs talk to OAuth-backed providers through OpenAI- and Anthropic-compatible endpoints.

An open-source, local-first canvas for editing LLM context as a graph. It lets users branch, prune, merge, and inspect the exact context sent to a model, with a desktop app, web demo, and support for Ollama and OpenAI-compatible endpoints.

Self-hosted AI gateway in Go that routes requests across 30+ LLM providers through a single OpenAI- and Anthropic-compatible API.

SmolSignal is an AI signal copilot for Flipper Zero files. It explains common capture formats, classifies safety risk, supports local and cloud model backends, and can generate safe consumer IR files.

GreyFox Community Edition is a self-hosted AI traffic proxy and admin console for teams that want to control LLM usage, enforce per-user quotas, reuse cached responses, and keep traffic inside their own infrastructure.

A VS Code AI sidebar for focused coding help, with voice input, file and selection chat, Git and debugger context, and support for OpenAI-compatible, local, and budget models.

Self-hosted OpenAI-compatible mock server for testing LLM integrations without exposing API keys. Includes a hosted instance, local setup, Docker support, streaming, and deterministic responses.

A hands-on kit for authorized red teaming of locally run LLMs, with jailbreak techniques, prompt-injection scenarios, streaming attack visualization, and support for OpenAI-compatible local model servers.

Self-hosted OpenAI-compatible AI gateway with a CLI, server mode, and web UI for text, image, and audio workflows across many models and providers.

An OpenAI-compatible LLM proxy that routes requests to the fastest healthy provider. It runs as a small sidecar, supports latency/error-aware routing, session affinity, and Vertex AI, and can be deployed as a single static binary or Docker container.

FAAAH is a dependency-free, OpenAI-compatible local proxy that routes requests through text files and AI coding agents. It is aimed at developers who want to reuse an existing agent subscription as a backend for tools that expect the OpenAI API.

A lightweight Flask-based LLM proxy that forwards Ollama, OpenAI, and llama.cpp-style requests to NVIDIA’s OpenAI-compatible API, with streaming support, retries, caching, auth, and usage stats.