LLM routing

OpenWorkers is a thesis-focused research assistant that searches literature, verifies citations, critiques ideas, and produces structured research support without writing the prose for the student.

Self-hosted AI gateway in Go that routes requests across 30+ LLM providers through a single OpenAI- and Anthropic-compatible API.

A Python SDK that provides LiteLLM-style model routing and translation with a smaller surface area. It supports completions, streaming, embeddings, tool calling, async variants, provider mapping, and local OpenAI-compatible backends.

Open-source local-first AI agent that routes between local and cloud LLMs, learns from escalations, and stores knowledge for future queries. The repo includes a quickstart, setup modes, and a concrete explanation of how it ingests docs and improves over time.

Open-source CLI and plugin that lets Claude Code run workflows, teams, and subagents on third-party models like DeepSeek, GLM, Kimi, Qwen, or Codex-compatible providers.

Open-source LLM routing and cascade engine that sends prompts from local Ollama models to cloud and frontier models based on task complexity, cache hits, and quality gates.

Swobu is an open-source LLM switchboard that routes agent requests across providers, regions, cloud accounts, and local models behind a stable model name. It supports fallback routing, protocol translation, and agent setup via CLI or Cockpit.

A CLI tool that deterministically routes prompts between local and hosted LLMs without making a model call to decide. It emphasizes offline operation, configurable calibration, and demo modes for seeing routing decisions and savings.