llm

Anthropic’s Claude API platform for building AI products, apps, and agent workflows with Claude models, built-in tools, pricing tiers, and developer docs.

WebLLM is a high-performance in-browser LLM inference engine that runs locally in the browser with WebGPU acceleration. It exposes an OpenAI-compatible API, supports streaming and JSON mode, and includes examples for building chat apps and browser extensions.

A self-hosted Docker Compose stack for running local AI services including Ollama, LiteLLM, Whisper, Kokoro, embeddings, and an MCP Gateway.

Open Bias is an open-source reliability harness for LLM apps and agents that enforces rules at runtime. It sits between your app and an LLM provider, using RULES.md policies to trace, block, or fix off-policy behavior.

AutoRound is an open-source quantization toolkit for LLMs and VLMs, focused on high-accuracy low-bit inference across CPU, XPU, CUDA, and multiple deployment backends.

Google’s Gemini 3.5 Flash announcement describes a frontier model aimed at agents and coding, with notes on speed, multimodal generation, and availability through the Gemini app, Google Antigravity, Gemini API, AI Studio, Android Studio, and Gemini Enterprise.

LLMCap is a proxy for LLM API calls that hard-stops requests when a dollar cap is reached, with support for major providers and companion tools for VS Code, CLI, and Windows.

An open-source CLI for testing LLM prompts across consistency, latency, cost, and behavior, with HTML reports and support for OpenAI and Anthropic.

oruk is a live broadcast intelligence API for real-time news. It offers REST endpoints, SSE streaming, webhooks, and an MCP server for use in AI apps and developer workflows.

Open-source terminal coding agent in Rust with LLM-native code understanding, shell safety, multi-provider support, and automatic failover.

Python package for recording real LLM API responses and replaying them in tests so LLM-driven code can run deterministically without live API calls.

tokentoll is a GitHub Action and CLI that scans Python and JavaScript/TypeScript code for LLM API calls, estimates spend, and blocks pull requests when cost or model-policy thresholds are exceeded.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

SwarmWright is a self-hosted multi-agent AI orchestration platform for designing, running, and inspecting swarms of agents from markdown and config. The page highlights Docker-based setup, topology-enforced agent graphs, human approval steps, local storage, and detailed audit logs.

A Go-based text editor built for LLM agents, with branching undo, conflict handling, audit logs, MCP support, and agent skills installation.

Strict Go static analyzer built for LLM-written code, with opinionated checks, annotation-based exceptions, caching, and Claude Code hook integration.

TypeScript middleware that trims or compresses LLM chat history to fit a token budget, with support for OpenAI, Anthropic, and AI SDK integrations.

Open-sourced local multi-agent OS that runs three agents on consumer hardware, lets them form goals from environmental pressure, and supports self-modifying workflows through tool creation and change requests.

A research-style demo showing LLM agents evolving through a genetic algorithm to play Pokémon in parallel sandboxed VMs. The page explains the setup, scoring loop, generations, results, and links to the repo and run artifacts.

A ~1000-line C workflow runtime where an LLM can modify a DAG during execution using a restricted four-verb grammar, with every change written to an append-only audit log for replay and inspection.

Open-source Rust coding agent with LLM-native code understanding, shell safety, and support for multiple LLM providers with automatic failover.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

A governance plugin for OpenClaw that registers instances with a Recursant registry and intercepts tool calls, LLM prompts, and chat messages for auth, PII redaction, rate limiting, and auditing.

Single-binary viewer for HTML reports generated by AI agents, with local browsing, live previews, search, and shareable links.