llm

Anthropic’s Claude API platform for building AI products, apps, and agent workflows with Claude models, built-in tools, pricing tiers, and developer docs.

WebLLM is a high-performance in-browser LLM inference engine that runs locally in the browser with WebGPU acceleration. It exposes an OpenAI-compatible API, supports streaming and JSON mode, and includes examples for building chat apps and browser extensions.

WakaWiki is a Rust CLI that generates and keeps agent-facing documentation up to date for a codebase. It supports multiple model providers, a zero-LLM scan mode, incremental updates, and AGENTS.md integration, with CI-friendly GitHub Actions usage documented in the README.

A self-hosted Docker Compose stack for running local AI services including Ollama, LiteLLM, Whisper, Kokoro, embeddings, and an MCP Gateway.

Open Bias is an open-source reliability harness for LLM apps and agents that enforces rules at runtime. It sits between your app and an LLM provider, using RULES.md policies to trace, block, or fix off-policy behavior.

Browser extension that scans pastes for credentials and PII before they reach LLM chat sites, with local on-device inference and no network calls.

AutoRound is an open-source quantization toolkit for LLMs and VLMs, focused on high-accuracy low-bit inference across CPU, XPU, CUDA, and multiple deployment backends.

NeatContext is a local-first desktop workspace that adds team-specific knowledge and read-only internal tools to LLMs so they can give grounded operational answers. The page shows incident-response examples, Markdown-based profiles, MCP integration, and support for multiple model providers.

LocalMask is a local-first privacy layer for AI coding that scans repos on-device, masks secrets and PII into reversible tokens, and forwards only safe content to models like Claude, GPT, or Gemini. It also supports masked repo mirrors, an AI proxy, and a CLI/MCP workflow.

CLI tool for versioning, diffing, rolling back, and searching AI prompts, with Git-style workflows for prompt management.

Open-source AI agent monitoring platform with tracing, issue grouping, evals, semantic search, alerts, and MCP access for coding agents.

An OTP-native Elixir library for building AI agents, durable LLM workflows, retrieval pipelines, and production LLM services.

Lowfat is a lightweight CLI tool that filters noisy command output before it reaches an AI agent, with plugins, shell integration, and usage stats for token savings.

Google’s Gemini 3.5 Flash announcement describes a frontier model aimed at agents and coding, with notes on speed, multimodal generation, and availability through the Gemini app, Google Antigravity, Gemini API, AI Studio, Android Studio, and Gemini Enterprise.

LLMCap is a proxy for LLM API calls that hard-stops requests when a dollar cap is reached, with support for major providers and companion tools for VS Code, CLI, and Windows.

An open-source CLI for testing LLM prompts across consistency, latency, cost, and behavior, with HTML reports and support for OpenAI and Anthropic.

oruk is a live broadcast intelligence API for real-time news. It offers REST endpoints, SSE streaming, webhooks, and an MCP server for use in AI apps and developer workflows.

fenic is an open-source Python framework for semantic DataFrames, letting you use LLM-powered operators like extract, classify, summarize, and embed inside query pipelines.

Open-source terminal coding agent in Rust with LLM-native code understanding, shell safety, multi-provider support, and automatic failover.

Python package for recording real LLM API responses and replaying them in tests so LLM-driven code can run deterministically without live API calls.

A Python package and CLI for checking how closely an AI-generated answer reuses its source text, with support for verbatim matching, subsequence matching, quotation verification, and pipeline gating.

An open-source project that runs full games of Diplomacy between 7 LLM-controlled powers, with negotiation rounds, validated orders, and saved transcripts for replay and analysis.

An autonomous research system that runs on a single workstation and aggressively checks its own claims with adversarial self-verification, replication, and calibration audits.

A desktop browser that hallucinates web pages on the fly with an LLM, including interactive apps and customizable “lenses” for different styles of generated sites.