llm

A from-scratch ~1B parameter language model on Hugging Face with open weights, open data, training details, and loading guidance. The page is unusually candid about capabilities, limits, and evaluation.

Open-source SDK and libraries for building local-first, peer-to-peer AI apps. It supports local LLM inference, embeddings, translation, transcription, TTS, OCR, image generation, and an OpenAI-compatible API across desktop and mobile platforms.

A Python library that transpiles stateful imperative LLM workflows into optimizable DSPy programs, with typed outputs, self-correction loops, validation reporting, and prompt tuning support.

An AI API gateway/proxy in Go that sits between coding clients and upstream LLM providers, with request routing, secret redaction, context handling, MCP tool integration, and transparent SSE streaming.

tokentoll is a GitHub Action and CLI that scans Python and JavaScript/TypeScript code for LLM API calls, estimates spend, and blocks pull requests when cost or model-policy thresholds are exceeded.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

SwarmWright is a self-hosted multi-agent AI orchestration platform for designing, running, and inspecting swarms of agents from markdown and config. The page highlights Docker-based setup, topology-enforced agent graphs, human approval steps, local storage, and detailed audit logs.

A Go-based text editor built for LLM agents, with branching undo, conflict handling, audit logs, MCP support, and agent skills installation.

A local-first, self-hosted home assistant that runs a local LLM as a single brain for Home Assistant, voice, memory, reminders, media control, and other scoped tools.

AutomatiQ is a Python CLI that records a browsing session and uses vision and LLM steps to generate a standalone HTTP-based automation script.

An interactive guide and demo for prompt engineering that shows how analogies, examples, and format-matching can improve LLM outputs.

Open-source Go runtime for autonomous multi-agent systems. Swarm models work as durable state machines, persists state, supports replay/fork, and integrates with multiple LLM backends.

Strict Go static analyzer built for LLM-written code, with opinionated checks, annotation-based exceptions, caching, and Claude Code hook integration.

A local Rust-plus-Python middleware layer for LLM apps that claims to reduce token usage and add in-process security checks before prompts are sent to a provider.

An open-source tool that watches Playwright failures, inspects the live page, and opens a GitHub PR with a proposed fix.

AI-powered security scanner for modern web apps that combines SAST, DAST, and LLM-assisted code review in a single command. The repository includes install steps, quick-start commands, supported stacks, and examples for scanning live URLs or source code.

Soup is a Python library that routes Agent Skills into LLM prompts, injecting only the skills relevant to each request. It supports local skills, remote repositories, and multiple providers including OpenAI, Anthropic, Gemini, Ollama, LiteLLM, and LangChain.

Local-first Python SDK for AI agents that compresses web pages before LLM use, flattens Shadow DOM, builds action maps, and extracts structured data from tables, forms, and lists.

An open-source, self-hosted AI DevOps pipeline that ingests GitHub webhooks, generates code patches with an LLM, runs them in network-isolated Docker sandboxes, and posts validated fixes back as PR comments.

Cachet is a local semantic cache for LLM APIs that sits in front of OpenAI- or Anthropic-compatible endpoints and serves repeated or rephrased requests from cache. It includes a dashboard for hit rate and estimated savings, supports streaming responses, and is implemented as a single Rust binary.

Open-source MCP server and CLI that lets an LLM control hardware workflows like compiling, flashing, and reading serial output for firmware development and device diagnostics.

Rudi is a Python tool for LLM memory management that replaces a growing chat transcript with a causal dependency graph, aiming to keep token usage flat across long sessions. The README shows benchmarking results, fold behavior, and example usage with get_slice, store_decisions, and run_turn.

Go packages for building agents in Go, with a streaming runner, tool dispatch, guardrails, compaction, provider adapters, and verified completion helpers.

Open-source MCP server that exposes SQL databases as tools and prompts for AI agents, with support for MSSQL and PostgreSQL, read-only defaults, and local or remote transport.