llm

A from-scratch ~1B parameter language model on Hugging Face with open weights, open data, training details, and loading guidance. The page is unusually candid about capabilities, limits, and evaluation.

Open-source SDK and libraries for building local-first, peer-to-peer AI apps. It supports local LLM inference, embeddings, translation, transcription, TTS, OCR, image generation, and an OpenAI-compatible API across desktop and mobile platforms.

A Python library that transpiles stateful imperative LLM workflows into optimizable DSPy programs, with typed outputs, self-correction loops, validation reporting, and prompt tuning support.

An AI API gateway/proxy in Go that sits between coding clients and upstream LLM providers, with request routing, secret redaction, context handling, MCP tool integration, and transparent SSE streaming.

tokentoll is a GitHub Action and CLI that scans Python and JavaScript/TypeScript code for LLM API calls, estimates spend, and blocks pull requests when cost or model-policy thresholds are exceeded.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

SwarmWright is a self-hosted multi-agent AI orchestration platform for designing, running, and inspecting swarms of agents from markdown and config. The page highlights Docker-based setup, topology-enforced agent graphs, human approval steps, local storage, and detailed audit logs.

A Go-based text editor built for LLM agents, with branching undo, conflict handling, audit logs, MCP support, and agent skills installation.

Chrome extension that captures a fixed screen region, runs offline OCR with bundled Tesseract, and exports page-by-page text for use with LLMs or search.

A pure C implementation for training and running a tiny GPT, with build instructions, sample output, and performance notes for macOS, Linux, and Windows.

clai is a terminal-first AI tool that pipes stdin to an LLM and writes results to stdout, so it fits naturally into shell workflows like git diffs, text files, and command pipelines.

Self-hosted OpenAI-compatible mock server for testing LLM integrations without exposing API keys. Includes a hosted instance, local setup, Docker support, streaming, and deterministic responses.

Local-first debugger for LLM agent context windows. It records each call’s context into a single-file trace so you can inspect, diff, and share what the model actually saw turn by turn.

A hands-on kit for authorized red teaming of locally run LLMs, with jailbreak techniques, prompt-injection scenarios, streaming attack visualization, and support for OpenAI-compatible local model servers.

Gnoseed is a free spaced-repetition flashcard platform for developers, focused on Kubernetes, DevOps, AI, cloud, and certification prep. It includes 3,924+ practice questions, 47 topic decks, offline use, and learning paths for roles and exams.

A local-first CLI that compresses application logs into a token-optimized Markdown/JSONL summary for LLMs.

A local-first, self-hosted home assistant that runs a local LLM as a single brain for Home Assistant, voice, memory, reminders, media control, and other scoped tools.

AutomatiQ is a Python CLI that records a browsing session and uses vision and LLM steps to generate a standalone HTTP-based automation script.

An interactive guide and demo for prompt engineering that shows how analogies, examples, and format-matching can improve LLM outputs.

Open-source Go runtime for autonomous multi-agent systems. Swarm models work as durable state machines, persists state, supports replay/fork, and integrates with multiple LLM backends.

Strict Go static analyzer built for LLM-written code, with opinionated checks, annotation-based exceptions, caching, and Claude Code hook integration.

Open-source harness for measuring how consistently hosted LLM APIs return the same output across repeated runs and over time, with raw transcripts, scoring, and a static leaderboard generator.

A technical primer that explains how LLM inference works, covering weights in GPU memory, prefill vs. decode, the KV cache, and batching.

LayoutLens is an AI-assisted UI testing tool that combines natural-language visual checks with deterministic WCAG audits using axe-core and Playwright. It supports keyless accessibility scans, hybrid LLM-grounded checks, a Python API, and a CLI for running tests in CI.