llm

Local-first debugger for LLM agent context windows. It records each call’s context into a single-file trace so you can inspect, diff, and share what the model actually saw turn by turn.

A hands-on kit for authorized red teaming of locally run LLMs, with jailbreak techniques, prompt-injection scenarios, streaming attack visualization, and support for OpenAI-compatible local model servers.

Gnoseed is a free spaced-repetition flashcard platform for developers, focused on Kubernetes, DevOps, AI, cloud, and certification prep. It includes 3,924+ practice questions, 47 topic decks, offline use, and learning paths for roles and exams.

A local-first CLI that compresses application logs into a token-optimized Markdown/JSONL summary for LLMs.

A local-first, self-hosted home assistant that runs a local LLM as a single brain for Home Assistant, voice, memory, reminders, media control, and other scoped tools.

AutomatiQ is a Python CLI that records a browsing session and uses vision and LLM steps to generate a standalone HTTP-based automation script.

An interactive guide and demo for prompt engineering that shows how analogies, examples, and format-matching can improve LLM outputs.

Open-source Go runtime for autonomous multi-agent systems. Swarm models work as durable state machines, persists state, supports replay/fork, and integrates with multiple LLM backends.

Strict Go static analyzer built for LLM-written code, with opinionated checks, annotation-based exceptions, caching, and Claude Code hook integration.

Open-source semantic layer for warehouses that infers table, column, join, and business-rule metadata, then serves it to AI agents through MCP and CLI checks.

An open-source browser extension for creating and managing userscripts by chatting with an LLM. It inspects the current page, writes and tests scripts live, supports multiple model providers, and can export, import, and run mods across supported browsers.

A GitHub repo benchmarking TypeSafe’s Jev against Sonnet, GPT-5 nano, and local models on 770 Reddit AITA verdicts, with Brier scores, latency, and cost comparisons.

A public guide to principles for building reliable LLM applications and production-ready agents. The page lays out 12 factors, with discussion of tool calls, context windows, control flow, human handoff, and state handling.

ThreadShelf is a local-first archive and semantic search tool for AI conversations, with support for ChatGPT, Claude, Gemini, Grok, OpenRouter, LM Studio, and Google AI Studio. It can reconstruct threads, export conversations to Markdown, and continue chats through local llama.cpp or OpenRouter.

A web calculator that estimates the electricity use and carbon emissions of AI token usage, with everyday comparisons, example workloads, and a detailed methodology page.

Open-source text-to-SQL engine tuned to your own database, with configurable pipeline stages, policy checks, and an evaluation harness for measuring performance on real schemas.

A fully local voice-controlled 3D sandbox where a sassy robot turns spoken commands into voxel builds. The repo explains the stack, runtime requirements, service contracts, controls, and tests.

Open-source harness for measuring how consistently hosted LLM APIs return the same output across repeated runs and over time, with raw transcripts, scoring, and a static leaderboard generator.

A technical primer that explains how LLM inference works, covering weights in GPU memory, prefill vs. decode, the KV cache, and batching.

LayoutLens is an AI-assisted UI testing tool that combines natural-language visual checks with deterministic WCAG audits using axe-core and Playwright. It supports keyless accessibility scans, hybrid LLM-grounded checks, a Python API, and a CLI for running tests in CI.

StateM is a Python CLI for managing long-running AI agents with explicit states, transition checks, runtime history, and resume/compaction support. The repo shows installation, quick-start commands, and a concrete coding-agent runbook example.

CLI and GitHub Action that scans repos, logs, and CI artifacts for leaked LLM reasoning-trace blocks from Anthropic, OpenAI, and Google.

A live demo and write-up showing a 3.16M-parameter INT4 transformer running entirely in on-chip memory on a Xilinx Kria KV260 FPGA, with measured token rates and hardware details.

Symbio is a local AI assistant that learns from user corrections, builds training data from notes, and can fine-tune itself over time. It supports file operations, sandboxed shell commands, RAG, a Telegram bot, and a demo with MoA and skill adapters.