llm

A ~1000-line C workflow runtime where an LLM can modify a DAG during execution using a restricted four-verb grammar, with every change written to an append-only audit log for replay and inspection.

Open-source Rust coding agent with LLM-native code understanding, shell safety, and support for multiple LLM providers with automatic failover.

Lightport is a lightweight AI gateway that makes LLM providers OpenAI-compatible. The repo shows supported endpoints, a long provider list, quickstart commands, request examples, and active maintenance signals.

Local privacy gateway that redacts sensitive text before sending prompts to external LLMs, then reconstructs the final answer locally.

Dependency-free Python library that compiles a declarative JSON query format into safe, parameterized SQL for LLM workflows, REST APIs, and frontend-backed data tables.

ContextSpy is an LLM context profiler that intercepts agent traffic, breaks down token usage, and visualizes how prompts change across requests and sessions.

An AI-powered Obsidian plugin that turns notes into a self-organizing wiki with auto-generated entity pages, bidirectional links, traceable answers, and local-first support.

A governance plugin for OpenClaw that registers instances with a Recursant registry and intercepts tool calls, LLM prompts, and chat messages for auth, PII redaction, rate limiting, and auditing.

Single-binary viewer for HTML reports generated by AI agents, with local browsing, live previews, search, and shareable links.

A hands-on workshop repository that walks developers through building a small GPT-style language model from scratch, including tokenization, transformer blocks, training, and text generation.

A terminal-based agentic coding harness for engineers, optimized for z.ai GLM models and built to hot-swap across multiple LLM providers mid-session.

Open-source agent harness that starts from a tiny loop, gives the model one exec tool, and stores the agent’s state and sessions inside its own directory. It includes setup commands, model configuration notes, and design rationale.

A small Rust-based LLM proxy for forwarding chat, messages, and responses requests to providers with gateway-key handling and optional protocol translation between Anthropic and OpenAI styles.

Open-source Python library that lets developers integrate an LLM into the Python runtime so missing attributes, methods, and typed values can be inferred on demand with confidence scores.

A Rust-based coding agent built for speed, low memory use, and Claude Code compatibility. The project highlights support for skills, hooks, MCP, plugins, sub-agents, and multiple LLM providers, with terminal, headless, and IDE-facing entry points.

A curated GitHub resource mapping AI token costs, waste, and efficiency practices for agentic coding. It combines an awesome list with editorial notes, practices, concepts, claims, and copy-paste setups.

NakshGuard is a self-hosted reverse proxy for OpenAI and Anthropic chat APIs that detects and blocks runaway AI agent loops before they waste tokens or API spend. It includes per-agent session tracking, configurable thresholds, shadow mode, and hot config reload.

Local-first governance layer for AI systems that monitors prompts and responses to block secrets, PII, and runaway LLM spending before requests leave the machine.

Python library for managing LLM conversation history with cache-friendly message ordering, dynamic context, and compaction.

A macOS desktop shell where apps are generated by Claude into interactive HTML mini-apps, with local system features like windows, dock, file storage, notifications, and persona-based themes.

Lathe generates multi-part, hands-on technical tutorials from prompts and provides a local UI plus CLI workflow for working through them with LLM-assisted skills.

A Python filter layer for LLM apps that evaluates responses against a Lean-verified Scherf logic backend and can pass, flag, correct, or block output.

A PyTorch reference implementation of DeepSeek Sparse Attention from the LLMs-from-scratch project, including a lightweight indexer, top-K token selection, and a GPT-style model with KV-cache support.

MagesticAI is an open-source, browser-based platform for managing AI coding tasks with multi-agent orchestration, task boards, terminal access, and code review. The README shows installation steps, Docker deployment, supported platforms, and a concrete local setup path.