llama.cpp

Wizard is a self-extending autonomous agent shipped as a single Rust binary. It supports local and hosted models, live provider switching, MCP tools, self-modification, a messaging gateway, and built-in benchmarking.

SnapName is a macOS app that watches a screenshot or image folder and uses bundled local AI to suggest better filenames without uploading images.

Reference implementation for using Linux Pressure Stall Information to trim an LLM KV cache under memory pressure. The repo includes requirements, basic usage commands, a simulator, a llama.cpp runner, and benchmark scripts with example results.

A detailed walkthrough for running a local coding agent on macOS with llama.cpp, Gemma 4, MTP speculative decoding, image support, and Pi as the agent interface.

A local AI coding harness that turns business-rule specs into a constrained JSON AST, validates it, and compiles it into Clojure code while logging generation and repair artifacts.

A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code.

A GitHub repository for a latency-separated AI memory retrieval and RAG system. The README describes fetch, compute, and ANN search stages, includes benchmark ranges, and exposes a public test endpoint.