Developer Tools / AI/LLM Inference
A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code.
The crawl snapshot gives enough evidence that this is a real AI developer project: it explains the KV fragment approach, shows engine adapters, lists Android and Go code, and includes benchmark and architecture details. It is clearly aimed at builders working on local LLM inference, not a thin placeholder.
The snapshot does not show installation steps, a quickstart, or a runnable demo, so a visitor still cannot tell how to try it locally. Maintenance signals are also limited in the crawl, beyond the file list and commit count.
Last evaluated 108 days ago. Current rank #2100. Up 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.
Lumae is a free native macOS screen recorder and screenshot tool for polished demos, with automatic zooms, cursor smoothing, motion blur, captions, voiceover, and annotated screenshots. It also exposes editing commands over MCP so agents like Claude Code or Claude Desktop can edit projects directly.
A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.
