Developer Tools / AI/LLM Inference
A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code.
The crawl snapshot gives enough evidence that this is a real AI developer project: it explains the KV fragment approach, shows engine adapters, lists Android and Go code, and includes benchmark and architecture details. It is clearly aimed at builders working on local LLM inference, not a thin placeholder.
The snapshot does not show installation steps, a quickstart, or a runnable demo, so a visitor still cannot tell how to try it locally. Maintenance signals are also limited in the crawl, beyond the file list and commit count.
Last evaluated 18 days ago. Current rank #927. Up 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Single-binary CLI that builds an AI agent knowledge base from git repos, Claude Code/Codex sessions, and saved links. It generates a portable markdown wiki, runs on cron, supports local Ollama mode, and exposes the result for agents via CLAUDE.md/AGENTS.md and MCP.
A lightweight React Markdown renderer with built-in LaTeX, syntax highlighting, streaming-safe rendering, and security-focused defaults.
Claude Code plugin that blocks dependency edits until a fresh, source-cited version check is recorded, helping prevent hallucinated or stale package versions across npm, pip, Poetry/uv, Cargo, and NuGet.
