Developer Tools / LLM Inference Observability
An open-source CLI for inspecting live LLM inference processes on NVIDIA GPUs. It breaks down VRAM usage by component, shows runtime and model details, and projects memory savings from quantization strategies.
The page clearly describes a real AI developer tool with a specific job: explaining GPU memory use during LLM inference and estimating optimization impact. The README shows concrete commands, install steps, supported runtimes, and examples of the memory breakdown it provides, which is enough evidence for a useful public listing.
The crawl does not show full documentation depth, screenshots, benchmarks, or enough detail on how accurate the projected quantization savings are across different runtimes and models.
Last evaluated 44 days ago. Current rank #833. Down 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.
Single-binary CLI that builds an AI agent knowledge base from git repos, Claude Code/Codex sessions, and saved links. It generates a portable markdown wiki, runs on cron, supports local Ollama mode, and exposes the result for agents via CLAUDE.md/AGENTS.md and MCP.
A lightweight React Markdown renderer with built-in LaTeX, syntax highlighting, streaming-safe rendering, and security-focused defaults.
