cpp

A curated GitHub list and benchmark leaderboard for ultra-lightweight, zero-dependency AI engines in C/C++/Rust/Assembly, covering local LLMs, vector search, memory, GEMM, and agent tooling.

Open-source AI infrastructure project focused on GPU memory management and serving, with a Python control plane, C++ data plane, and optional CUDA kernels.