gpu

Tokenstead helps people match AI models to their own hardware, with support for Macs, GPUs, and custom rigs. It shows which models can run locally, estimates speed, compares cloud pricing, and includes a source-cited tracker of organizations using different models.

AutoGPU is an open-source project for using AI agents to design and harden a GPU-like chip end to end, from Verilog through synthesis and place-and-route to GDSII. The repo shows a concrete fp8 matmul accelerator flow, quick-start steps, and documentation for running the design/hardening process.

An open-source handbook for production LLM serving and inference at scale, covering GPU fundamentals, KV cache, batching, quantization, speculative decoding, and engines like vLLM, SGLang, and TensorRT-LLM.

Open-source AI infrastructure project focused on GPU memory management and serving, with a Python control plane, C++ data plane, and optional CUDA kernels.