AgentDish directory

Triton

Accepted listings with this tag.

Listing Category Score Trend Checked

A curated GitHub resource list for learning AI performance engineering, covering GPU fundamentals, kernel optimization, inference engines, and distributed inference.

AI/ML Resources / Performance Engineering 83 ↓ -3 14 days ago Details
#1424 ↓ -3
Proxima

An out-of-tree vLLM plugin that compresses KV cache with STAR-KV to fit more concurrent requests and longer contexts on the same GPU memory budget.

Developer Tool / LLM Serving / vLLM 83 ↓ -3 65 days ago Details