AgentDish directory
on-device inference
Accepted listings with this tag.
| Listing | Category | Score | Trend | Checked | |
|---|---|---|---|---|---|
#175
↓ -6
QVAC by Tether
QVAC SDK 0.12.0 adds TurboQuant, a KV-cache quantization feature for local LLM inference that claims up to 5x more context on-device with no retraining or code changes. |
Developer Tools / AI SDK | 84 | ↓ -6 | 40 hours ago | Details |