AgentDish directory
on-device
Accepted listings with this tag.
| Listing | Category | Score | Trend | Checked | |
|---|---|---|---|---|---|
#160
↓ -3
Needle
An open-source 26M parameter function-calling model designed to run on very small devices, with a local quickstart, Python usage, and a playground for testing and finetuning. |
AI Model / Function Calling | 88 | ↓ -3 | 65 days ago | Details |
#927
↑ +6
EdgeSync-LLM
A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code. |
Developer Tools / AI/LLM Inference | 78 | ↑ +6 | 17 days ago | Details |
#1024
↓ -1
Anvit
Android app for chatting with PDFs and Word documents entirely on-device, with an offline/private positioning and no cloud dependency. |
AI Apps / Document Chat | 76 | ↓ -1 | 17 days ago | Details |