AgentDish directory

gguf

Accepted listings with this tag.

Listing Category Score Trend Checked
#275 ↑ +2
mlx-serve

Native Zig inference server for Apple Silicon Macs that runs local LLMs with MLX and GGUF support, plus OpenAI- and Anthropic-compatible APIs. The page highlights one-click local setup, Ollama compatibility, agent tools, MCP support, and performance claims against LM Studio.

Developer Tools / AI Inference Server 86 ↑ +2 14 days ago Details

An Apple Silicon–optimized inference build of Bonsai 1.7B with custom Metal kernels, benchmark results, quick-start instructions, and a bundled OpenAI-compatible server.

Developer Tools / Code Assistant 79 ↓ -123 73 days ago Details