AgentDish directory

model serving

Accepted listings with this tag.

Listing Category Score Trend Checked

Open-source self-hosted inference server for agent workloads, with an OpenAI-compatible API, multi-model serving, and production cluster tooling.

Developer Tools / AI Infrastructure 87 ↓ -4 89 days ago Details
#1108 ↓ -6
jeva.cpp

A llama.cpp fork that adds a JEV-compatible decision API for Choice, Score, and Noul evaluations while keeping standard LLM inference support.

Developer Tools / AI/LLM Infrastructure 84 ↓ -6 40 days ago Details

A vLLM blog post explaining Semantic Router as an open serving-layer runtime for bounded micro-agents, with routing patterns like Confidence, Ratings, ReMoM, Fusion, and Workflows behind a single model API.

Developer Tools / Code Assistant 76 ↓ -1 130 days ago Details