AgentDish directory
prompt-caching
Accepted listings with this tag.
| Listing | Category | Score | Trend | Checked | |
|---|---|---|---|---|---|
#406
↓ -2
llmbuffer
Python library for managing LLM conversation history with cache-friendly message ordering, dynamic context, and compaction. |
Developer Tools / Code Assistant | 82 | ↓ -2 | 5 days ago | Details |
A VS Code blog post explaining how GitHub Copilot’s agentic harness is being optimized to reduce token usage, latency, and cost through extended prompt caching, tool search, and WebSocket connections. |
AI Product / Platform / AI Coding Assistant | 81 | ↑ +2 | just now | Details |