semantic caching

CacheCore is an agent infrastructure tool that sits between LLM clients and the API to cache exact and near-identical prompts, cutting repeat calls and latency. The page shows OpenAI-compatible integration, support for common agent frameworks, and use cases for RAG and multi-agent workflows.