semantic cache

Open-source package collection for BetterDB’s Valkey/Redis-based AI infrastructure, including semantic cache, agent memory, retrieval, monitoring, CLI, and an MCP server for assistants.

Cachet is a local semantic cache for LLM APIs that sits in front of OpenAI- or Anthropic-compatible endpoints and serves repeated or rephrased requests from cache. It includes a dashboard for hit rate and estimated savings, supports streaming responses, and is implemented as a single Rust binary.

Open-source LLM routing and cascade engine that sends prompts from local Ollama models to cloud and frontier models based on task complexity, cache hits, and quality gates.