prompt cache

Millwright is a self-hosted Rust LLM router that sits between apps and model providers to enforce policy-based routing, control spend, and preserve provider/model affinity for cache reuse.

A research project and proxy for Claude Code that chooses per-step reasoning effort with Jev while preserving the prompt cache. The repo includes benchmark results, a real-session measurement, and notes on how the mechanism works.