prompt cache

Millwright is a self-hosted Rust LLM router that sits between apps and model providers to enforce policy-based routing, control spend, and preserve provider/model affinity for cache reuse.