middleware

A local Rust-plus-Python middleware layer for LLM apps that claims to reduce token usage and add in-process security checks before prompts are sent to a provider.

TypeScript middleware that trims or compresses LLM chat history to fit a token budget, with support for OpenAI, Anthropic, and AI SDK integrations.

Myli is a provider-neutral Python harness for multi-agent visual design workflows. It defines typed design specs, validates JSON candidates at runtime, supports tools and middleware, and can render candidates for visual review with event and trace reporting.