determinism

Open-source harness for measuring how consistently hosted LLM APIs return the same output across repeated runs and over time, with raw transcripts, scoring, and a static leaderboard generator.

A Python library that traces multi-step AI agent workflows and compiles repeated trajectories into deterministic, low-latency code with runtime guards and fallback to the original agent.