AI benchmark / LLM Evaluation
A GitHub repo benchmarking TypeSafe’s Jev against Sonnet, GPT-5 nano, and local models on 770 Reddit AITA verdicts, with Brier scores, latency, and cost comparisons.
The page clearly presents an AI-related benchmark with a specific methodology, concrete results, and model comparisons. It includes enough visible detail to describe the project as a useful public listing for AI builders and evaluators.
The snapshot does not show a quickstart, install steps, or how to rerun the benchmark locally. It also does not surface the underlying dataset structure or whether the repo provides scripts for reproducing each result end to end.
Last evaluated 22 days ago. Current rank #1015. Down 6 spots in the rankings.
An AI strategy benchmark that pits frontier language models against each other in turn-based games and records decision logs and raw replays.
