Developer Tools / Code Assistant

i5h Benchmark

A benchmark for coding agents that tests whether they can formally verify properties of real-world Rust web apps in Lean 4. It includes upstream code, i5h ports, extracted Lean models, proof attempts, and task-by-task results.

Clear28/30
Useful27/30
Specific17/20
Complete14/20
i5h Benchmark screenshot

Why it was accepted

The page clearly describes a real AI-adjacent developer tool: a benchmark for coding agents working on formal verification. The snapshot explains the task flow, the Rust-to-Lean pipeline, what the agent receives, how proofs are graded, and shows that results are tracked per task and per model. There is enough visible evidence to make a useful directory listing.

Weakness

The page is marked as a work in progress, and the snapshot does not show full benchmark coverage, public results for every model/task, or how many tasks are included overall. It also does not reveal whether the project is easy to reproduce locally or whether the GitHub link contains setup instructions and downloadable artifacts.

Review status

15 days ago #582 ↑ +2

Last evaluated 15 days ago. Current rank #582. Up 2 spots in the rankings.

Score history

86

Related listings

CodeGraph screenshot
94

Developer Tools / AI for Code

CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.

Mercemur screenshot
93

Developer Tools / API / AI Agent Infrastructure

Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.

Lumae screenshot
#4 Lumae
92

Developer Tools / Code Assistant

Lumae is a free native macOS screen recorder and screenshot tool for polished demos, with automatic zooms, cursor smoothing, motion blur, captions, voiceover, and annotated screenshots. It also exposes editing commands over MCP so agents like Claude Code or Claude Desktop can edit projects directly.

ripwire screenshot
#6 ripwire
92

Developer Tools / Code Assistant

A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.