Developer Tool / AI Evaluation / Data Format

ARF — a record format for evaluation runs

ARF defines a JSON record format for AI evaluation runs with canonicalization and reproducible SHA-256 digests, so scores can be traced back to the underlying question, model, inputs, and judgment.

Clear25/30
Useful26/30
Specific16/20
Complete16/20
ARF — a record format for evaluation runs screenshot

Why it was accepted

The page describes a concrete AI-adjacent developer format with visible structure: ten record types, reference links between records, offline validation, and a deterministic hashing rule. It also shows examples and explains the purpose of the format clearly enough for a public directory listing.

Weakness

The page is a v0.1 spec and leaves some implementation details unresolved, including schemas and record shapes that may change. It also does not show a packaged library, API, or docs for integrating ARF into another system beyond the format description.

Review status

24 days ago #1043 ↓ -3

Last evaluated 24 days ago. Current rank #1043. Down 3 spots in the rankings.

Score history

83

Related listings

bdinfo-rs screenshot
92

Developer Tool / Media Analysis

A Rust Blu-ray disc analyzer that reimplements BDInfo for BDMV folders and ISO images, with CLI, desktop, and browser/WASM front ends.

WebLLM screenshot
#7 WebLLM
92

Developer Tool / AI SDK / In-browser LLM inference

WebLLM is a high-performance in-browser LLM inference engine that runs locally in the browser with WebGPU acceleration. It exposes an OpenAI-compatible API, supports streaming and JSON mode, and includes examples for building chat apps and browser extensions.

Molt screenshot
#31 Molt
90

Developer Tool / AI Agent Infrastructure

Molt is an open protocol for letting an AI agent make bounded purchases through disposable, single-use payment credentials. The repo includes a clear quickstart, MCP integration, a threat model, and a working test-mode demo.

Flightdeck screenshot
90

Developer Tool / AI Observability

Self-hosted observability and control plane for production and coding AI agents, with live timelines, fleet-wide feeds, token budgets, MCP allow/block rules, and support for Claude Code plus a Python sensor.