Developer Tool / RAG Evaluation

Retrieval Auditor for LangChain RAG Quickstart

A GitHub example that audits LangChain’s RAG quickstart with retrieval-quality metrics, flags off-topic and out-of-distribution queries, and surfaces ranking and calibration issues with charts and results files.

Clear19/30
Useful25/30
Specific16/20
Complete18/20
Retrieval Auditor for LangChain RAG Quickstart screenshot

Why it was accepted

The page clearly describes an AI developer tool focused on RAG retrieval auditing. The README gives a concrete use case, explains the corpus and retriever setup, and shows the kinds of failures it detects. The snapshot also includes implementation files, result JSON, and charts, which makes it useful for a public listing.

Weakness

The snapshot does not show installation or run instructions beyond the example content, and it’s hard to tell how reusable the tool is outside this specific LangChain quickstart teardown. Maintenance status, supported frameworks, and a fuller feature overview are also not visible here.

Review status

118 days ago #1627 ↑ +4

Last evaluated 118 days ago. Current rank #1627. Up 4 spots in the rankings.

Score history

727878817774807878

Related listings

bdinfo-rs screenshot
92

Developer Tool / Media Analysis

A Rust Blu-ray disc analyzer that reimplements BDInfo for BDMV folders and ISO images, with CLI, desktop, and browser/WASM front ends.

WebLLM screenshot
#7 WebLLM
92

Developer Tool / AI SDK / In-browser LLM inference

WebLLM is a high-performance in-browser LLM inference engine that runs locally in the browser with WebGPU acceleration. It exposes an OpenAI-compatible API, supports streaming and JSON mode, and includes examples for building chat apps and browser extensions.

Molt screenshot
#31 Molt
90

Developer Tool / AI Agent Infrastructure

Molt is an open protocol for letting an AI agent make bounded purchases through disposable, single-use payment credentials. The repo includes a clear quickstart, MCP integration, a threat model, and a working test-mode demo.

Flightdeck screenshot
90

Developer Tool / AI Observability

Self-hosted observability and control plane for production and coding AI agents, with live timelines, fleet-wide feeds, token budgets, MCP allow/block rules, and support for Claude Code plus a Python sensor.