Developer Tools / AI Agent Infrastructure

Cockroach Crawler

Open-source TypeScript crawler for AI agents that needs bounded web access, structured extraction, PDF parsing, JavaScript rendering, and MCP support. It outputs Markdown, JSON, and JSONL evidence records with provenance and crawl limits.

Clear27/30
Useful28/30
Specific15/20
Complete13/20
Cockroach Crawler screenshot

Why it was accepted

The page clearly presents a real AI-adjacent developer tool with concrete capabilities, usage context, and product positioning. The snapshot shows a full repository with README evidence for crawl strategies, structured extraction, PDF handling, browser rendering, local CLI/API/MCP options, and bounded access controls. That is enough for a useful public listing, and the project is clearly aimed at AI agents and automation workflows.

Weakness

The snapshot does not show installation commands, quickstart examples, API references, or code snippets, so a visitor cannot tell how to try it immediately. It also does not show release activity or maintenance signals beyond commit and file listings.

Review status

39 days ago #1062 ↓ -3

Last evaluated 39 days ago. Current rank #1062. Down 3 spots in the rankings.

Score history

83

Related listings

CodeGraph screenshot
94

Developer Tools / AI for Code

CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.

Traccia screenshot
#3 Traccia
92

Developer Tools / Code Assistant

Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.

scribe screenshot
#5 scribe
92

Developer Tools / AI Agents

Single-binary CLI that builds an AI agent knowledge base from git repos, Claude Code/Codex sessions, and saved links. It generates a portable markdown wiki, runs on cron, supports local Ollama mode, and exposes the result for agents via CLAUDE.md/AGENTS.md and MCP.

LLMRender screenshot
92

Developer Tools / React Libraries

A lightweight React Markdown renderer with built-in LaTeX, syntax highlighting, streaming-safe rendering, and security-focused defaults.