AgentDish directory

web scraping

Accepted listings with this tag.

Listing Category Score Trend Checked
#988 ↓ -6
Web2MD MCP

An MCP server that converts public URLs into clean Markdown for AI agents and MCP-compatible clients. The repo includes setup instructions, a usage example, a direct API option, and notes on supported clients like Claude Desktop and Cursor.

Developer Tools / MCP Servers 84 ↓ -6 13 days ago Details
#1448 ↓ -3
Cockroach Crawler

Open-source TypeScript crawler for AI agents that needs bounded web access, structured extraction, PDF parsing, JavaScript rendering, and MCP support. It outputs Markdown, JSON, and JSONL evidence records with provenance and crawl limits.

Developer Tools / AI Agent Infrastructure 83 ↓ -3 84 days ago Details
#1706 ↓ -2
FuckUI

A CLI/browser skill for AI agents that turns websites into numbered actions with stable references, persistent sessions, and human handoff for auth, CAPTCHA, and MFA.

Developer Tools / Browser Automation 82 ↓ -2 109 days ago Details
#1943 ↑ +2
Site MCP

A web tool that turns a public website into an MCP server so AI agents can search and read its content via a generated link.

Research / Knowledge Work 79 ↑ +2 22 days ago Details