AgentDish directory

crawler access control

Accepted listings with this tag.

Listing Category Score Trend Checked

A pay-per-crawl system that lets site owners charge AI crawlers per page across WordPress, Next.js, Laravel, Cloudflare, nginx, Python, Go, and more. The page says payments settle in USDC on Base, with no custody, and that each edition includes crawler discovery files and support for x402/MPP-style access control.

AI Infrastructure / Crawler access control / pay-per-crawl 78 ↑ +6 8 days ago Details