https://appliedcompute.com/research/inference-benchmark
Under the hood
AI queue
Watch AgentDish crawl new pages and run AI reviews in public.
Processing queue
Live queue state for crawls and AI evaluations.
#46 submission_evaluation
succeeded
#45 submission_evaluation
succeeded
https://rinhelp.com
#44 submission_evaluation
succeeded
https://github.com/hunvreus/pi-hosts
#43 submission_evaluation
succeeded
https://jdeid.it/agi-research/
#42 submission_evaluation
succeeded
https://mistral.ai/news/workflows
#41 submission_evaluation
succeeded
https://github.com/Hodlatoor/SyntheticOutlaw/
#40 submission_evaluation
succeeded
https://arxiv.org/abs/2604.18394
#39 submission_evaluation
succeeded
https://github.com/49Agents/49Agents
#38 submission_evaluation
succeeded
https://sparkit.science
#37 submission_evaluation
succeeded
https://soliddark.net/gate
#36 submission_evaluation
succeeded
https://discuss.ai.google.dev/t/unexpected-67k-gemini-api-spike-in-19-hours-2016-firebase-provisioned-android-key-not-covered-by-googles-may-2024-auto-restriction-policy/142717
#35 submission_evaluation
succeeded
https://chromewebstore.google.com/detail/claude-exporter-claude-ch/mhckealbblinipeplfddmbcohdidkfjf
Processing logs
Newest worker events first.
info / publishing
Publishing accepted listing.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:59
info / evaluation_saved
Saved accepted evaluation with score 78.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:59
info / evaluating
Running the AI evaluation.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:57
info / crawl_saved
Saved crawl snapshot with status 200.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:57
info / crawling
Crawling https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:57
info / checking_duplicate
Checking for an existing accepted listing.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:57
info / starting
Started processing job.
https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/piloting-the-worlds-first-double-blind-ai-evaluations/double-blind-evaluations-technical-report.pdf / 2026-09-02 15:35:57
info / complete
Processing job completed.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:55
info / complete
Rejected submission decision saved.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:55
info / rejecting
Saving rejected submission decision.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:55
info / evaluation_saved
Saved rejected evaluation with score 18.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:55
info / evaluating
Running the AI evaluation.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:52
info / crawl_saved
Saved crawl snapshot with status 200.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:52
info / crawling
Crawling https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:52
info / checking_duplicate
Checking for an existing accepted listing.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:52
info / starting
Started processing job.
https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-8-Flash-Model-Card.pdf / 2026-09-02 15:35:52
info / complete
Processing job completed.
https://mvakde.github.io/blog/44-on-arc-1/ / 2026-09-02 15:35:50
info / screenshot_captured
Screenshot captured and linked.
https://mvakde.github.io/blog/44-on-arc-1/ / 2026-09-02 15:35:50
info / capturing_screenshot
Capturing screenshot for 44% on ARC-AGI-1 in 67 cents.
https://mvakde.github.io/blog/44-on-arc-1/ / 2026-09-02 15:35:46
info / complete
Accepted and published 44% on ARC-AGI-1 in 67 cents.
https://mvakde.github.io/blog/44-on-arc-1/ / 2026-09-02 15:35:46