Agent-Ready.dev
AgentReady.site
Firecrawl
agentShelf.app
Agent.ai
Is Your Site Agent-Ready? by Cloudflare
AI Listing
AI SEO Page
Apify
import.io
Octoparse
Bright Data
ParseHub
Zyte
Scrapy
Data Miner
Agent Ready is a free agent-readability checker for websites. Enter any public URL and it returns a 0โ100 score for how well AI agents, crawlers, and LLMs can understand and act on your site - plus a plain-English fix for every issue it finds.
It validates against the standards that govern the agentic web: โข Vercel Agent Readability Spec - semantic HTML, metadata, structured data, content clarity โข llmstxt.org - llms.txt and llms-full.txt discovery files โข Agent-protocol manifests - MCP server cards, A2A, agents.json, agent-permissions.json, NLWeb, x402, and more
Results are grouped into Site, Page, llms.txt, and Protocol checks, each with a clear pass/fail and a remediation step, so developers can ship changes and re-scan immediately. A corpus benchmark shows how your site ranks against every other site scanned, and every scan gives you a shareable result URL and an embeddable SVG score badge.
Agent Ready is available wherever you work: web app, REST API, MCP server (Claude Desktop, Cursor, Cline, Goose, Continue), CLI (npm: agent-ready-scanner), client SDKs (npm + PyPI: agent-ready-client), and a browser extension for Chrome, Edge, and Firefox.
Freemium: scan free with no signup (3 scans/30 days anonymous, 10 signed in, 25 pages each). Pro ($19/month) adds deeper scans, history, monitoring, and API/MCP access. Built for developers, technical founders, and DevRel teams.
Apify is a JavaScript & Node.js based data extraction tool for websites that crawls lists of URLs and automates workflows on the web. With Apify you can manage and automatically scale a pool of headless Chrome / Puppeteer instances, maintain queues of URLs to crawl, store crawling results locally or in the cloud, rotate proxies and much more.
Agent-Ready.dev ApifyNo Agent-Ready.dev videos yet. You could help us improve this page by suggesting one.
Agent-Ready.dev's answer
Most agent-readiness tools check a shallow list of well-known paths and produce inconsistent or false-positive results. Agent Ready validates against the actual published specs in depth, groups findings into Site / Page / llms.txt / Protocol layers, and gives a concrete remediation step for each. It scans free with no signup, shows how your site ranks against the whole corpus, and meets you wherever you work - API, MCP, CLI, SDK, or browser extension - not just a single web form.
Agent-Ready.dev's answer
Developers, technical founders, and DevRel teams preparing their websites for AI search and autonomous agents. Anyone who needs their site to be discoverable and usable by LLMs, AI assistants, and agentic crawlers.
Agent-Ready.dev's answer
Agent Ready is the only readiness checker grounded in the full set of agentic-web standards at once - the Vercel Agent Readability Spec, the llmstxt.org standard, and the major agent-protocol manifests (MCP, A2A, agents.json, NLWeb, x402). Independent scanners score the same site anywhere from 46 to 96 because they disagree on what to check; Agent Ready's value is spec fidelity and depth of protocol validation, with a plain-English fix for every issue. It's also available on every surface developers use - web, REST API, MCP, CLI, SDKs, and a browser extension.
Agent-Ready.dev's answer
As AI assistants and autonomous agents became a primary way people find products and information, websites built only for human visitors started getting left behind - and there was no precise, standards-grounded way to know how "agent-ready" a site actually was. Agent Ready was built to fill that gap: a rigorous, spec-faithful score plus actionable fixes, so teams can prepare for the agentic web with confidence instead of guesswork.
Agent-Ready.dev's answer
Next.js (App Router) and TypeScript, Tailwind CSS with shadcn/ui, Postgres for scan storage, deployed on Vercel. Standards/protocols implemented include the Vercel Agent Readability Spec, llmstxt.org, Model Context Protocol (MCP), A2A, agents.json, NLWeb, and x402.
Based on our record, Apify seems to be more popular. It has been mentiond 44 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Data collection: Apify actors, one per source, that scrape the open-data endpoints and normalize them. Quebec RBQ ships a daily bulk CSV (inside a 10.8 MB zip, ~924k rows that dedupe to ~54k active licences). Ontario HCRA has no bulk file โ it's an internal JSON API behind the public registry. - Source: dev.to / 18 days ago
Create a free Apify account and grab your API token from Settings โ API & Integrations. - Source: dev.to / 26 days ago
BYOK. It runs on your own Apify token. No shared keys, no lock-in, no licensing chokepoint โ a lesson the whole "Proxycurl shut down and stranded everyone" saga taught the space. - Source: dev.to / about 1 month ago
You need apify-client installed (pip install apify-client pandas scikit-learn). Get a free Apify API token at apify.com โ no card required, every account starts with $5 of credit. - Source: dev.to / about 2 months ago
A free Apify account (for the API token). - Source: dev.to / about 2 months ago
AgentReady.site - AI Readiness scoring platform. Scan any website and get an AI Readiness Score measuring how well it works with AI agents, LLMs, and crawlers. Free scan, 10 free tools, open-source algorithm.
import.io - Import. io helps its users find the internet data they need, organize and store it, and transform it into a format that provides them with the context they need.
Firecrawl - Turn any website into LLM-ready data.
Octoparse - Octoparse provides easy web scraping for anyone. Our advanced web crawler, allows users to turn web pages into structured spreadsheets within clicks.
agentShelf.app - Find out how visible your store is to AI shopping assistants. Free score in ~30 seconds. No signup.
Bright Data - World's largest proxy service with a residential proxy network of 72M IPs worldwide and proxy management interface for zero coding.