AI Readiness Checker
Can ChatGPT, Claude, Perplexity and Google’s AI Overviews reach your page, read it and quote it? Enter an address and get a report in a few seconds: crawler access, content without JavaScript, structure and structured data.
- Loading the page as a browser would
- Reading robots.txt for 19 AI crawlers
- Requesting the page as GPTBot, ClaudeBot and PerplexityBot
- Measuring the content available without JavaScript
- Looking for structured data, a sitemap and llms.txt
Want your site to show up in AI answers?
The checker looks at one page. We audit the whole site, give you a prioritised list and implement the changes for you.
- Audit of every page template, not just the home page
- robots.txt, CDN and firewall rules set up for the crawlers you want
- Server-side rendering or prerendering for JavaScript-heavy pages
- Schema.org markup, content structure and llms.txt
- A before-and-after report you can show your team
Why AI search needs its own check
A growing share of people ask an assistant instead of typing a query into a search engine. The assistant answers in its own words and cites a handful of sources. Being one of those sources depends on things a classic SEO audit does not look at: whether the assistant’s crawler is allowed in, whether it can read the page without a browser, and whether the page contains a passage that answers the question on its own.
Many sites fail the first step without knowing it. A security plugin or a CDN setting blocks “AI bots” wholesale, a robots.txt copied from a template disallows them, or the whole site is rendered in the browser and looks empty to anything that does not run JavaScript. None of this shows up in ordinary analytics, because the visitors who never arrive are machines.
1. Access
robots.txt rules for nineteen AI user agents, server responses to crawler user-agent strings, and noindex or nosnippet directives.
2. Readability
How much text is in the HTML before any script runs, how fast the server answers and whether the document is small enough to be read in full.
3. Quotability
One clear topic, sections with descriptive headings, semantic markup, structured data and the files that help crawlers find the rest of the site.
Questions and answers
What does the AI Readiness Checker test?
It loads one page the way a crawler does and checks five things: whether robots.txt and the server let AI crawlers in, whether the text is in the HTML without running JavaScript, whether the page is structured so that a passage can be quoted, whether it has structured data, and whether the site publishes a sitemap and an llms.txt file.
Which AI crawlers are checked?
Nineteen user agents: OAI-SearchBot, ChatGPT-User and GPTBot from OpenAI; Claude-SearchBot, Claude-User and ClaudeBot from Anthropic; PerplexityBot and Perplexity-User; Googlebot and Google-Extended; Bingbot; Applebot and Applebot-Extended; DuckAssistBot, Amazonbot, MistralAI-User, Meta-ExternalAgent, CCBot and Bytespider.
What is the difference between a search crawler and a training crawler?
A search crawler, such as OAI-SearchBot or PerplexityBot, builds the index an assistant searches when it answers a question, and that is what gets your page cited. A training crawler, such as GPTBot or Google-Extended, collects text for training models. You can block training crawlers and still appear in AI answers, so the checker reports them separately and does not count them against the score.
Why does content without JavaScript matter?
Most AI crawlers download the HTML and do not execute scripts. If a page is assembled in the browser by React, Vue or Angular, the crawler receives an almost empty document. Server-side rendering or static generation puts the content into the first response, where every crawler can read it.
Do I need an llms.txt file?
It is optional. llms.txt is a proposed convention: a short Markdown file at the root of the site that summarises it and links to the most important pages. No major AI provider treats it as a ranking signal and support is still limited, but it takes minutes to add, so the checker lists it as an improvement rather than an error.
How accurate is the result?
The robots.txt rules are evaluated exactly as the crawlers evaluate them. The server-level test sends requests with the crawlers' user-agent strings from our own server, so it detects blocking by user agent but not blocking by IP address. Only the one page you enter is checked; a site-wide picture needs a full audit.
Need more than a one-page check?
We have been building and maintaining websites and SaaS products since 2008. Tell us about your site and we will come back with a plan and an honest estimate.
