What does the checker test?

It checks four areas. Discovery covers robots.txt, your sitemap, and llms.txt. Content checks whether your server returns Markdown when an agent asks for it. Access covers your robots.txt rules for each AI crawler and Content Signals. Capabilities covers files that describe your APIs and tools for agents, such as an API Catalog or an MCP Server Card.

Does agent readiness affect my Google rankings?

Not directly. Google says its AI features rely on the same ranking and quality systems as Google Search, and that Google Search ignores llms.txt files. Agent readiness matters for AI agents and tools that visit your site directly, not for where your pages rank in Google.

Should I block AI crawlers?

It depends on what you want AI companies to do with your content. Many companies use separate crawlers for separate jobs: OpenAI, for example, uses GPTBot to collect training data and OAI-SearchBot for search answers, so you can block one and allow the other. Content Signals add a second layer: a line in robots.txt that states whether you allow AI training (ai-train), AI answers (ai-input), and search.

What is Markdown content negotiation?

When an agent requests a page with the Accept header “Accept: text/markdown”, a server that supports it returns a plain Markdown version instead of HTML. The Markdown version uses fewer tokens so that agents can read more of your content at a lower cost. Cloudflare measured up to 80% fewer tokens in some cases.

How do I improve my score?

Fix the checks in order of effort. First, add a Sitemap line to robots.txt and set rules for AI crawlers. Next, create an llms.txt file and offer Markdown versions of your key pages. Then add capability files, such as an API Catalogue or MCP Server Card, if your site has APIs or tools for agents to use.

AI Agent Readiness Checker

Enter your website to see how well AI agents can find, read, and use it. The checker tests your discovery files, content format, crawler rules, and agent standards, and shows how to fix each gap.

Readiness report

Your readiness report will appear here

Enter your website, then click “Check My Site”.

How to Check Your Site’s AI Agent Readiness

Get a score and a fix list in three steps.

Step 1

Enter Your Website

Enter your home page address. The checker requests your robots.txt, sitemap, llms.txt, and the other files AI agents look for.

Step 2

Review Your Score

See a separate score for discovery, content, access, and capabilities, with every check marked as passed or failed.

Step 3

Fix the Gaps

Start with the discovery and access checks, since they use files you already control, such as robots.txt. Each failed check links to instructions or to a Nivon tool that creates the missing file.

Overview

What Is AI Agent Readiness?

AI agent readiness describes how easily AI agents, such as coding tools, AI browsers, and chat assistants that search the web, can find your pages, read your content, and act on your site. An agent-ready site lists its pages in a sitemap, sets clear robots.txt rules for AI crawlers, serves pages as Markdown, and publishes files describing its tools and APIs. Most sites are early: in a Cloudflare scan of popular sites, 4% declared AI usage preferences in robots.txt, and 3.9% served Markdown to agents that requested it.

Why Choose Nivon’s AI Agent Readiness Checker?

A clear score and fix list to make your site ready for AI.

Four Categories, One Report

Discovery, content, access, and capabilities are scored separately, so you can see which area needs work first.

Every AI Crawler Listed

The report shows how your robots.txt rules treat each AI crawler, including GPTBot, ClaudeBot, and PerplexityBot, because a rule for one name doesn’t apply to the others.