See which AI bots read your siteand which pages they cannot read
An AI answer starts with a crawl. FullReach AI shows which AI crawlers visit your site, which requests fail, what your robots.txt blocks and how many visitors AI sends you.
| Crawler | Purpose | Requests | Failed |
|---|---|---|---|
| GPTBotOpenAI | Training | 8,420 | 1.2% |
| OAI-SearchBotOpenAI | Search | 7,760 | 0.8% |
| ChatGPT-UserOpenAI | Asked by a person | 5,928 | 2.6% |
| PerplexityBotPerplexity | Search | 4,430 | 4.9% |
| ClaudeBotAnthropic | Training | 3,680 | 0.4% |
Illustrative sample. The brands are real. The figures in the sample panels are invented.
Crawler visits
Each request from a known AI crawler, by day, crawler and page.
Verification
Each request’s address against the list its operator publishes: verified, spoofed or unverifiable.
Crawlability
What your robots.txt allows for about 30 AI crawlers, and what a plain request to your homepage gets.
AI visits
The sessions that AI assistants send to your site, read from your Google Analytics 4.
Find out if AI can read you
AI cannot cite a page that it cannot read. These checks show you where the crawl breaks.
Connect your logs your way
Upload a log file, send logs with an ingest key, or connect Cloudflare. On an upload, only the crawler rows leave your browser.
Tell real crawlers from fakes
Anyone can call a bot GPTBot. FullReach AI checks each request’s address against the list that the operator publishes. Spoofed requests stay out of every count.
Catch the pages that fail
See every page that answers an AI crawler with 403, 429 or 5xx. Pages not found are listed apart.
Audit your robots.txt
See what your robots.txt allows for each AI crawler, and the line that decides it. Test a URL, and compare the last 30 versions of the file.
Check your homepage every day
FullReach AI checks that your homepage reads without JavaScript, and asks ChatGPT’s own fetcher to open it and quote it.
Join crawls to citations and visits
Own Pages puts each page’s crawler requests next to the answers that cite it and the visitors AI sends to it. A page that AI crawlers read but no answer cites stands out.
| Page | Crawler requests | Cited in | AI sessions |
|---|---|---|---|
| / | 2,249 | 41 answers | 812 |
| /pricing | 1,647 | 28 answers | 455 |
| /blog/best-crm-small-business | 1,891 | Never cited | 37 |
| /features/pipeline-management | 1,552 | 9 answers | 120 |
AI sessions come from Google Analytics 4. The count is a floor, because GA4 files some AI visits under Organic Search or Direct.
Ask ChatGPT which AI bots read your site.
Connect FullReach AI to the assistant your team already uses. It reads the same figures as your dashboard, and the answers behind them.
Is anything stopping AI crawlers from reading our site?
Your robots.txt blocks CCBot. It blocks Google-Extended, with exceptions. PerplexityBot got 217 failed requests in the last 28 days, most of them a 403 on /pricing.
Today’s check could not confirm that ChatGPT can read your homepage.
One project. Four views of AI search.
All four read the same prompts, platforms and markets.
Agent Analytics questions
Which AI crawlers do you recognise?
About 30 AI crawlers that their operators document. Among them are GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot and ClaudeBot.
Do I need to install a script?
No. Upload a log file, send logs from a CDN or a server with an ingest key, or connect Cloudflare with a read-only token.
What does “spoofed” mean?
The request used the name of a known AI crawler, but it came from an address outside the list its operator publishes. Cloudflare sends no addresses, so its requests stay unverifiable.
Do you store my visitors’ IP addresses?
No. On an upload, only the crawler rows leave your browser. FullReach AI reads the address to verify a request, then keeps daily counts without it.
Why are the AI visit counts a floor?
GA4 cannot attribute every AI visit. It files some under Organic Search or Direct. FullReach AI shows what GA4 counts and adds nothing to it.
Can I check my site without an account?
Yes. The free AI crawler checker reads the robots.txt and the homepage of any website. It shows which AI crawlers may read it.
Learn what AI says about you.
Your first analysis runs right away.
7-day free trial · No credit card required