Free tool
Can AI crawlers read this website?
Enter a website. We read its robots.txt and its homepage now. You see which AI crawlers may fetch the site, the rule that decides each, and what they can read. You need no account.
What it reads
robots.txt
Each documented AI crawler receives a verdict: allowed, blocked, or “blocked, with exceptions”. Each verdict names the line that decides it.
The homepage
Whether a plain request opens it, how much text arrives without JavaScript, and whether the page opts out of AI answers.
Nothing kept
We read the site when you ask and keep no copy of the result.