AI crawler checker
AI engines can't recommend what they can't read. Check in seconds whether your robots.txt allows GPTBot, ClaudeBot, PerplexityBot, Google-Extended and more.
Free · no sign-up
Check a site
Enter a domain. We read its robots.txt and tell you which AI crawlers are allowed.
