Control who crawls your site
Create robots.txt files with AI bot blocking. Block GPTBot, Claude-Web, CCBot and 15 AI crawlers. Test rules and download instantly.
Rules
Sitemap URLs
# robots.txt — generated by AeoIX (aeoix.com/tools/robots-txt-generator)
User-agent: *
Allow: /
Save as robots.txt at your site root (e.g. yourcompany.com/robots.txt).
Test your rules
Access granted!
User-agent: * Allow: /
Why robots.txt still matters
It’s the first gate every crawler hits — search engines and AI bots alike.
Block AI scrapers
Stop GPTBot, Claude-Web and CCBot from using your content to train models or answer queries without attribution.
Guide search crawlers
Add sitemap URLs, protect admin paths, and keep staging pages out of the index.
Test before you ship
Check whether a path is allowed or blocked for any user-agent before you upload robots.txt to your root.
Find out if AI is recommending you
One domain, five minutes, and you'll know exactly where you stand. *No card required.
Free report · No credit card · Results in ~5 minutes
Free tools
More free AEO tools
No sign-up, no catch. Built to help you get found, quoted and recommended by AI.