Skip to content
Home
About
Contact
Search for:
Search
Search
Robots.txt Generator
Robots.txt Generator
Build a custom robots.txt file to control how search engines crawl your site.
Quick Presets
Allow All
Block All
WordPress Defaults
Crawl Rules
+ Add Rule
Sitemap URL (optional)
Crawl-Delay in Seconds (optional)
Block common aggressive/scraper bots (AhrefsBot, SemrushBot, MJ12bot)
Clear
Generate robots.txt
Generated robots.txt
Copy to Clipboard
Download robots.txt
Scroll to Top
