Robots.txt Generator
Easily create a robots.txt file to guide search engine crawlers and protect sensitive areas of your site.
Default Crawler Rules
Default (All Bots)
Crawl Delay
Restricted Directories
One per line (e.g. /admin/)
Sitemap URL
Live Preview
User-agent: *
Allow: /