Home
Tools
SEO Tools
Robots.txt Generator
Robots.txt Generator
Create rules for search engine crawlers
Save
Share
Global Settings
Default Access (All Robots)
Allow All
Disallow All
Crawl-Delay (Seconds)
Sitemap URL
Custom Directives
User-Agent
* (All Bots)
Googlebot
Googlebot-Image
Bingbot
Yahoo! Slurp
Baiduspider
YandexBot
Rule
Disallow
Allow
Directory / Path
No custom rules added.
robots.txt
Copy
User-agent: * Disallow: