Robots.txt Generator
Create a custom robots.txt file to control search engine crawlers
User-agent
All user-agents (*)
Googlebot
Googlebot-Image
Googlebot-News
Googlebot-Video
Bingbot
Yahoo! Slurp
DuckDuckBot
Baiduspider
Yandex
Action
Allow
Disallow
Path
Add Rule
Clear All
Download robots.txt
Copy to Clipboard