Robots.txt Generator
Create and validate robots.txt files to control search engine crawlers.
Rule 1
Generated robots.txt
User-agent: * Disallow:
Instructions
- Copy the generated content above
- Create a file named
robots.txt - Paste the content and save
- Upload to your website's root directory