How to use
- Enter paths to disallow or allow.
- Add a sitemap URL if you have one.
- Review the generated robots.txt.
- Copy or download the file.
Web and Developer
Build a basic robots.txt file.
Your files and text never leave your computer. Robots.txt text is generated in your browser. Your entries are not uploaded, stored or sent to a Chrysoro server.
No. It gives crawler instructions but does not protect private content.
No. It creates a basic file draft from your inputs.