Robots.txt Generator

Build a valid robots.txt from checkboxes, with per-bot rules and the sitemap directive already in place.

robots.txt

Nothing you type here is uploaded, stored or sent anywhere. It all runs in your browser.

What robots.txt does and does not do

It is not a security control. The file is public. Listing /admin tells everyone where your admin is.
Disallow is not noindex. A blocked page can still be indexed from external links — it just gets indexed with no description. To keep something out of the index, let it be crawled and serve noindex.
Never block CSS or JS. Google renders pages; blocking assets makes your site look broken to it.
It lives at the root only. /robots.txt, nowhere else, one per subdomain.

At some point the missing ingredient is authority, not crawl rules.