‹ robots.txt generator
robots.txt file generator
Tick what should be reachable and what should be closed. The file assembles live below, ready to save at the root of your site as /robots.txt.
Check an existing file ›Start from a ready setting
Block AI model crawlers
You refuse entry to the chosen AI crawlers. It does not affect your Google ranking.
Hide selected paths
Addresses that should not reach the results. Not a lock on people, just a request to crawlers not to index them.
One per line, each starting with /.
The full sitemap address. It hands the search engine the list of all pages.
Your robots.txt file
Copy it and save as robots.txt at the root of your site (next to the home page).
User-agent: *
Disallow: