Robots.txt Generator

Start from

Folders to hide (one per line) Sitemap address Crawl delay (seconds)

Block AI crawlers

Your robots.txt

Upload the file to the top folder of your site so it opens at yoursite.com/robots.txt.

What is the Robots.txt Generator?

Robots.txt Generator by Assignment Lab is a free online tool. Make a correct robots.txt for your website: allow or block search engines, hide folders, add your sitemap, and block AI crawlers if you want.

At a glance

Price: Free. No sign-up, no watermark.
Works on: Phone, tablet and computer, in any modern browser.
Privacy: Runs in your browser. Your text and files are not uploaded.
Made by: Assignment Lab, free tools for students in India.

How to use the robots.txt maker

Pick a starting point: allow everything, a WordPress site, or block everything.
List folders to hide, add your sitemap, and tick any AI crawlers you want to block.
Copy or download the file and put it in the top folder of your website.

Frequently asked questions

Does robots.txt hide pages from Google completely?

No. It asks crawlers not to visit those paths, but a blocked page can still appear in results if other sites link to it. Use a "noindex" tag to keep a page out of search.

Should I block AI crawlers?

That is your choice. Blocking them stops those companies from using your pages for AI training; it does not affect normal Google search.

Is it free?

Yes. The Robots.txt Generator on Assignment Lab is completely free with no sign-up, and it works right in your browser. Nothing you type or add is uploaded.