YTKit Pro

Robots.txt & Sitemap Generator logoRobots.txt & Sitemap Generator

Create a valid robots.txt and XML sitemap for your site. Enter your domain, list your pages, add paths to block, and download both files ready to upload to your site’s root folder.

About this tool

Generate a valid robots.txt and sitemap.xml for your website in seconds. List your page URLs and any paths you want crawlers to avoid, then download both files and upload them to your site’s root folder. Add the sitemap in Google Search Console so new pages are found faster.

How to use the Robots.txt & Sitemap Generator

  1. Enter your website URL.
  2. List your pages and disallowed paths.
  3. Generate and download both files.

Why use this tool?

It is 100% free, needs no signup, gives instant results and works on desktop, tablet and mobile. Your data is processed in your browser and is not stored on our servers.

Frequently asked questions

Where do I upload these files?

In the root of your domain, for example example.com/robots.txt.

How do I submit my sitemap?

Add it in Google Search Console under Sitemaps.

Where do I upload robots.txt?

Upload it to the root of your domain so it is reachable at yourdomain.com/robots.txt.

Does robots.txt hide pages from Google?

Not reliably. It asks crawlers not to crawl a path. To keep a page out of search results use a noindex tag.

More free tools