Dear Friend:
Following are the steps to add Robot.txt to your Blog.


What is Robots.txt?

Robots.txt is a text file which contains few lines of simple code it also called sitemap.
It is saved on the website or blog's server which instruct the web crawlers on how to index and crawl your blog in the search results.

Each Blog Hosted on Blogger has its default robots.txt file which is something look like this: 

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED

How to Create robot.txt 
in the search engine type your blog URL http://example.blogspot.com/robot.txt and press Enter
copy the given robot.txt and paste in your blog.

Adding Custom Robots.Txt to Blogger 

Now the main part of this tutorial is how to add custom robots.txt in blogger. So below are steps to add it.

  1. Go to your blogger blog.
  2. Navigate to Settings >> Search Preferences ›› Crawlers and indexing ›› Custom robots.txt ›› Edit ›› Yes
  3. Now paste your robots.txt file code in the box.
  4. Click on Save Changes button.
  5. You are done! 

0 Comments