How to Enable Robots.txt and Robots Setting Header Tags on the blog

Indeed this post I've ever published, but I published it again now because I have an update by adding the setting robots header tags. If there are not yet understand what the heck robots.txt it? read more below.

The Robots Exclusion Standard, or commonly known as the Robots Exclusion Protocol or robots.txt protocol is a convention to prevent web crawlers cooperate with other web robots to access all or part of a website that when seen openly.

Robots are often used search engines to categorize and archive web sites, or web master to correct the source code. From some of the articles I read, use robots.txt is very useful to boost SEO blog you know.

Suppose there is a page that does not want us to show to the public and search engines then we can utilize the functionality of this robots.txt to block these pages. Blogger already supports this functionality and this shows that the blogger is getting easier for us to our blog SEO optimization.

I have not understood well, you can register your blog on google websmaster here. Then the clay on the crawl errors, the function will be performed by robots.txt blocking this.
How To Enable And Setting Robots.txt:
1. Log in to blogger with your blogger account.
2. Click settings> Preferences search / Search preferences.


3. On the tab select robots.txt crawlers and indexing.

4. And enter the following command:

     User-agent: Mediapartners-Google
     Disallow:

     User-agent: *
     Disallow: / search
     Allow: /

     Sitemap: http://mannersecret.blogspot.com/feeds/posts/default?orderby=UPDATED


Replace the url http://mannersecret.blogspot.com with your blog url.

Specification:

•      The first line group is Google's user agent information indicates that this blog is a partner of Google, it is easy for those of you who want to use the services in order to google adsense ads will appear relevant to the content of your blog, also tells us that the blog can be accessed through a search engine .
•      The second line is a group for all engine information search engine crawlers. There is written disallow: / search Yag signifies all the search engine robots to index page should not be labeled. which is useful for medium duplicate article very disliked by google.
•      The third row is a group that serves sitemap facilitate the search engines to index your blog
•      Sign "/" is a sign of your home page so do not just put this sign on the column because the resulting disallow search engines can not index your home.

5. Click save changes.

Robot Setting Header Tags
1. Still in Search settings menu preferences / Preferences search
2. The bottom section is no menu Custom robots header tags. Click the edit.
3. Select yes
4. The settings box will appear, match the settings as shown below

5. Save changes

One more note to be careful to use this function because if any-one even your blog being ignored by search engines.