Configure Blogger Custom Robots Header Tags for Best Search Ranking in 2020

Search engines draw the most traffic to major content websites. For blogger blogs however, just like other content websites and blogs, you need to do the needful so that search engines may find your blog attractive and friendly to crawl, index and show case to the world.


In blogger (blogspot blogs), the feature is readily available but majority of blogspot users are not utilizing the feature and the few ones that utilize the feature do not do so in the best ways it should.


The feature I am referring to here is well-known to those Keen bloggers who are always working hard to driving traffic to their blogs.


That feature is known as Custom Robots Header Tags.


Yes. Most blogspot users have seen and come across this feature under the blogger settings several times.


Yes. In fact, I can be sure that you have also come across this feature under the blogger settings several times over but, just like most others, you just decide to ignore that feature and scroll pass it.


Well, most people ignore the blogger blogspot custom robots header tags because they don't know how best to configure it. And at the same time, most people believe blogger leaves the best preferences there.


Well, to a level, I can agree and submit to that assumption but that's to a level. You know.


When I say "...to a level", I mean blogger leaves a default settings for the blogspot custom robots header tags; one they believe works best for all bloggers. Yes. blogger may not be wrong by that but you should decide what works best for you.


Let me give you an instance.


Instance A: Let us suppose you set up a blogger blog focusing How-to do this and that precisely in the general SEO sub-section of webmasters niche.


For every blog posts published in this blog, you have a wisely selected and neatly arranged post labels tagged to each such that they are in the form of primary label to secondary label and sub-label.


Example: SEO to On-page SEO to Post Labelling


Instance B: Now, let us suppose you set up another blogger blog also focusing "How-to" in the general SEO sub-section of webmasters niche.


And this time around, your every blog posts published in this blog, you have randomly and unwisely selected post labels tagged to each such that they are in a related form but not easily described.


Example: SEO to SEO Tips to SEO to How-to to On-page SEO


Now, for most, the same settings would work for both referrences set out from above. But to those who wants to get more, they would define their own wants.


And this is why some blogger blogs do really fine, competing favourable against top websites powered by other CMS which you believe to being the best SEO-wise. - because those bloggers wants more and they define their wants.


Well, with that said, in this tutorial, I will be putting you through, with illustration, the best configuration settings for your blogspot custom robots header tags and hopefully; from there you can help your blogger blog do fine and compete favourably in your niche.


NOTE: the configuration settings I show you here works best for all blogspot blogs but you can maximise the benefits by working on other best blogspot SEO practices already discussed in our SEO section. And if you need an SEO services expert for your blogspot blog, you may contact us as well or check our SEO best practices posts here.


What is Custom Robots Header Tags?

As part of the blogspot efforts at being ever flexible with users, blogger makes available a section within the blogger blog settings that allows each blogspot user modify his or her own search engine relationship and visibility preferences as he or she wishes.


Within this section being talked about from above, you'll see a sub-section that writes "custom robots header tags".


This custom robots header tags option allows you instruct Google Search as well as other search engines, which part of your blog you want indexed, which part you want ignored and how you want them accessed or blocked.


Therefore, custom robots header tags, comprises a set of HTML tags at the server level that instructs search engines such as Google which part of a website or blog should be indexed, de-indexed and how such parts should be indexed and presented in the world wide web.


What is the Purpose for Custom Robots Header Tags

Custom Robots header tags serve similar purposes as the robots text file only that it does far more.


Thus, if you have the right custom robots header tags set, you may relax your mind at worrying over your robots text file because, automatically; robots header tags modifies your robots text file per the instructions set in the robots header tags.


The custom robots header tags is one of those set of codes search engine spiders lookout for the moment they arrive a domain for indexation.


As such, web spiders relate with websites per the instructions issued by the custom header tags.


Meanings of Each Word in Blogger Custom Robots Header Tags

  1. all – This indicates that your blog is a free zone and can be accessed and exposed as desired hence, setting this tag, crawlers are not bound by any constraints. They can freely crawl, index and expose your content.
  2. noindex – Though not all the blogs are meant for the general public use. However, even so, if you don’t share the URL of your personal blog with anybody; chances are people will get to know of it and arrive there from search engines. If that is the case with you, thus; you do not want your blog featured in search engine, this is the instruction you should set.
  3. nofollow – Nofollow and dofollow tags are for outbound links. Dofollow is the default robot tag for all your outbound links. That means the search engines can sneak upon the pages you linked to. If you don’t want search bots to look through your links, addition of a nofollow tag is the instruction expected of you to set.
  4. none – This is a two-in-one instruction as it combines the features of both noindex and nofollow tags. The crawlers will neither index your pages nor skim through the links.
  5. noarchive – This feature declares that search engines may not save a copy of your web document for use in case your site goes down. If you are observant enough to notice it, you might have noticed a cached label with most of the website links on SERPs. It shows that Google has captured a copy of your site into their server to display in case it goes down. That being said, the noarchive tag turns off cached version in search pages.
  6. nosnippet – Snippet is the short description of every results being displayed in the SERPs. This snippets in search results help people find what’s on the webpage as it describes what's on the page before visitors get there. If you want to keep the content exclusive, you can turn this header tag on.
  7. noodp – Open Directory Project or Dmoz is a man-made directory of websites. Google uses the information from there sometimes. You can turn it off with this tag if you want to.
  8. notranslate – This feature simply instructs Google not to translate your web content.
  9. noimageindex – If your blog is one that uploads exclusive images you don't want go viral or just want it remain exclusive to your blog alone, you may use this option so that Google may de-indexed your images or never index it at all. Two things should be noted though; i- proper image SEO and exposure may help your blog go viral in no time. Check our other best SEO practices for more notes on that. ii- your visitors may screenshot and share your images still, even with noimageindex tag enabled. We already have some themes that prevents that published. Check our iVthemes for the one that suits your needs the most.
  10. unavailable_after – this feature allows you instruct Google to deindex your blog after a set period of time. In Blogger, you will get a field right to this tag. So, the webpage will be deindexed after the period of time set out in that field.

What is the Best Custom Robots Header Tags Settings for Blogger

Now that you know what each of the tags in the blogspot custom robots header tags stand for and their meanings, you may now be curious to know which robots header tags combination you should use and how to configure them.


Well, it's all answered right below here.


  1. For Homepage tick: all and noodp
  2. For Archive and Search pages tick: all and noodp - I am aware that most blogspot SEO services experts and webmasters recommend choosing noindex for the archive and search pages but that's wrong though, before you tick all for archive and search pages in your blogger blog, read this: how to optimize blogger blog title tags for better search engines ranking
  3. For Posts and Static pages tick: all and noodp

And for those who don't know how to go about it, below here I have a fully illustrated guide on how to do it.


How to Set Blogger Blog Custom Robots Header Tags

Estimated cost: $0
Estimated time: 5 minutes
This tutorial explains with illustration, how to configure your blogger blog custom robots header tags settings for the best results and better search engine visibility.

Requirements:

Recommended tools:

Preparation

  • Either you intend to use your phone or PC, connect either of them to the internet and login your blogger homepage by visiting www.blogger.com.
Blogger blog homepage

Go to Settings from Blogger Dashboard

  • From your Blogger blog dashboard go to Settings and click it.
    From the page that opens, click to search preferences and then click Edit on custom robots header tags.
JS code copied to text editor

Choose Yes to bring up your options

  • Click yes so that custom robots header tags options for your blogger blog shows up.
search within HTML editor

Tick the boxes as seen in the image below

  • Now, observe the image below and tick as selected in the image:
blogger code

Conclusion

Either you believe it or not, custom robots header tags are powerful! If Google can provide an easy click-of-a-button ready-made setup to use it, why not maximize its use?


And if you could apply this configuration settings along with other best blogspot SEO practices available in our SEO sections, I assure you your blog would go places far.


Also worthy of a note; do not tick noindex checkbox until and unless you are sure about it because doing so will pull your website off from search engine result pages.


0 Comments

to top