How To Tell Robot not Indexing our Archive?

Blogger has a variety of URL representations, for example for Archives and Posts. A post will get a URL format like .../year/month/post.html, if we omit /post.html, then it will be .../year/month an Archive page. Each page can generally be accessed by a bot then processed by it, such as for example a Google bot can index the page and then display it on its search engine.

Because each page can be accessed, it is possible that we will find duplicate content. Just say, an article titled "Foo go to Bar" with the URL form "/2018/10/foo.html" will also be found in the "2018/10" Archive Page. On the Google search engine, this can affect the display of 2 content, which is often called a duplicate. For example, we search for the title "Foo go to Bar" in Google search, maybe we will get 2 results from our Blog with 2 different URLs, one of which is the Post Article Link with title Foo go to Bar and the other one is the Archive page Link with title BlogTitle: 10/1/18 - 11/1/18 with the description "Foo go to Bar" inside or showing same description in every Archive Link. Try to search your Blog with keyword site:BLOG-URL example, site:example.blogspot.com.

Expression	URL Format	Meaning
data:view.isHomepage	/	Homepage
data:view.isPage	/p	Static Page
data:view.isArchive	/2018 or /2018/11	Page List of post from the current year or month
data:view.isPost	/2018/11/foo.html	Post Article Page
data:view.isSearch	/search	All URL has a word 'search'
data:view.isLabelSearch	/search/labelname	Page list of Post with 'labelname'
data:view.search.query	/search?q=keyword	Blog Search Result Page.

To avoid this duplication, we cannot use the Custom Robot.txt feature as we forbid robots from accessing the label page section by entering "Disallow: /search/LabelName" because if we enter "Disallow: /2018/10" this will generalize all that is inside that section will be prevented from accessing, this includes our posting page, like the example "foo.html", another problem also that "/year/month/" will definitely become a lot as the age of our Blog increases. from that, the solution is to use the <meta> tag for Robot.

Meta Tags for Robots Search Engine Crawlers

The Meta robot tag is a tag that will tell the Search engine how it should handle a page. This tag is located in the <head> tag section of a page.

Syntax

<meta name='robots' content='ATTRIBUTE'/>

Attribute
`all`	Allow All, mean no restrictions for indexing or serving, like Allow index, allow follow, etc.
`noindex`	Don't show this page in search results.
`nofollow`	Don't follow the links on this page.
`none`	Equivalent to `noindex, nofollow`.
`noarchive`	Don't show a "Cached" link in search results.
`nosnippet`	Don't show a text snippet or video preview in the search results for this page.
`notranslate`	Don't offer translation of this page in search results.
`noimageindex`	Don't index images on this page.
`unavailable_after: [RFC-850 date/time]`	Don't show this page in search results after the specified date/time. The date/time format must be specified in the RFC 850 format.

There are 2 ways in Blogger to provide meta tags for robots, manually and automatically.

Custom Robots Header Tags

This is an automated way to provide meta tags on a page. There are 3 sections here, Homepage, Archive and Search Page, Post and Page.

Inside the Blogger Dashboard select 'Settings'.
Select 'Search preferences'.
See the 'Crawlers and indexing' section.
Click 'Edit' in the 'Custom Robots Header Tags' section.
Choose 'yes' to enable this feature.
Select the desired option.
Save.

Seen from the section, Archive And Search Page is in the same part, if we want to only provide the meta tag for the Archive page, then we have to use the manual method.

Manually Adding Meta Robots Tag in Blogger

The manual method can be done by giving a code for the meta tag. For example, we give a condition to only display the Meta Robots Tag on the Archive page, we can insert the code below between the tags <head> and </head>.

With the <b:if> tag

<b:if cond='data:view.isArchive'>
    <meta content='noindex,noarchive' name='robots'/>
</b:if>

9 comments:

Fabricio vonMay 24, 2019 at 9:08 PM
Just discovered your blog. Thanks A LOT for such useful information for Blogger, I have been using it for 10 years and I dont want to change to Wordpress. Thank you!
Brandon WilliamJuly 3, 2019 at 9:10 PM
This comment has been removed by the author.
UnknownSeptember 7, 2019 at 5:52 PM
learn programming
Brandon WilliamDecember 12, 2019 at 4:02 PM
This system allows you to convert paperwork with out having the necessity to reformat it, which certainly makes your complete course of straightforward. With high-end conversion options, you'll be able to merely alter the transformed paperwork and a few of these applications come at actual tempting and inexpensive worth vary.
onlineconvert
Abid KhanJanuary 15, 2020 at 5:32 PM
Very Helpfull Guide
SmithFebruary 5, 2020 at 8:24 PM
Fascinating! There are so many interesting points there - age, gender, background. I enjoyed looking at the details. Epub FREE
Jeffery WeightMay 8, 2020 at 6:04 AM
This article is awesome. meanwhile I have also written one article on Monitors and technology. So if you want to check it out then you can Click here for more information related to Monitors
Isabell GraciaSeptember 3, 2020 at 1:36 PM
hi,
I have checked so many website, your website is very amazing. you should try this
website
Spacebar counterJanuary 19, 2022 at 3:49 PM
The https://spacebarclicker.substack.com/p/spacebar-counter is found at the most reduced of the console or character-at-a-time printer in an incredibly even line. You realize a space bar counter is an astonishing apparatus, which assists you with finding how regularly you press the space bar on your console. Our subsequent counter instrument will assist you with boosting your tapping speed.