topic Re: remove Blog /tag URLs from Search Engine indexation in CMS Development

remove Blog /tag URLs from Search Engine indexation

Anton — Fri, 22 Nov 2019 21:27:30 GMT

Hey guys,

as the title says -a client wants to remove all /tag URLs from a specific blog from indexing. Is there a "simple" way to achieve this? I know that you can "globaly" add

<meta name="robots" content="noindex,nofollow">

in Settings->Website->Blog->templates to the blog posting and blog listing templates but as he wants to remove only the /tag URLs neither of those two would work. Adding this to the "blog posting" header wouldn't help and adding the code to the listing view would also affect the default listing view - what's not the goal here.

I've told him about the solution with a custom robots.txt, but he's now happy about that. Excluding the /tag/* URLs in the Google Search Console is also not an option as it'll only affect the google results(who knows which other Search Engine the user uses).

Does anyone have a solution or idea how to achieve this?

Note: The client also told me that he want's a userfriendly and "easly scaleable" solution.

thanks in advance

best,

Anton

Re: remove Blog /tag URLs from Search Engine indexation

alyssamwilie — Sat, 23 Nov 2019 03:30:49 GMT

In the blog listing markup you can target just the topic/tag pages by using the following if statement:

{% if topic %}
    <meta name="robots" content="noindex,nofollow">
{% endif %}

Alyssa Wilie
Web Developer
LyntonWeb

Re: remove Blog /tag URLs from Search Engine indexation

Anton — Mon, 02 Dec 2019 16:44:33 GMT

hi @alyssamwilie,

thanks for the quick and easy solution. It works fine.

Did a small addition so the meta-tag will be added to the head.

My code:

{% if topic %}
<script>
$('head').append( '<meta name="robots" content="noindex,nofollow">' );
</script>
{% endif %}

Thanks again!

best,

Anton

Re: remove Blog /tag URLs from Search Engine indexation

RNWilkinson — Mon, 22 Aug 2022 13:08:48 GMT

Hi Anton,

I am trying to do the same, but I'm having some trouble. Does this code need to go into our blog listing template or the original HubSpot version?

Thanks,

Neal

Edit

This code worked like a charm - our template used a base html file for headers and footers, so I just needed to apply this code in there, rather than the blog template specifically. Works great. Thanks to Alyssa and Anton.

Re: remove Blog /tag URLs from Search Engine indexation

PBifaro — Tue, 29 Aug 2023 17:03:45 GMT

So this goes into setting > Advanced Settings > Head HTML

copy and paste as is or do I need to wrap this in <>

Re: remove Blog /tag URLs from Search Engine indexation

PBifaro — Tue, 29 Aug 2023 17:47:18 GMT

this did n't work for the template

Re: remove Blog /tag URLs from Search Engine indexation

PBifaro — Tue, 29 Aug 2023 17:53:54 GMT

I tried adding this to the blog listing template header section and it just shows at the top of the page.

Where is this supposed to go?

Re: remove Blog /tag URLs from Search Engine indexation

Anton — Tue, 29 Aug 2023 19:31:39 GMT

Hi @PBifaro,

unless you want to go a custom module way you can drop

in the Header-HTML part in the blog settings here:

settings(gear icon top right) -> Website -> Blog -> Templates -> Blog listing pages header HTML and/or Blog post header HTML

best,

Anton