We are currently blocking crawler access in the KB settings, which successfully prevents articles from appearing in Google search results.
However, the Knowledgebase domain itself and its categories are still visible via Google Search.
I also tried the robots.txt approach and the no index tag.
Do you know if there is a setting, possibly outside of the standard HubSpot KB options, that would allow us to hide the entire KB structure (domain and categories) from search engines?
Hi @mreybarr thank your for reaching out to the community on this regard ! To confirm, you’re implement the robotx.txt and no index tag separately correct ? As our KB indicates, the no index tag method should not be used in combination with the robots.txt method, as this will prevent search engines from seeing the “noindex” tag.
I would also like to tag some KB experts from our Community hear their recommendations; @Jake_Lett @ScottPennwood @deepikaverma have you come across this behavior before ? TIA - Josefina, Community Moderator