Hi all, we recently rescanned our site for SEO issues and when we scan our domain it usually scans hundreds of pages we have but today it is stuck only scanning 1 page.
This was a problem that I had earlier but it is still not getting resolved, it seems other SEO tools such as SemRush are able to crawl all of our pages.
Does anyone have any insight on why this is happening on Hubspot?
Hi @SEsposito4! To review this better could you please share a screenshot of the scan results?
@SEsposito4 thanks for sharing!
I think this could be related to robots.txt or meta tags blocking the crawl - This basically means that your robots.txt file or meta robots tags (like noindex, nofollow) restrict HubSpot’s bot but not others, it may prevent scanning.
This knowledge article could be helpful in that case: https://knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results?hubs_content=knowledge.hubspot.com/seo/understand-seo-crawling-errors&hubs_content-cta=robots.txt%20file
Hope this helps - and let me know if you need further help!
Hi,
Could you also check with how your root domain is configured. If your root domain isn’t redirecting properly to where your site actually lives, that could mess up the scan.
You will to ensure that when you type in your root domain, it takes you straight to your website.
Also, if you have got subdomains floating around, you will want to make sure there’s a clear link from your main domain over to them so they get picked up during the scan too.
Hope this helps!
Cheers,
Harsh
