Hi everybody,
I’ve used different times HubSpot’s SEO tool but with this website (carboff.it) I’m facing this problem: the result of the scan is only one page scanned and the message "Confirm the correct pages are blocked by your robots.txt file(1)"
I’ve checked in the Robots’s file (https://www.carboff.it/robots.txt😞 there is no page blocked and the page is inserted in the sitemap (https://www.carboff.it/page-sitemap.xml).
I’ve also checked in Search console and the homepage and all the other pages are scanned regularly.
I’ve also made a Google search and the homepage appears in the result’s list.
What could be the problem?
Thank to everybody for your help!
Erica
Hey @EricaFontimedia
This seems to be an unexpected error I suggest to kindly reach out to HubSpot support regarding this issue they can better assist you in the HubSpot features issues
Let me know if you have any follow-up questions.
Hi Jigar,
I’ve tried with HubSpot suport but unfortunately I’m not receiving a solution.
I’ve tried, on their advice, to:
- edit the url scanned replacing http with https
- add an exception for HubSpot robot
- deleting the slash after “disallow:”
After all this failed try they’ve said the error is because of the file load too slowly and HubSpot crawler is no capable to read it.
Onestly it doesn’t seem possible to me, it is only a simple txt file. an i can load it super fast.
Do you have some other idea to solve it?
thanks
@EricaFontimedia
Also, can you share the screenshots of the issue you are facing
It was an hosting problem, I’ve solved contacting it.