topic Re: Blocked External Resource in Robots.txt in Content Strategy & SEO

Blocked External Resource in Robots.txt

ARama — Thu, 19 Sep 2024 14:02:46 GMT

Hello,

I am getting an error that states "issues with blocked external resources in robots.txt." in SEMRush

The resource URL that is causing it is:

https://hubspotonwebflow.com/assets/js/form-124.js

Can you help me how can I fix this?

Re: Blocked External Resource in Robots.txt

Ben_M — Thu, 19 Sep 2024 14:17:59 GMT

This thread looks to resolve your issue: https://community.hubspot.com/t5/CMS-Development/Blocked-External-Resource-in-Robots-txt/m-p/309272

Re: Blocked External Resource in Robots.txt

ARama — Thu, 19 Sep 2024 14:28:58 GMT

It doesn't seem to be this the issue. Since the URL is from hubspot form

Re: Blocked External Resource in Robots.txt

TSburv — Tue, 24 Sep 2024 16:58:15 GMT

Hello @ARama

You should check robots.txt on Webflow (hubspotonwebflow.com). Ensure that this JavaScript file is not being blocked. Look for any Disallow rules related to /assets/ or similar paths and remove the block for that file if present. If you find that this file is blocked, modify the robots.txt file to allow it.

After updating robots.txt, clear your site cache and revalidate the site in SEMRush to check if the issue persists. By ensuring the file is not blocked in robots.txt, SEMRush should no longer flag this resource as an issue.

Hope it will be useful for you

Re: Blocked External Resource in Robots.txt

kennedyp — Tue, 24 Sep 2024 20:28:47 GMT

Hey @ARama -- how is your form embedded on this page? Often we see this error if you are not using our standard embedded forms. Often while using an integration with HubSpot and Webflow.

If that is the case, I recommend embedding the form on the page using HubSpot form embed code. You would copy the embed code from the form editor, and add it to your page without modifying it.

Please let me know if I did not understand your questions or if you need additional clarification!

Best,
Kennedy

Re: Blocked External Resource in Robots.txt

ARama — Wed, 25 Sep 2024 06:25:11 GMT

Hi, thank you for your reply. We actually use the HubSpot form embed code. We did setup the code from HubSpot in webflow.

Re: Blocked External Resource in Robots.txt

ARama — Wed, 25 Sep 2024 06:38:17 GMT

Hello. When I created the robots.txt file i have not blocked anything. it looks like this:
https://www.numarics.com/robots.txt.

Thank you for your answer.