Does the Cloudflare AI Crawler lockout also affects Hubspot?

Marketing & Content Hub Content Strategy & SEO
1

Since Cloudflare intends to block crawlers from LLMs, AIs, whatever you want to call them, or only allow content to be crawled and/or scraped with the website’s explicit consent, and since HubSpot is known to rely on Cloudflare as a partner:

  1. Does this also affect HubSpot customers in general? If so, what is the default setting for a John Doe customer?
  2. Do they have the ability to consent (or not) to this? Or is this determined by HubSpot? Or does it need to be requested separately?
2

Hi @SETMeyer !

I’ll answer your questions below:
1. Yes — but indirectly. While Cloudflare is a key infrastructure partner for HubSpot, HubSpot-hosted websites are not necessarily affected by Cloudflare’s AI crawler blocking by default, unless HubSpot specifically enables those protections for customer sites.

As of now, HubSpot does not publicly state that Cloudflare’s AI crawler blocklist is enforced by default on CMS-hosted sites.

2. By default:

  • HubSpot does not expose settings to block or allow AI crawlers (like OpenAI, Anthropic, etc.).
  • HubSpot customers cannot directly configure Cloudflare’s bot settings — that control sits with HubSpot as the platform owner.
  • AI crawlers will respect the robots.txt and meta tags set by the customer via HubSpot settings.

So, if a HubSpot customer wants to block or allow AI bots, they must manage that via robots.txt or page-level meta tags, not through Cloudflare directly.

Hope this helps!

Carolina De Mares

CarolinaDeMares_0-1744137610972.png
CarolinaDeMares_0-1744137610972.png130×130 23.5 KB

Brandgang

Goirkekanaaldijk 14

5046 AT Tilburg

3

Hi @CarolinaDeMares,
thank you very much! That’s definately a helping answer. Due to it being managed globally and us being able to at least advise crawlers what to crawl/give our own consent, I hope for the best and that HubSpot won’t make any global changes to this.:hugs: