I couldn’t see any mention of this in the docs or any existing community posts, so I thought I’d share what this crawler is doing - as advised by HubSpot support.
Request User Agent = HubSpot Ads Link Fetcher/1.0
The “HubSpot Ads Link Fetcher” is running when a portal has switched on the Auto Tracking for Ads. With the Fetcher we check if the links specified in the Ads you are tracking have redirecting URLs or not.
The Hubspot Ads Link Fetcher in that case is the HTTP client that makes a request to the links in the Ad to determine if it includes a redirect. Which cannot be tracked.
