Hi, We’ve been using ADFs Hubspot connector to retreive the contact entity and drop it into SQL for a while now, but recently the Copy Data Task has stopped including new contacts. The task completes successfully and doesn’t return any errors, but doesnt include any contacts added since the 21st of March. I see 3 of around 20 records that were added via import on the hubspot site (again, succesfully), and do not see the rest of them, or any since. As a result, I see 20,800 records via the connector, and 20840 in Hubspots front end.
When I switch from using the ‘table’ option in the data source to using a ‘query’, I can select all records (select * from contacts) and get 20,800 - but the [Added_At] column is returned as null and the associated_company_id contains spurious info. If I select a specific vid that is ‘missing’ in the full list, I can see that record, eg adding ‘where vid=1234’. Anything other than one specific vid (eg searching on an attribute such as the name or modified date), or any inequality, a list of IDs using an IN operator, a couple of vids with an OR, etc etc, and the records are not visible.
I’m *guessing* that behind the scenes the connector chooses a different API endpoint depending on whether its a table scan, a query with filters, or a specific vid, and only the latter works to extract these new contacts.
The only other thing I noted was that our vids were fairly small until recently (7 digits), and have very recently jumped to allocating very large IDs - 5458938129,7676958746,8258749207. This doesnt look to cause any problems in the hubspot frontend, but I wasnt sure if this was expected/handled in the Hubspot connector, as they’re now larger than, say, an Int32.
Hey, @GBarnwell Thanks for reaching out. If you haven’t opened a support ticket with ADF, I’d suggest starting there. This is because we don’t have any ability to troubleshoot or maintain 3rd party apps, integrations, or connectors. To your last point, HubSpot rolled out a change to begin using 64-bit data types to store IDs. This rolled out in March — Changelog announcement. You can try opening a ticket with our support if you have access, but I have a feeling that they will direct you to reach out to the connector creator.
Best,
Jaycee
Hi,
I am having a similar issue. How did you solve this issue where with the ADF, HubSpot connector is missing few contacts?
Thanks,
Sruthi