topic Re: Incremental syncrhonization in APIs & Integrations

Incremental syncrhonization

Chloeeee — Mon, 19 Dec 2022 03:27:24 GMT

Hi There, Our company uses hubspot APIs to synchronize daily contacts data to hubspot. At present, the interface provided by hubspot to us is a fully synchronized interface, which means the API need compared with all contacts info to update every day. With more and more synchronized lists be created and more contact be synchronized, it makes our system burdensome and requires a lot of jobs to run everyday.

May I ask whether the hubspot have incremental synchronization API to reduce the burden on our system?
* Incremental synchronization API : will only provide everyday updated or new contacts info to us, we don't need to compare all the contacts info everyday.
*Fully synchronized API: we need to compare all the contacts info one by one, and find out the update or new contact information by ourselves.

Re: Incremental syncrhonization

Jaycee_Lewis — Mon, 19 Dec 2022 22:26:33 GMT

Hi, @Chloeeee 👋 Thanks for reaching out. There is not an additional set of endpoints or alternative functionality. My two quick thoughts are to look at leveraging Webhooks or the Search API and an operator like BTN to search for updates to a property or record in a specific time range.

Hey, @weiliang_lee @Mike_Eastwood, do you have any thoughts?

Best,

Jaycee

Re: Incremental syncrhonization

Mike_Eastwood — Mon, 19 Dec 2022 23:53:04 GMT

Hi @Chloeeee

@Jaycee_Lewis is right, you can leverage the lastmodifieddate Property in the Search API to only grab what you need to sync.

Have fun

Mike

Re: Incremental syncrhonization

Chloeeee — Tue, 20 Dec 2022 09:11:02 GMT

Hi @Jaycee_Lewis & @Mike_Eastwood ,

Thank you so much for your quick guides,
We synchronize data to hubspot every day, and the lastmodifieddate will be displayed whenever the contact attribute changes. If a contact canceled the subscription first and then modified one attribute, we can't use this lastmodifieddate properties to update, it will only change the contact attribute without canceling the subscription status.

How to solve this problem, or is there any other way we can use?

Best Regards,

Chloe

Re: Incremental syncrhonization

Mike_Eastwood — Tue, 20 Dec 2022 19:49:41 GMT

Hi @Chloeeee

Could you use HubSpot's Webhooks rather than syncs?

We've built apps that watch for Contact Property changes, which triggers the Webhook, which calls our API.

If this works for you then you will only ever update the relevant contacts.

Also, do you have access to Operations Hub Pro? We've played with custom code in Workflows for one of our clients – it's really powerful.

Happy to jump on Zoom to dicuss.

Mike

Re: Incremental syncrhonization

Chloeeee — Wed, 21 Dec 2022 02:18:29 GMT

Hi @Mike_Eastwood ,

It seems that the webhooks is still in beta stage, will it change a lot in the future?

Best Regards,

Chloe

Re: Incremental syncrhonization

Mike_Eastwood — Wed, 21 Dec 2022 03:06:19 GMT

Hi @Chloeeee

We've been using Webhook for several years, and it's rock solid.

The "Conversations Inbox" Webhooks are in Beta, the rest has been live for a while.

Have fun

Mike

p.s. watch out for retries - if you don't reply to the webhook promptly, it assumes you've ignored it and resends the data. There's a "retry" field in the json to check.