APIs & Integrations

mirko_ds
Membro

Export data to AWS datalake

resolver

Hi everyone,

 

our company has a datalake architecture on AWS with a classic stack lambda + athena + S3.

 

I'd like to transfer all the Hubspot data related to deals on our datalake during the night. I have considered this cases:

 

- using deals API that all the nights get all the data

- using deals API to have only the data of the last 24 hours

 

For rate limit reason, the second way is better but don't garantee that nothing has been cancelled or updated on deals older than 24 hours.

 

Do you have some suggestions or use cases already realized for this scenario?

 

Thanks

0 Avaliação positiva
1 Solução aceita
WendyGoh
Solução
HubSpot Employee
HubSpot Employee

Export data to AWS datalake

resolver

Hi @mirko_ds,

 

By cancelled do you mean that when a deal is being deleted? If that's the case, currently the endpoint doesn't return deleted deal. Any deal that returned from deals API hasn't been deleted. 

 

When looking to get notified of deleted deals, you can explore the HubSpot Webhook: Webhooks API Overview and subscribe to the deal deletions events. 

Exibir solução no post original

0 Avaliação positiva
4 Respostas 4
WendyGoh
HubSpot Employee
HubSpot Employee

Export data to AWS datalake

resolver

Hi @mirko_ds,

 

When looking to retrieved deals that recently got updated/created, you can look into using this endpoint here: Get Recent Deals | Deals API so that you do not have to use the get all deals endpoint and page through all the deals.

0 Avaliação positiva
mirko_ds
Membro

Export data to AWS datalake

resolver

Hi @WendyGoh ,

 

thanks for your feedback. The endpoint you linked it's very good to understand the what is changed/created in last x time.  How can I understand if something has been cancelled?

 

 

 

0 Avaliação positiva
WendyGoh
Solução
HubSpot Employee
HubSpot Employee

Export data to AWS datalake

resolver

Hi @mirko_ds,

 

By cancelled do you mean that when a deal is being deleted? If that's the case, currently the endpoint doesn't return deleted deal. Any deal that returned from deals API hasn't been deleted. 

 

When looking to get notified of deleted deals, you can explore the HubSpot Webhook: Webhooks API Overview and subscribe to the deal deletions events. 

0 Avaliação positiva
mirko_ds
Membro

Export data to AWS datalake

resolver

Thanks again for your reply @WendyGoh .

 

Yes for cancelled I mean that a deal is being deleted. 

 

Thanks for your support

 

0 Avaliação positiva