Export data to AWS datalakeSOLVE
Oct 28, 2019 4:36 AM
our company has a datalake architecture on AWS with a classic stack lambda + athena + S3.
I'd like to transfer all the Hubspot data related to deals on our datalake during the night. I have considered this cases:
- using deals API that all the nights get all the data
- using deals API to have only the data of the last 24 hours
For rate limit reason, the second way is better but don't garantee that nothing has been cancelled or updated on deals older than 24 hours.
Do you have some suggestions or use cases already realized for this scenario?
Solved! Go to Solution.
Oct 29, 2019 9:36 PM
By cancelled do you mean that when a deal is being deleted? If that's the case, currently the endpoint doesn't return deleted deal. Any deal that returned from deals API hasn't been deleted.
When looking to get notified of deleted deals, you can explore the HubSpot Webhook: Webhooks API Overview and subscribe to the deal deletions events.