Our organization have more than 1 million of deals. We have a daily process that ask to endpoint of modified deals, but we get next error when these are up of 10.000. Unfortunately this happen many weekdays.
"Result window is too large, count + offset must be less than or equal to: 10000 but was ..."
Response results are returned in inverse chronological, so this makes impossible get deals modified slices with 10.000 objects and reconstruct URL request with remaining deals with a new since timestamp parameter ...
The API documentation warns to use get all endpoint in these cases. From our point of view it seems to be very inefficient, and also we think that others could have a similar problem, and in this case we want to know how they face it.
We sync customer's data into Google Sheets and as a result we've run into this problem multiple times from multiple angles. From our experience there is no option other than pulling all the deals records at once which means that for a million deals you are looking at 12 hours of syncing no matter what.
Contacts have a recently updated/created that doesnt' have the 10K limit but with deals you have no choice. 😞
If you'd like to retrieve more than 10k records, one other suggestion is to use the CRM API | Search > in which you can search based on the deal property - Last modified date.
.png "HubSpot Employee"){kind=icon}
