I know this is a usecase that has been brought up many times, but is it possible to sync more historical data than the basic 10 000 limit set by the search api. I’m currently cloning data bases in my ELT pipeline, and this would really help.
Not to my knowledge,
You might be able to add a filter for creation date and make multiple calls.
Hi @SBurwash , you’re right to bump into that cap. The CRM Search API returns a maximum of 10,000 records per query, so you won’t get “all history” in one sweep.
The reliable pattern is to chunk your pulls by time windows or IDs and page with after, then iterate windows until you exhaust history. Using createdate or hs_lastmodifieddate as your watermark lets you resume incrementally later without re-pulling old pages (Search the CRM - HubSpot docs )
For a true one-time historical backfill or periodic full extracts, switch to the Exports API. It generates downloadable files for contacts, deals, companies and more, with your chosen properties, and it is not constrained by the 10k Search cap.
Kick off an async export, poll for completion, download, then load to your warehouse. After that, keep in sync using Search with a watermark on hs_lastmodifieddate (Accounts Dashboard | HubSpot ) If consistency between HubSpot and your finance or ops system is the gap, Stacksync keeps them mirrored as changes happen.