API Batch Limit of 100 (10 for contacts)

As a HubSpot Administrator, I’m using the API for two goals:

1. daily pull all data from Hubspot to our own database (backup & integration in other services)

2. daily update properties with data from other systems

The batch limit of 100 (resp 10 for updating contacts) as documented here makes this process unecessarily slow and I would like to have the option to increase this limit somehow. Maybe this can be an option in the Private Apps? This would allow to manipulating large amounts of data more efficiently.

Other products have the option to request an export of e.g. all contacts, processes the request in the background and provide a link to e.g. a *.csv file for download, all via REST endpoints.

If I’m using the API for things it is not intended for, please educate me! It feels like there must be a better way to pull/push 600k+ contacts other than in batches of 10.

I agree! We use to do batch updates via our API every night with 500 contacts in each batch. It is now impossible for us to keep our database clean due to the rediculous limit of 10 contacts by batch. This is a huge problem for us.