Daily Export Request causing 429 Error

I have a daily export of all our talbes. If I run this more than once a day, i get the message:

HTTP error: 429 Too Many Requests date: Tue, 15 Aug 2023 09:00:11 GMT content_type: application/json;charset=utf-8 content_length: 262 connection: keep-alive cf_ray: 7f703ee6df342039-IAD cf_cache_status: DYNAMIC strict_transport_security: max-age=315360…

Some tables like the Deals have over 10,000 rows. I tried to use a get request but according the Hubspot support, you are limited to 10,000 records (using an offset fails at 9994)

Is there a daily Oauth limit and if so, any workarounds for this. Considering the Snowflake connector but it’s pricey.

@VascoEagles There is a paid app in the HubSpot App Marketplace that exports the data you want to Excel -- the Excel Integration for HubSpot. Using this app, your HubSpot data can be set up to refresh in Excel on a regularly scheduled basis. There is another app called Ultimate Data Export that might meet your needs.

To clarify, I have a job that does a post request (for example: post /crm/v3/exports/export/async/contacts). This makes only 3 requests. It gets the contacts, line items and deals.

However, if I run this job twice a day, we get a 429, too many requests error.

Why would we get this if we are making less than 10 requests a day? Does it use up a ton of requests while processing the files? We have over 10K records in those 3 tables.

Final post here as I figured out what it going on. When you use the export function you are limited to 10 exports per day.

message": “This portal has reached the maximum daily number of exports (limit: 10)”,

Will check to see if there is an option to increase.