topic Re: Download Restriction in APIs & Integrations

Download Restriction

Ashley2 — Tue, 01 Oct 2019 08:11:09 GMT

We load leads that exceed a threshold Hubspot score into a telephone system.
We also gather some information about leads, like form entry on web pages for instance.
To do this we are fetching modified contacts via the API. (We had to keep track of the last read offset etc, but overall this is working for us.)
When bulk mailings are done however, a lot of contacts are modified.
The restriction of 100 per API call is restricting us in getting leads processed quickly in this case.
We have considered using lists instead of the contacts API, but the gain seems limited as it also limits to 100 per call.

It would seem there is now rather a daily limit than a time limit on calls. Can we now call for 100 leads as quickly as the API responds (e.g. 100/second)?
Is there a best practice/preferred way that someone can recommend for the above scenario?
Alternative ideas?

Kind Regards,

Ashley

Re: Download Restriction

WendyGoh — Wed, 02 Oct 2019 02:43:07 GMT

Hi @Ashley2,

I hope all is well with you 😄

When using the Get recently updated and created contacts endpoint, while there's a limit of 100 contact per call, you should be able to page through the next page of contacts by using the time offset and contact offset value in your subsequent call.

For this, I wouldn't expect you to hit the limit of our API usage: https://developers.hubspot.com/apps/api_guidelines.

Additionally, here's some related forum discussion on how pagination works:

https://community.hubspot.com/t5/APIs-Integrations/Pagination-of-contacts-list-not-working/td-p/2366...

https://community.hubspot.com/t5/APIs-Integrations/Get-all-contacts-doesn-t-get-all-contacts/td-p/22...

https://community.hubspot.com/t5/APIs-Integrations/Recently-Created-API-call-isn-t-paging-results/td...

I hope this helps to further clarify things here!

Re: Download Restriction

Ashley2 — Wed, 02 Oct 2019 06:31:11 GMT

Hi WendyGoh,

Thank you for the reply.

We can page through the contacts, but I believe we are limited to a page of 100 every 10 seconds. When a mass mailing or update goes through almost the entire set refreshes on Hubspot and ends up in recent modified. On 200,000 prospects it takes 5.5 hours to traverse the set @100/10sec assuming no overhead on each call and zero processing time on our side. In reality this takes 2 days at the moment. We process 1000 at a time with 10 API calls in each round.

Is the 10 second limit between calls still applicable?

One can request a list via the Hubspot user interface and a link is sent within an hour normally on email. Then one downloads the list - this can be done manually within 2 hours, is there no way to get the entire list in one go via the API?

Or is there another preferred way of doing what we are trying to achieve?

Thank you!

Re: Download Restriction

Ashley2 — Fri, 04 Oct 2019 05:49:47 GMT

Bump 😉 anyone? Thanks

Re: Download Restriction

WendyGoh — Mon, 07 Oct 2019 02:02:02 GMT

Hi @Ashley2,

Pardon that this slip through the cracks!

Currently, the limit of each call for both Get all contacts | Contacts API and Get contacts in a list | Contact Lists API return a maximum amount of 100 contacts.

On top of that, when looking at our API limits here: API Limits; you can see that the limit is 100 calls per 10 seconds this means that you can call both the above endpoint 100 times per 10 seconds and so this means you can retrieve back 10000 contacts per 10 seconds.

I hope this helps!

Re: Download Restriction

Ashley2 — Mon, 07 Oct 2019 14:23:09 GMT

Hi @WendyGoh

Oops should have caught that. Thanks so much! Will increase the calls on our side.