topic Re: Hard limit for no. of deal records extracted using API (Ticket number: #2057435) in APIs & Integrations

Hard limit for no. of deal records extracted using API (Ticket number: #2057435)

mingheng_moka — Wed, 17 Oct 2018 02:11:47 GMT

Hi,

I'm doing the ETL of Hubspot data to my company data warehouse. Have tried extracting all the deals as well as recently modified deals using API from the following endpoints:

https://api.hubapi.com/deals/v1/deal/paged?hapikey=
https://api.hubapi.com/deals/v1/deal/recent/modified?hapikey=

Extraction would halt after 10k records. Have checked response and its due to rate limit (see attached screenshot)

Pls note that I've set it to extract up to 250 records per query but it only extracts 100

Have lodged a ticket, but was directed to post my query here instead.

Please advise.

Thank you.

Regards,
Mingheng

Re: Hard limit for no. of deal records extracted using API (Ticket number: #2057435)

IsaacTakushi — Thu, 18 Oct 2018 16:33:45 GMT

Hi @mingheng_moka,

As stated in this documentation, the Get recently modified deals endpoint only returns up to the 10,000 most recently modified deals. Please refer to this similar topic.

Regarding the limit value used for the Get all deals endpoint, please share your Hub ID and the full request URL you are using (not including your API key).

Re: Hard limit for no. of deal records extracted using API (Ticket number: #2057435)

mingheng_moka — Fri, 19 Oct 2018 02:43:26 GMT

Hi Issac,

Hubspot ID : is 2528720

Full request url for all deals is:
'https://api.hubapi.com/deals/v1/deal/paged?hapikey=XXXXXXXXXXXX&properties=dealstage&properties=invoice_number&properties=createdate&properties=closed_won_reason&properties=closed_lost_reason&properties=pipeline&properties=dealtype&properties=amount&properties=hubspot_owner_id&properties=activation_email&properties=hs_lastmodifieddate&count=250&includeAssociations=true'

Thanks!

Re: Hard limit for no. of deal records extracted using API (Ticket number: #2057435)

IsaacTakushi — Fri, 19 Oct 2018 12:11:25 GMT

Hi @mingheng_moka,

Thank you for the URL. You are only receiving 100 deals per call because you are using count=250 instead of limit=250.

The count parameter is used for the Get recently modified deals endpoint while the limit parameter is used for the Get all deals endpoint.

Use this request URL instead:

https://api.hubapi.com/deals/v1/deal/paged?hapikey=XXXXXXXXXXXX&properties=dealstage&properties=invoice_number&properties=createdate&properties=closed_won_reason&properties=closed_lost_reason&properties=pipeline&properties=dealtype&properties=amount&properties=hubspot_owner_id&properties=activation_email&properties=hs_lastmodifieddate&limit=250&includeAssociations=true