https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/925962#M71363 <P>I use the following format to be able to retrieve all the data for a given object:</P><P>&nbsp;</P><DIV><PRE><SPAN>function.basic_api.get_page(</SPAN><BR /><SPAN>limit</SPAN><SPAN>=</SPAN><SPAN>100</SPAN><SPAN>,</SPAN><BR /><SPAN>properties</SPAN><SPAN>=</SPAN><SPAN>properties,</SPAN><BR /><SPAN>associations</SPAN> <SPAN>=</SPAN><SPAN> associations,</SPAN><BR /><SPAN>archived</SPAN><SPAN>=</SPAN><SPAN>False</SPAN><SPAN>,</SPAN><BR /><SPAN>after</SPAN><SPAN>=</SPAN><SPAN>after)</SPAN></PRE><DIV>&nbsp;</DIV><DIV><SPAN>For this purpose I use pagination with the value at <STRONG>''response.paging.next.after''</STRONG> and add it to the <STRONG>'after'</STRONG>.</SPAN></DIV><DIV><P>But if there are <EM>associations </EM>that specifically require pagination, there are new keys for each of the association type. Named as<BR /><STRONG>'associations.contacts.paging.next.after'</STRONG> or</P><P><STRONG>'associations.companies.paging.next.after'</STRONG>.</P><P>How should I query them to get all the associations for the given record?</P></DIV><DIV><P><BR /><BR /></P></DIV></DIV> Tue, 20 Feb 2024 21:45:51 GMT GKurtulmus 2024-02-20T21:45:51Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/924929#M71166 <P>Hi again,</P><P>&nbsp;</P><P>I am currently creating a API connector to extract data from HubSpot to a datawarehouse solution.</P><P>&nbsp;</P><P>We are using the&nbsp;GET /crm/v3/objects/&lt;object&gt; endpoints to do most of the extraction. Here we also ask for all associations for each object to any object. These associations also come with separate pagination links. We handle this.</P><P>&nbsp;</P><P>My question is: we see that when running a full load using these endpoints we end up missing a bunch of associations. We are certain we are picking up all associations on "first page" (together with the object properties) and all subsequent pagination pages for each type of association.</P><P>&nbsp;</P><P>When we have identified some missing associations we can make a call to the associations endpoint, eg:</P><P>GET&nbsp;<SPAN>api.hubapi.com/crm/v4/objects/companies/xxxxx/associations/emails</SPAN></P><P><SPAN>and here we can find the missing associations. So there is no scoping or user settings restricting the associations.</SPAN></P><P>&nbsp;</P><P><SPAN>Is there somekind of undocumented features of how the associations works in the objects endpoints that we are using? For instance there is no documentation on the pagination for these associations, so is there something else we should be aware of that might explain the missing associations?</SPAN></P><P>&nbsp;</P><P><SPAN>Sincerely,</SPAN></P><P><SPAN>NM Foss</SPAN></P> Mon, 19 Feb 2024 14:05:14 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/924929#M71166 nmfoss 2024-02-19T14:05:14Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/925962#M71363 <P>I use the following format to be able to retrieve all the data for a given object:</P><P>&nbsp;</P><DIV><PRE><SPAN>function.basic_api.get_page(</SPAN><BR /><SPAN>limit</SPAN><SPAN>=</SPAN><SPAN>100</SPAN><SPAN>,</SPAN><BR /><SPAN>properties</SPAN><SPAN>=</SPAN><SPAN>properties,</SPAN><BR /><SPAN>associations</SPAN> <SPAN>=</SPAN><SPAN> associations,</SPAN><BR /><SPAN>archived</SPAN><SPAN>=</SPAN><SPAN>False</SPAN><SPAN>,</SPAN><BR /><SPAN>after</SPAN><SPAN>=</SPAN><SPAN>after)</SPAN></PRE><DIV>&nbsp;</DIV><DIV><SPAN>For this purpose I use pagination with the value at <STRONG>''response.paging.next.after''</STRONG> and add it to the <STRONG>'after'</STRONG>.</SPAN></DIV><DIV><P>But if there are <EM>associations </EM>that specifically require pagination, there are new keys for each of the association type. Named as<BR /><STRONG>'associations.contacts.paging.next.after'</STRONG> or</P><P><STRONG>'associations.companies.paging.next.after'</STRONG>.</P><P>How should I query them to get all the associations for the given record?</P></DIV><DIV><P><BR /><BR /></P></DIV></DIV> Tue, 20 Feb 2024 21:45:51 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/925962#M71363 GKurtulmus 2024-02-20T21:45:51Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/928222#M71360 <P>Hi <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/698588">@nmfoss</a></SPAN>,<BR /><BR />Thank you for asking the Community!<BR /><BR />I believe there may be a limit in the number of rows you can get. Which API documentation did you use, please? Is there any limit mentioned on it?<BR /><BR />Have you tried breaking up your call in several requests to get all associations, please?<BR /><BR />I also wanted to invite a couple of subject matter experts and some Community Members to this conversation: Hi <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/91608">@alyssamwilie</a></SPAN>, <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/55480">@jonchim</a></SPAN>, <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/408593">@PCronin9</a></SPAN>, <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/206717">@HBrandao</a></SPAN> and <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/133">@stefen</a></SPAN> do you have suggestions to help <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/698588">@nmfoss</a></SPAN>, please?<BR /><BR />If anybody else has anything to add and/or share, please feel free to join in the conversation <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span><BR /><BR />Thanks a lot and have a wonderful day!<BR /><BR />Best,<BR />Bérangère</P> Fri, 23 Feb 2024 13:13:20 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/928222#M71360 BérangèreL 2024-02-23T13:13:20Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/928234#M71361 <P>Hi&nbsp;<a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/698588">@nmfoss</a>,&nbsp;I agree with you, this is a great question, and <A href="https://community.hubspot.com/t5/APIs-Integrations/What-is-the-right-way-to-get-all-objects-with-all-associations/td-p/900275" target="_blank" rel="noopener">I have it too</A>!&nbsp;.If you have an object with more than 100 associations, there _used_ to be an endpoint in the v3 Associations API that would facilitate you paginating the remainder of the associations, but it appears that endpoint has been removed from the documentation and crippled (but not removed!) in functionality (see details in my linked post).</P><P>&nbsp;</P><P>For our organization, we don't have an object with over 100 associations yet, so I haven't had to cross this bridge yet. But, if I had to solve it today, I would use the V4 Associations API (either the Batch - Read or Basic - List endpoints) to get all the associations I need. Do note however that the pagination information from the V3 CRM API is not compatible with the V4 Associations API, so if you do this, I'd throw out the ones you got on the "first page" of results from the V3 CRM API (or simply not request them at all), and use the V4 Associations API to get them all.</P><P>&nbsp;</P><P>For what it's worth, I find this behavior of the HubSpot APIs quite alarming, and I find the lack of participation, comment, and interest in bug reports from anyone employed by HubSpot to be simiarly alarming. In my experience working with the HubSpot APIs that I do, the developer experience has been quite weak, and I have not found anyone at HubSpot yet who seems to share my concerns with what appear to be genuine bugs in their APIs.</P> Fri, 23 Feb 2024 13:35:49 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/928234#M71361 PCronin9 2024-02-23T13:35:49Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/935454#M71532 <P>Hi <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/408593">@PCronin9</a></SPAN> and <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/698588">@nmfoss</a></SPAN>,<BR /><BR />Thanks for your valuable feedback. This means a lot to us.<BR />I have shared it internally for more visibility.<BR /><BR />I'm sorry to hear about your experience regarding this.<BR /><BR />I would like to apologize for the frustration, data issues, and business impact this has caused.<BR /><BR />Thank you <SPAN style="background: var(--ck-color-mention-background); color: var(--ck-color-mention-text);"><a href="https://community.hubspot.com/t5/user/viewprofilepage/user-id/408593">@PCronin9</a></SPAN> also for sharing this workaround that can help in the meanwhile.<BR /><BR />I have checked internally for you and I could see that <STRONG>HubSpot will soon be releasing a V4 of the CRM Object API</STRONG> that will help for this.<BR />I don't have an exact timeline to share for this at the moment but the Team is actively working on it as we speak.<BR /><BR />Thank you for your patience.<BR /><BR />Have a great day!<BR /><BR />Best,<BR />Bérangère</P> Thu, 29 Feb 2024 16:56:28 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/935454#M71532 BérangèreL 2024-02-29T16:56:28Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/1068914#M78186 <P>Hi there, we are facing this issue to. Any update on the v4 API? "Soon" was 8 months ago! <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span>&nbsp;</P> Wed, 13 Nov 2024 13:55:15 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/1068914#M78186 EMårtensson 2024-11-13T13:55:15Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/1069116#M78201 <P>Is there a reason the <A href="https://developers.hubspot.com/beta-docs/reference/api/crm/associations/association-details" target="_blank" rel="noopener">associations API</A>&nbsp;is not a sufficient solution for your use case?</P> Wed, 13 Nov 2024 19:15:18 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/1069116#M78201 PCronin9 2024-11-13T19:15:18Z https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/1069169#M78207 <P>Hi PCronin:<BR /><BR />By now Ive spent enough time on this issue to work around it. Whenever we encounter a company with a next pagination, I refetch all associations from scratch using the Associations v4. Just cumbersome and tough to explain to others looking at the repo why it has to be that way. But yes, its possible to work around and its not that much more labor intensive than having a working pagination (as we only miss the first page when starting anew).</P><P>&nbsp;</P><P>However, the amount of time spent debugging that "later" value (assuming it worked and realizing after some hours that it didnt) was a painful experience. Having undocumented behavior like this in the API is a pain when developing. So I raise any issues I see to validate the price tag for Enterprise that we're happily paying <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span>&nbsp;</P> Wed, 13 Nov 2024 21:13:01 GMT https://community.hubspot.com/t5/APIs-Integrations/Using-GET-crm-v3-objects-lt-object-gt-endpoints-for-extracting/m-p/1069169#M78207 EMårtensson 2024-11-13T21:13:01Z