# How to do an incremental load of API data pull **URL:** \ **Category:** APIs & Integrations\ **Tags:** developer-tools\ **Created:** [June 18, 2019, 10:10pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855 "2019-06-18T22:10:10Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![JessicaSalley](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/jessicasalley/32/84489_2.png) [@JessicaSalley](https://community.hubspot.com/u/JessicaSalley)\ **Post date:** [June 18, 2019, 10:10pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/1 "2019-06-18T22:10:10Z")
We are unable to do incremental load as we do not have (i) Ability to read the data based on date filters [Date filters are not accepted in API Call] (ii) Ability to update the existing data since we do not have unique row identifier. Would it be possible to reach out to the support team to add some unique row identifier so that we can do insert/update. Also, if possible, some kind of date fields which we can use to extract data incrementally. Till then we have to do full load every day (Truncate and load). We are working with the workflows, social media, forms APIs and this is a big barrier ---
**Author:** ![IsaacTakushi](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/isaactakushi/32/70387_2.png) [@IsaacTakushi](https://community.hubspot.com/u/IsaacTakushi)\ **Post date:** [June 19, 2019, 1:34pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/2 "2019-06-19T13:34:43Z")
Hi, @JessicaSalley. Could you describe your ideal scenario with an example? It sounds like you wish to update contacts in your account each day via either [manual import](https://knowledge.hubspot.com/articles/kcs_article/contacts/import-contacts-companies-deals-tickets-products) or the [Contacts API](https://developers.hubspot.com/docs/methods/contacts/contacts-overview) but are encountering issues. Am I following so far? If so, I have two specific questions: 1. **Why do you wish to “extract data incrementally” by date?** Are you seeking to check HubSpot contacts for relevant updates and then only update _those_ contacts via import or the Contacts API? If so, could you use the [_Get recently updated and created contacts_](https://developers.hubspot.com/docs/methods/contacts/get_recently_updated_contacts) endpoint? 2. **Could you clarify why you do not believe you have a “unique row identifier”?** If you are referring to importing objects, HubSpot supports the following identifiers: 1. [Email address or record ID](https://knowledge.hubspot.com/articles/kcs_article/contacts/how-does-hubspot-deduplicate-contacts) for contacts. 2. [_Company domain name_ property value or record ID](https://knowledge.hubspot.com/articles/kcs_article/contacts/how-does-hubspot-deduplicate-contacts) for companies. 3. [Record ID](https://knowledge.hubspot.com/articles/kcs_article/contacts/how-does-hubspot-deduplicate-contacts#object-id) for deals, tickets, and products. 4. If you’re not sure what the record ID values are, you can [export](https://knowledge.hubspot.com/articles/kcs_article/contacts/export-contacts-companies-deals-or-tickets) the objects from HubSpot, modify the data in the rows, and re-import to update records. Finally, if you are working out of account **1430252** , you have full access to [HubSpot support](https://help.hubspot.com/). Should you want it, my colleagues would be happy to walk through the import process in greater detail. ---
**Author:** ![JessicaSalley](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/jessicasalley/32/84489_2.png) [@JessicaSalley](https://community.hubspot.com/u/JessicaSalley)\ **Post date:** [June 19, 2019, 2:26pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/3 "2019-06-19T14:26:50Z")
Our team is working with the workflows, social media, and forms APIs for this project not the contacts API. We are working witht that instance and would appreciate a resource to be able to help if it’s included in our contract. ---
**Author:** ![IsaacTakushi](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/isaactakushi/32/70387_2.png) [@IsaacTakushi](https://community.hubspot.com/u/IsaacTakushi)\ **Post date:** [June 19, 2019, 5:03pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/4 "2019-06-19T17:03:56Z")
Hi, @JessicaSalley. You can contact support at any time by following the instructions on [this page](https://help.hubspot.com/). Options include: - Live support over phone. - Live support over chat. - Support via email. Could you clarify _exactly_ what data you are looking to incrementally upload or update? If you are working with the [Workflows](https://community.hubspot.com/rs.hubspot.com/docs/methods/workflows/workflows_overview), [Social Media](https://developers.hubspot.com/docs/methods/social_media/create_broadcast), and [Forms](https://developers.hubspot.com/docs/methods/forms/forms_overview) APIs, then perhaps you are looking to do all or some of the following: - [Create workflows](https://developers.hubspot.com/docs/methods/workflows/v3/create_workflow) - [Create social broadcast messages](https://developers.hubspot.com/docs/methods/social_media/create_broadcast) - [Create](https://developers.hubspot.com/docs/methods/forms/v2/create_form) or [update](https://developers.hubspot.com/docs/methods/forms/v2/update_form) forms - [Submit data to forms](https://developers.hubspot.com/docs/methods/forms/submit_form_v3) (thus indirectly creating or updating contacts) It’s still unclear to me how incremental uploads and row identifiers relate to these actions. To me, the term “incremental upload” invokes contacts, deals, and tickets, and I’ve only ever heard of “row identifiers” in the context of object imports. ---
**Author:** ![JessicaSalley](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/jessicasalley/32/84489_2.png) [@JessicaSalley](https://community.hubspot.com/u/JessicaSalley)\ **Post date:** [June 19, 2019, 5:10pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/5 "2019-06-19T17:10:51Z")
We are trying to pull down data on publishing and workflow goals completion into our SQL Server data warehouse for reporting purposes and blending that data with our CRM data and ecommerce and invoicing platforms. So we are not attempting to use the APIs to create content or create workflows. ---
**Author:** ![IsaacTakushi](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/isaactakushi/32/70387_2.png) [@IsaacTakushi](https://community.hubspot.com/u/IsaacTakushi)\ **Post date:** [June 20, 2019, 9:37pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/6 "2019-06-20T21:37:01Z")
Hi, @JessicaSalley. Thank you for clarifying. I didn’t understand that you were describing issues retrieving data _from_ HubSpot to then incrementally upload _into_ your database. Most of the “upload” questions I field refer to HubSpot. At this time, there are no plans to add date filters to the `GET` endpoints for workflows, social broadcast messages, forms, and form submissions. That said, I will share your use case internally so that the team knows there is need out there. I also do not expect support for unique row identifiers across APIs in the foreseeable future. That said, could you generate your own using, for example, the millisecond timestamps when requests are received? ---
**Author:** ![KMalaiyappan](https://avatars.discourse-cdn.com/v4/letter/k/5daacb/32.png) [@KMalaiyappan](https://community.hubspot.com/u/KMalaiyappan)\ **Post date:** [July 17, 2023, 5:55pm UTC](https://community.hubspot.com/t/how-to-do-an-incremental-load-of-api-data-pull/14855/7 "2023-07-17T17:55:25Z")
Hi Isaac, I looking to get the incremental data for deal and company and the association of it. Do Hubspot have that feature in place now to make use of. If not please suggest the way to pull only the incremental data