Form Submission capture to data warehouse

[sanchid]

Hi All, 

We all know that form submissions data can be captured as fields in Hubspot. However if a different form or the same form is submitted again, these values can be overridden. To track this better, Hubspot allows us to see all data points of the form during the submission activity. Is there a way we can record this back to any of the tables in a data warehouse, so that it helps us analyse this better?

[Jonas_De_Mets · Accepted solution]

Hi @sanchid,

What data warehouse do you use? I've extracted HubSpot data to Redshift, BigQuery, and Snowflake using Fivetran or a similar tool. These platforms have clear data models that can inspire your setup:https://docs.google.com/presentation/d/17hG7vce4KMDLvHjYKhrmCeGpjaxVu8dLBWfhBeev7NI/edit#slide=id.ge... 

Hope this helps!

Best regards,
Jonas De Mets
HubSpot Revenue Operations & Co-Founder @ Koalify 

Did my answer help? Please "mark as a solution" to help the community.

[johnelmer]

@sanchid @Jonas_De_Mets @TomM2 You might consider using an app in the HubSpot App Marketplace called Database Sync for HubSpot.  This app syncs forms data (and over 100 other data tables) from HubSpot to Azure, Bigquery, MySQL, PostgreSQL, Redshift, and SQL  cloud databases.  The cost is only $49 a month for daily sync refreshes, and faster rates are available.

[TomM2 · Accepted solution]

Hey @sanchid just to add to what everyone else posted, you can use the get submissions endpoint here to get the raw data for each submission. This will show you the values submit on the form submission, not the existing values for the CRM record. 

[sanchid]

Thanks Tom, let me try this once.

[Jonas_De_Mets · Accepted solution]

Hi @sanchid,

What data warehouse do you use? I've extracted HubSpot data to Redshift, BigQuery, and Snowflake using Fivetran or a similar tool. These platforms have clear data models that can inspire your setup:https://docs.google.com/presentation/d/17hG7vce4KMDLvHjYKhrmCeGpjaxVu8dLBWfhBeev7NI/edit#slide=id.ge... 

Hope this helps!

Best regards,
Jonas De Mets
HubSpot Revenue Operations & Co-Founder @ Koalify 

Did my answer help? Please "mark as a solution" to help the community.

[sanchid]

So each form can bring in multiple contact/conversion level information like UTM params while submission. However these values can be overriden if a new form is submitted. In order to track the history, I'd like to capture the form level submission data also to my data warehouse in Bigquery.

[Jonas_De_Mets]

@sanchid correct! You should be able to retrieve this data in a table that contains all form submissions. 

Hope this helps!

Best regards,
Jonas De Mets
HubSpot Revenue Operations & Co-Founder @ Koalify 

Did my answer help? Please "mark as a solution" to help the community

[sanchid]

But from the screenshot or your deck, I'm not able to see which table actually captures the field information during the form submission. I guess not even a JSON field is available to capture all form level data.

[Jonas_De_Mets]

@sanchid you are right, the table does not contain the details of the form submission. I double checked in our BigQuery database (see printscreen below). Pretty sure we could do this in the past with Fivetran though. I believe it might be related to the switch to the new HubsSpot API.

You would need the legacy API endpoint to capture the details of form submissions as @TomM2 refered to: https://legacydocs.hubspot.com/docs/methods/forms/get-submissions-for-a-form

If you prefer to use an ETL solution, Airbyte should be able to capture this data according to their documentation for HubSpot. 

Hope this helps!

Best regards,
Jonas De Mets
HubSpot Revenue Operations & Co-Founder @ Koalify 

Did my answer help? Please "mark as a solution" to help the community.

[Celmer93]

Sanchid,

There's a pre-built integration to SQL server that you should evaluate as well as the manual API route that Karsten mentioned. 

https://datawarehouse.io/product/hubspot-ms-sql-integration/ This handles both the extraction and storage - and the form submission data tables are included.

[karstenkoehler]

Hi @sanchid,

Yes, the HubSpot CRM API would be one way to do that: https://developers.hubspot.com/docs/api/crm/understanding-the-crm

Best regards!