Hi, we tried to integrate our Hubspot Data with Skyvia. The tables were created in our SQL server; however they are empty and we are getting a failure error. Skyvia has checked their additional logs and saw that error comes from HubSpot.
Can someone please take a look at this so the issue can be fixed?
Thanks!
Welcome, @tromero.
Happy to help. To troubleshoot effectively, though, I’ll need more information. In fact, it will be easiest to resolve this for you if your contact at Skyvia joins this thread as well.
Would you:
Without knowing what calls Skyvia is making and the responses their app is receiving, I have no way to isolate the issue.
I appreciate your assistance and look forward to getting to the bottom of this.
Thanks a lot for your response Isaac!
I can confirm our account HubID ends in 8235.
We tried to use the integration and backup products from skyvia and both of them are failing.
The error for the integration is:
19251087 Failed Internal error Mar 14,2019 3:01 AM 2 min 48 sec
The error for the backup is:
Contacts internal error
I have shared your questions with Skyvia, as soon as I get an answer I will get back to you. I have also asked them if I can include them on this thread.
Thank you so much for your help!
Hello Isaac!
I’m Mariia from Skyvia Team.
We performed extended logging for data integration package with an error. We can provide you with the full log file, please specify the best way to do this.
Log file contains all requests sent to HubSpot, with headers and information about the error.
According to the log file Skyvia is retrieving data from HubSpot - data is returned page by page, 250 records per 1 API call. Each result contains an offset (pointer) to the next page. This offset is used in the subsequent API call. On one of such calls the error occurs.
It’s good to hear from you, @MariiaZ!
Could you send the log file to my email? I will direct message you my email address.
To be clear, could you send me a log of only the calls for @tromero’s account (ending in 8235)? I won’t be able to look through a log of all of your app’s calls to all HubSpot accounts.
Also, could you specify which endpoint is consistently returning a 500 error? Is it the Get all deals endpoint?
Additionally, are you seeing one particularoffset value always fail?
I should be able to find the above information in the log file, but it saves me time if you already know where I should look!
Hi @IsaacTakushi !
I have sent you log file, please check your email.
The log file is related to @tromero’s account and shows an error on Contacts table.
We have some more customers who get “internal error” on reading Contacts, Deals and Engagements, however, we did not perform extended logging for their packages and we cannot provide you with more details.
Please look at the log file and let me know if you have any further questions.
Best regards,
Mariia
Hi, @MariiaZ.
Thank you for sending that file along!
The file contains five hundred and two GET requests to various HubSpot endpoints. Two-thirds of the way through, I see the 500 error, triggered by a query to the Get all contacts endpoint: https://api.hubapi.com/contacts/v1/lists/all/contacts/all?vidOffset=32069401&count=250&property=x&property=y&property=z&property=etc.
I have replicated this exact request multiple times in Chrome, Firefox, and the REST Client Postman with 200 OK responses every time.
Since every test has returned contacts and I cannot reproduce the 500 error, I have to believe these are transient timeouts. HubSpot has seen slightly elevated rates over the past week, which might be why you’re seeing them more frequently.
That said, the overwhelming majority of transient errors can be resolved after a single retry. (Again, I wasn’t able to get a 500 error in all of my tests.)
Can you confirm whether Skyvia retries requests which fail after a short delay? This should almost universally resolve these types of issues for our mutual customers. We recommend that all our integrators use some mechanism to retry 500 errors.
If you are seeing 5XX errors which are consistently reproducible (i.e. with a specificvidOffsetvalue), please let me know.
Hey, @tromero!
For context, I’ve been working with another Skyvia customer through our customer support channel who is encounters similar 500 errors. We haven’t been able to reproduce those errors, either, so also seem to be transient.
Per my last message, @MariiaZ:
Can you confirm whether Skyvia retries requests which fail after a short delay? This should almost universally resolve these types of issues for our mutual customers. We recommend that all our integrators use some mechanism to retry 500 errors.
If you are seeing 5XX errors which are consistently reproducible (i.e. with a specificvidOffsetvalue), please let me know.
Hi @IsaacTakushi , @tromero !
Sorry for the delayed response.
We have improved retry logic on Skyvia side and this should solve this issue. We plan to update Skyvia with these changes soon. We will definitely notify our customers when it is done.
Best regards,
Mariia
Skyvia Team
Thanks for the update, @MariiaZ!
@IsaacTakushi @I know this is an older thread, but for anyone struggling with connecting HubSpot to a SQL Server data warehouse there is a low cost solution. We offer an app in the HubSpot App Marketplace called MS SQL Server for HubSpot . The app pulls your HubSpot data into a SQL data warehouse via prebuilt API connectors. A SQL data warehouse in Azure is included in the cost.
Once your HubSpot data is in the data warehouse, it automatically refreshes on a scheduled basis. You can connect the SQL data warehouse to any other application that has a SQL connector.