Luckily I managed to sort out the issue. The reason why my call always failed was due to the limit imposed by HubSpot in getting records. I sorted this issue by running a loop and making calls with Limits set to 100. Doing so helped me with my issue.
However one issue I ran into now is that certain fields from Contacts object are not retrievable. For example I wanted to extract OriginalSource information by passing the properties tag as shown below