I was able to resolve this. I think it had to do with my developer account. The app I created for local development was under one of my other Hubspot developer accounts. I tried a different one (one that is associated with a paid account) and it started to give me OAuth2 tokens.