Hi @SComeau,
There is an Outlook Contacts Integration by HubSpot which lets you “sync your Outlook (personal) contacts without manual data entry or messy, time-consuming imports”.
As per the description, “You can also add a filter for any Outlook/Exchange field (like categories or company name) or HubSpot list to sync exactly what you want—and nothing you don’t.”
Sounds like what you’re looking for?
Hope this helps!