Problem:
At the moment, Insights does not work for every field properly. (More info here: https://community.hubspot.com/t5/CRM/HubSpot-Insights-Database-enriches-wrong-address-information/m-...)
You already implemented an option to disable it completely. (https://community.hubspot.com/t5/HubSpot-Ideas/Option-to-turn-off-HubSpot-Insights-on-company-record...
This is not ideal, as some information is correct and we want to benefit from it.
Solution:
Provide the option to enable and disable Insight on a field basis instead of as a whole.