This is a problem for us as well… and there should be a way to limit this. However, since Hubspot charges for every contact you add, I suspect limiting ways of creating contacts is not something they will put a high priority on…
I hope that is not the case here!