Default email address for sending from CRM

We have a default email address sent but that hasn’t stopped it from switching me to a different not-default email address that I didn’t want to use. I think it did it because that email address was also on some of the emails. But I would expect that setting a default would keep me on that default email until I specified otherwise.