I have two answers.
First, to answer your question directly, in the search bar in contacts, you can put I think almost anything into the search bar line, including telephone number. I just tested it and the contact name came up immediately.
Second answer, in my Android phone app I enabled the app’s ability to display contact name from my HubSpot records. Works also with iPhones. Please let me know if this works for you. It’s very handy.