Manual searching through the "Manage Duplicates" section, page by page is rather time consuming and inefficient.
Suggestions would be:
Incorporate a search field within the Manage Duplicates section to search for an email address instead of a page by page scroll down search, OR
A property indication on the Contact Record that can be clicked on to either manage/merge the duplicate at the contact record level or clicked on to take you to that specific contact within the Manage Duplicates section