Hi @theseanoliver,
As far as I know, HubSpot cannot track or read replies to marketing emails. Currently your best option would be to have someone check the inbox for your from-email-address used in marketing emails and opt-out contacts manually: Unsubscribe an individual contact from receiving all email
Best,
Karsten