A workflow reversal would come in handy, especially when you forget to check the box to only enroll records that meet the trigger criteria after the workflow is turned on.
Cherelle from HubSpot shared this workaround with me in the meantime:
Export the property history for the close date and then import the information to overwrite what is currently there. The steps are linked below for both processes.