Non-timed AB tests

Status: Idea Submitted

Up until last week, we were able to run AB tests on marketing emails where 100% of the list received the emails right away, with 50% getting one version and 50% getting another.

On Friday, that went away, and now every time we want to test something, we have to wait at least 4 hours for at least 10% of our list to receive the email. We conduct our own data analysis and insights on the full test; it’s much more valuable for that 10% of our list to receive the email at the same time as everyone else.