I recently ran an email A/B test on two different subject lines. Despite version B having over a 2% higher open rate, that was deemed statisically insignificant and version A was sent by default. From my perspective, a 2% difference in open rate is far from insignificant. So, I would like to either see more clarity into how a winner is determined by the system (which I have not been able to locate, even after speaking with support), as well as the ability to manually select a winner on A/B tests like this. I have used this functionality in other marketing automation platforms previously, and found it extremely beneficial. In that scenario, HubSpot would notify the user who set up the A/B test when the test has completed, and potentially present HubSpot's suggested 'winner'. The user would then be able to either approve HubSpot's suggestion or select the winner themselves.
... Exibir mais