I recently ran an email A/B test on two different subject lines. Despite version B having over a 2% higher open rate, that was deemed statisically insignificant and version A was sent by default. From my perspective, a 2% difference in open rate is far from insignificant. So, I would like to either see more clarity into how a winner is determined by the system (which I have not been able to locate, even after speaking with support), as well as the ability to manually select a winner on A/B tests like this. I have used this functionality in other marketing automation platforms previously, and found it extremely beneficial. In that scenario, HubSpot would notify the user who set up the A/B test when the test has completed, and potentially present HubSpot's suggested 'winner'. The user would then be able to either approve HubSpot's suggestion or select the winner themselves.
...その他を表示