Enable A/B testing in workflow/automated emails

I was disappointed to see that I can't do an A/B test in an automated email:

https://knowledge.hubspot.com/articles/kcs_article/email/how-to-create-an-a-b-test-email

 

Marketo (a HubSpot competitor) allows this functionality.

Can you add this to the product sometime?

It's particularly helpful with a Welcome email sequence which is key to on-boarding new customers.

HubSpot updates
Feb 14, 2020

Hi all! Two quick updates for you on this:

 

Number 1: Progress is going well, we have our new A/B framework in good shape and at the moment we're focusing on the new in-app features needed to begin/end and analyse this new type of A/B test for workflow emails. This is a big update on what is currently available for batch emails, and will give you the ability to end an A/B test and start a new one on the same email without needing to rebuild the email over and over again. Getting very close now! 

 

Number 2: Moving forward this feature, the updates on it's release and all feedback will be handled by my colleague @jaleonard19. Jake is also a PM here working on our marketing email tools and has actually been the one spearheadding this feature for some time now so you'll be in great hands. 

 

Jake is currently working on our release plans and will be sharing a public beta signup form with you all as soon as it's ready. Thank you all again for your feedback and suggestions. Looking forward to seeing the impact this will have for you all.

Dec 19, 2019

Will do @petersherlock93

Dec 11, 2019

Will do @EJVFernyhough ! We'll be sharing a beta sign up form with everyone on this post when it's available so everyone will have the opportunity to sign up once it's open.

Dec 11, 2019

@AJernigan can do Smiley Happy

Nov 18, 2019

Hi @ridingforlife I can definitely share more. At the moment we're making good progress but factoring in the upcoming US and EU holiday season it's unlikely that we'll be hitting beta-ready in Q4 but safe to say that we'll have a beta in Q1 2020. As soon as we have an open beta we'll offer it up to everyone in this thread to give it a try. 

Nov 4, 2019

Hi all, just to keep everyone updated on our progress here, we've been making decent headway with the infrastructure planning and development roadmap for this feature and are making meaningful progress towards a beta.

 

There's still a lot of moving pieces here so we don't have a concrete date on when we'll be opening up a beta but I wanted to keep you all in the loop and confirm that we're definitely focused on this and are actively working on it.

Aug 14, 2019

Thanks @petersherlock93! Just a case of good ol' miscommunication Smiley Happy  The "on pause" here just means that we were still deep into the infrastructure and reliability work needed for this (and other) functionality. It was by no means deprioritised or taken off the roadmap, just needed to get the ordering right on the priorities to make sure we didn't put the cart in front of the horse, so to speak.

Aug 13, 2019

Hi @petersherlock93  (and all following along). I can confirm that this isn't the case, A/B testing of automated emails is still very much a priority for us.

 

For the past few months we have been focused primarily on work on the underlying infrastructure of email, to ensure speed, stability and reliability of the overall platform and user experience. We're nearing the end of this work right now which enables us to continue to build on top of the email tool and makes it possible for us to build more net-new functionality in a stable and scalable way, A/B testing of automated emails being a great example of that. 

 

While there hasn't been much news on this specific feature lately, it's something that is very high on our roadmap and now that we're seeing results from our infrastructure and performance work we're able to refocus our efforts on bringing these new features to the product. Rest assured that it's still something we're focused on. 

 

While we aren't yet at the stage of a beta for this feature, I'd recommend checking out these resources (one and two) from the HubSpot blog that provide interim solutions and as soon as we have a beta that's available for everyone I'll share a signup form for everyone here to try out. Thanks again for your feedback and for keeping the momentum going here. 

changed to: In Planning
Jan 29, 2019

Hi all, I wanted to share a quick status update with you on this. We've spent some time researching options for this feature and are making good progress. We'll soon be heading into a dedicated research phase and as we get close to a beta of this we'll open it up to everyone on this post to get early access. Please do keep your feedbac/upvotes coming, we really appreciate it.

Nov 16, 2018

Thank you all for sharing your feedback and use cases on this. The product team is currently thinking about how to solve this, and will post updates here. 

Apr 6, 2017

A/B testing an entire workflow to see what places could be improved to improve conversion rates.

220 Replies
New Contributor

I just spent several days creating an A/B testing plan under the assumption that you would be able to test automated emails just to find out that it's not possible. It's very disappointing. How is this not a feature? 

New Contributor

Ah, I just submitted a support ticket but seems this might be the answer. It does not make sense to me this is not possible?

 

Is there a logical explaination from HubSpot as to why?

 

Only solution is to A / B test the entire workflow? Not ideal... 

 

 

Occasional Contributor

Yea, it's crazy that you can't do this. The reasonings I've heard make little to no sense. It really isn't an option for many who are doing workflow based emails to send 1 offs as tests. The other workarounds are equally impracticle (ex: setting up separate workflows and trying to split enrollment between the 2).

Occasional Contributor

This feature would be extremely valuable for our team! Can someone from HubSpot respond and let us know if this is in the works or planned for a 2018 release?

Occasional Contributor

Bump on this

Occasional Contributor

For what it is worth, I was told by my account rep that development-wise it is the kind of thing that won't likely be addressed till 2019. Smiley Sad

Occasional Contributor

Yeah, this has been said already but I just assumed this was a function and created my first workflow happily and then found out it wasn't.  Hubspot Academy spends a lot of time talking about automation and experimenting and testing for these things not to be possible together. Disappointing for sure. 

New Contributor

+1. I just started with worfklows, and am quite surprised to see that this feature is missing. It seems like a critical feature to me. Hopefully it will be addressed soon.

New Contributor

Yes, please.  Make this possible!

Regular Contributor

Would be great to know where is this feature in the development roadmap, as our business is growing and we need to have these kind of A/B tests inn our CRM.

Occasional Contributor

How can it be that Hubspot doesn't have this super basic feature? 
Does anyone have any workaround for this?

Visitor

 This feature is absolutely paramount! Workflows allow us to communicate with customers at a precise moment in their journey, and we need to be able to test these communications via AB testing. Without this capability, Workflows completely lose their value to our business. 

Occasional Contributor

I've been waiting for this feature for 3 years...

New Contributor

Hubspot, people asked for this must have feature for more than a year ! And it's still not there... SHAME ON YOU !

 shame embarassed GIF-downsized.gif

Regular Contributor | Platinum Partner
Regular Contributor | Platinum Partner

 Come on guys... let built that feature! Please!?

Occasional Contributor

Need this desperately. Are you working on this? I can see it has a ton of upvotes.

New Contributor

In complete agreement that getting A/B testing to function within workflows is 100% necessary. The idea of adding multiple manual steps in order to use optimized content/messaging in each workflow multiplied by the number of workflows is mind-boggling.

Top Contributor

Over 100 votes and still not in planning? Really surprised. This will up our marketing email game if available. Please add!

New Contributor

I signed up to this community just to upvote this idea.

 

Please Hubspot, listen to your customers! ! !

 

This is amongst the top 12 idea in Hubspot community as of June 19 2018 and has been requested for over a year now.

 

 

Regular Contributor

Yes this would make our lives much much easier. all i want to do is A/B test subject lines, for goodness sake...