How to A/B test within a Workflow (workaround with guide video)

[fiachra_duffy]

A/B Testing is now in Beta

Reach out to your Customer Success Manager and ask to be enrolled - no need for complicated workarounds anymore! 🙌

Here is a short video walking you through the steps to setup A/B testing in any of your workflows. 

This method ensures completely random assignment of contacts between two groups.

You can use this to determine which step is more effective and then implement it fully. 

***Please UPVOTE if you found this useful*** 😀 👍

This is a workaround so please upvote the idea here too.

Here is a useful guide on A/B testing in general.

• How to Do A/B Testing: A Checklist You'll Want to Bookmark

EDIT:
I've gotten some questions around which users to assign to the A/B Team so here are my ideas:

• If you have any generic email addresses that aren't being used in the HubSpot portal (hello@, info@ etc...)
• If there are any staff that don't have HubSpot profiles and would be okay helping set this up for you
• Using a personal email address
• If you use Gmail, you can create an alias using a + 
  • Copy the link HubSpot emails to you to setup the new profile and open it in Incognito to create a new HubSpot user

Remember to run all of these past your Security or IT Admin teams before implementing!

***Please UPVOTE if you found this useful*** 😀 👍

[wZuzjDS]

The best information is that there's an replace at the real functionality entering into testing, so no want for workarounds

[Mike_Donnelly]

Hey @fiachra_duffy - I know this solution is a bit aged, but very creative.  I also know HubSpot has allowed 50/50 split in an email with workflows, but for more advanced capabilities, we built a split test automation tool that any HubSpot Marketing Pro / Enterprise user can install and it automates the ability to a/b or multi-variate test.  We're in the process of getting it listed in the HubSpot App Marketplace, but here's a link to a page where you can check it out / install it.  https://www.theseventhsense.com/split-test-automation

[karstenkoehler]

Good news everyone, this is now a feature (in beta)! https://knowledge.hubspot.com/workflows/automate-ab-emails-with-workflows

For access, you'd reach out to your account manager / customer success manager at HubSpot.

(Still love your workaround, @fiachra_duffy.)

[Mike_Donnelly]

Hey @karstenkoehler - We had some advanced needs to split and multi-variate test, so for anyone interested, we created a workflow tool called split test automation.  It's a free tool for anyone using HubSpot workflows (Pro and Enterprise).  It's in the final review process to be listed on the HubSpot App Marketplace, however, if you'd like to check it out / install it, here's a link to do so.  https://www.theseventhsense.com/split-test-automation

[Mariontex]

Thanks @fiachra_duffy this is very useful!

[fiachra_duffy]

@JRay9  the new Beta currently only allows for 50:50 testing. Once you select a winner, that becomes the default. 

You could in theory try my method to achieve a different split, but I would advise against this and instead ask your Customer Success Manager to be enrolled on the beta. More features will follow, don't worry!

[JRay9]

Ah thanks for letting know. I will wait until Hubspot adds an option.

[JRay9]

Hi! 

I would like to run a 50-50 split test on my target list to analyze the performance of a content asset... can I achieve the 50-50 split in A/B test instead of the pre-determined 80-20 test?

Thanks!

[inscopixdev]

Hi @fiachra_duffy 
I have a workflow like Fill out conatct form submission  on any page. Nect action have if then where create three branch of cotact propery if the value 1,2,3. For 1 = Sending an email and 2,3 also having different email.

How I can Do A/B testing on this workflow

[fiachra_duffy]

@inscopixdev 

If the property value 1, 2 & 3 are randomly assigned then you are already A/B/C testing your emails!

If you are able to rotate hubspot user as a Workflow Action, then you can A/B test any one of the branches.

Rather than sending the email as the next step, add another If/Then branch based off the randomly assigned property. 

So you can A/B test on any branch or all branches. 

Best to check with your Customer Success Team for help walking through it! 🙂 

[Aelia]

Hi,

Alright so I tried following the video step-by-step, and I got this:

Sadly, I can't use the rotate contacts feature because I don't have Sales Professional, I'm on Marketing Professional. :'(

[fiachra_duffy]

@Aelia 

I went to check and it turns out that rotating among users requires either Sales Hub Pro, or a Marketing Hub that was set up before 2018 – apologies, I didn't realise this feature was rolled into Sales Hub exclusively.

However – the good news is that there's an update on the actual functionality moving into testing, so no need for workarounds! 

Update here

[GF20]

This is a great resource! Thanks very much @fiachra_duffy 

[Drishtii]

Very useful @fiachra_duffy !

Will use this until the Hubspot tech team launches an A/B test feature 🙂

[Aelia]

Hi,

Can you clear out a confusion for me?

This workflow is based on lead owners. 

I have a lead assignment already in place that assigns demo/trial leads immediately to sales, who are HubSpot users as well.  

Is this going to be a problem if I use this method? If so, what else can I work with?

[fiachra_duffy]

Hi Aeila, 

So you definitely don't want to unassign your sales team from new leads! 🙂 

If you go to 1 min 45 in the video, you'll see where I create a new Contact Property called A/B Divider.

This is a HubSpot User property.

This allows you to keep your Lead Owner property comletely seperate from the A/B testing process.

You can use the A/B Divider property to assign another HubSpot user to the contact. 

That way, your sales team can keep the exact same process that runs on the Lead Owner property and you can run A/B tests using the A/B Divider property. 

If you get stuck, your Customer Success Team will be able to show you through this in more detail. 

Hope that helps!

Fiachrá

[Aelia]

Hey Fiachrá,

Sorry I missed your previous post!

I'm still kinda confused, but I'll reach out to my Account Manager and clarify the steps. I will post here in case any one else has the same concerns.

Thank you! 🙂

[fiachra_duffy]

Hi Aelia,

I'm on leave till next Thursday and will post an idea for you then if that's ok? 🙂