Contacts for A/B testing

ADoremi — Mon, 02 Oct 2023 19:21:52 GMT

Hello!

I am new here in HubSPot. Are we creating a lists of grpup from our original contacts? If yes, how many contacts for each group that we need to have?

Appreciate the answer.

Thank you

Re: Contacts for A/B testing

DianaGomez — Mon, 02 Oct 2023 19:50:31 GMT

Hi @ADoremi,

Thanks for reaching out to the Community!

It sounds like you are trying to send an A/B test email.

I wanted to share a few valuable resources that could be helpful.

I also wanted to invite our subject matter experts to this conversation.

Hi @Lucila-Andimol, @Gilempert, @JuanGomez0818 Do you have any advice for @ADoremi?

Thank you!

Best,

Diana

Re: Contacts for A/B testing

karstenkoehler — Tue, 03 Oct 2023 04:33:43 GMT

Hi @ADoremi,

Do you want to run an A/B test in HubSpot or do you want to create random lists for other purposes?

To create random samples of your contacts, you could follow these steps if you're on a Professional or Enterprise subscription: https://knowledge.hubspot.com/lists/create-a-sample-from-a-list

Without this feature, the best way to create random lists is to export your contacts, open Excel and add a new column with a random number for each contact (e.g. between 1 and 100), then re-import the contacts with the number and create a list A where the random number is 1-50 and another where it's 51-100, for example.

These lists you could use to test whatever you'd like that's not listed below. Regarding your question of how big each list should be: it should be big enough for your results to be likely statistically significant. https://www.surveymonkey.com/mp/ab-testing-significance-calculator/

For example, with two lists of 100 contacts and a small number of conversions, you're not going to get a statistically significant result:

You can use the calculator linked above to play around and test beforehand whether you're numbers are even in the range of getting statistically significant results.

Some HubSpot tools have A/B testing built in. You can find them here:

Hope this helps! If you have more context to share, I'm happy to elaborate.

topic Re: Contacts for A/B testing in Tips, Tricks & Best Practices

Contacts for A/B testing

Re: Contacts for A/B testing

Re: Contacts for A/B testing