What’s an A/B test you’ve performed that surprised you and why?

chrlee
HubSpot Employee
HubSpot Employee

Tell us about an A/B test you've conducted in email marketing. Give us some context about your company and industry, then tell us about the parameters of your experiment. What were the results and why did they surprise you?

557 Replies 557
PMorel8
Member

Hi! 

I haven't performed an A/B test, but I am looking forward to it. I would try it just to see how helpful it can be.

0 Upvotes
Saqui
Member

Tested two sets of different content types in social media: one is purely for our brand's content and the other set contains conversations that jump on what's new and hot in social media (aka trending topics).

We went on purely Australian real estate for one week and then the following week, on top of the said content, we also joined the hashtag campaigns like #throwbackthursday etc.

 

Surprisingly, the real estate content performed way better than the hashtag campaigns. This means that while we are still in the process of increasing our market reach, whatever subscribers we have are quality.

0 Upvotes
JE3
Member

I conducted a A/B test that changed one word on a CTA button between first person and second person, and was surprised that first person performed better.

BAworinde
Participant

Well, I haven't done an Email A/B test.

 

However, I have performed it twice on my social media posts on LinkedIn and X.

 

In the first post, I changed the headline. And it saw a 50% increase. I got an extra 50 likes and generated leads.

 

In the second post, I changed the content length. I made it short and more engaging. It also performed well. 

 

I remain a big supporter of A/B testing both for emails and even other social media platforms. 

NMeskel
Member

Hello, I have used A/B testing in my social media class where we tested certain ad campaigns. 

0 Upvotes
DNanda
Member

Hi Everyone,

Daisy this side,ya I have learned and performed A/B testing during my inbound classes.

It works great for analyzing the context in email and gives a better understanding where our email exists. 

0 Upvotes
Irtazat
Member

Currently, working as a freelance resume writer, promoting my service through social media, and hoping to progress more.

Although haven't performed, but subject lines and content length intrigue me to try.

JeannetteG
Participant

I have not performed an A/B test yet. 

0 Upvotes
Moyemi
Member

i havent

0 Upvotes
MGowen
Member

I haven't preformed A/B testing yet. 

0 Upvotes
mshank28
Member

I have not tried it yet either

0 Upvotes
PSINGH80
Member

I have tried the A/B testing yet.

0 Upvotes
ajmal074
Member

I havenot performed AB testing & still interested in more information

0 Upvotes
EFiati
Participant

Hello, I haven't done email marketing before yet to try out

0 Upvotes
ADeLaTorre9
Member

The huge impact that a simple adjustment in the subjet line (split version) can determine your succes results in the open rate,  CTR and conversions  enhacing the importance to check and explore the results of test A|B that makes a huge difference.

0 Upvotes
SamViquez
Member

Noy h ayudado a cumplir nuestros obejtivos, ya que al poder realizar el email marketing podemos tener mayor acercamiento con nuestros clientes y crear una fidelización y que nos puedan recomendar como marca

0 Upvotes
AkhilB
Member

I'm yet to run one.

0 Upvotes
MNour
Member

One A/B test that surprised me was when we experimented with different email subject lines for a promotional campaign. We tested two variations: one with a straightforward, descriptive subject line highlighting the discount ("Save 20% Today Only!") and another with a more creative and intriguing subject line ("Discover Your Exclusive Offer Inside!"). Surprisingly, the creative subject line outperformed the straightforward one in terms of open rates and click-through rates. This outcome challenged our assumptions about what resonates best with our audience. It taught us the importance of testing different messaging approaches and being open to unexpected results. This experience highlighted the value of data-driven decision-making in email marketing and reinforced the need to continuously test and refine our strategies based on audience preferences and behaviors.

chrlee
HubSpot Employee
HubSpot Employee

This is such a GREAT example! Instictually I would've thought the straight forward one would've gotten more engagement too. Thanks for your very clear and impactful insights as well! 💪 

0 Upvotes
KQuintero1088
Member

I still haven't tried A/B test yet. Excited to learn more and use!

0 Upvotes
VAraveeti
Member

to determine the goal and analyze the results

0 Upvotes