Email Marketing

chrlee
Inbound Professor
Inbound Professor

What’s an A/B test you’ve performed that surprised you and why?

Tell us about an A/B test you've conducted in email marketing. Give us some context about your company and industry, then tell us about the parameters of your experiment. What were the results and why did they surprise you?

232 Replies 232
rajdeepak07
Member

What’s an A/B test you’ve performed that surprised you and why?

I have performed A/B email testing and what I get is the best outcomes in each source of email while advertising and marketing. 

 

I get better conversion rates in alternative mail.

The open and click rate increased drastically.

Aslo I tasted at certain social media ad campaign.

inbound classes.

 

It works great for analyzing the context in email and gives a better understanding where our email exists. 

 

0 Upvotes
Enochbabs01
Participant

What’s an A/B test you’ve performed that surprised you and why?

I once performed an A/B test on an email marketing campaign where we tested two different subject lines. Version A had a straightforward, descriptive subject line, while Version B used a catchy, curiosity-inducing subject line. Surprisingly, Version A significantly outperformed Version B, with a 25% higher open rate. This taught us that our audience preferred clarity and directness over playful ambiguity, which was contrary to our initial assumptions.
Srush
Member

What’s an A/B test you’ve performed that surprised you and why?

One A/B test in email marketing involved changing the subject line format from question-based to benefit-driven. Surprisingly, the benefit-driven subject line increased open rates by 20%. It was unexpected because we assumed the question format would evoke curiosity, but the benefit-driven approach resonated better with our audience's needs.

CMorris602
Member

What’s an A/B test you’ve performed that surprised you and why?

I've run A/B tests on preview/prehader text. The overall goal is to increase clicks through to the blog articles featured in the email, and by describing the blog content in the preview text (we had a static subject lin) we were able to increase clicks to the blogs themselves. I used to be surprised when a plain language description of the blog article and the benefit it held for the reader won out over a 'clever' turn of phrase. With years of experience, and the information in this course about copywriting, I now understand why plain, benefit rich language works better than something that was 'fun' to write. 

0 Upvotes
AAli71
Participant

What’s an A/B test you’ve performed that surprised you and why?

Subject Line A/B Test:

 

- Variant A: "Exclusive Offer Inside!"

- Variant B: "Your Exclusive Offer Awaits"

 

Result: Variant B surprisingly outperformed Variant A by 15% in open rates, despite being less promotional. This showed that our audience responded better to a more personalized and subtle approach, rather than a loud and explicit one. This insight has since influenced our email marketing strategy.

Roshankoshy007
Member

What’s an A/B test you’ve performed that surprised you and why?

In a surprising A/B test, a subject line emphasizing exclusivity ("Unlock Exclusive Access") outperformed one directly mentioning the product ("Introducing Our Latest Innovation"). It showed the importance of tapping into emotions and creating a sense of urgency, leading to improved email engagement and conversion rates.

bbonn
Member

What’s an A/B test you’ve performed that surprised you and why?

better performance from a plane text

0 Upvotes
Jna37
Member

What’s an A/B test you’ve performed that surprised you and why?

We've conducted an email with no picture, just plain text and the other email contains a picture. It is in the e-commerce industry and we're launching a new kind of product of footwear. The email with the picture has higher click-through rates.

MVayani
Member

What’s an A/B test you’ve performed that surprised you and why?

I did an A/B testing for subject lines and to my surprise the subject line cotaining 2 words and an emoji worked better than a longer subject line with no emoji

JanelleK
Member

What’s an A/B test you’ve performed that surprised you and why?

I would love to do some A/B testing for a client to see if we can improve attendance at a future events. We also have multiple clients internationally and I would like to do some testing around send times and see if we have the correct data to segment that part of our audience properly.

BHall63
Participant

What’s an A/B test you’ve performed that surprised you and why?

I tested the CtA by hyperlinking to a form, or no link but asking the reader to reply instead.
I only got clicks on the hyperlinked version. 

0 Upvotes
ClaroIII
Member

What’s an A/B test you’ve performed that surprised you and why?

We did A/B testing for subject lines to find out if there's a better line that what we are currently using. Basically our go to subject line versus new ideas, this way we can find new subject lines instead of using the same winnings lines over and over because it can be go now but after a few months or years it will decline for sure.

0 Upvotes
PMorel8
Member

What’s an A/B test you’ve performed that surprised you and why?

Hi! 

I haven't performed an A/B test, but I am looking forward to it. I would try it just to see how helpful it can be.

0 Upvotes
Saqui
Member

What’s an A/B test you’ve performed that surprised you and why?

Tested two sets of different content types in social media: one is purely for our brand's content and the other set contains conversations that jump on what's new and hot in social media (aka trending topics).

We went on purely Australian real estate for one week and then the following week, on top of the said content, we also joined the hashtag campaigns like #throwbackthursday etc.

 

Surprisingly, the real estate content performed way better than the hashtag campaigns. This means that while we are still in the process of increasing our market reach, whatever subscribers we have are quality.

0 Upvotes
JE3
Member

What’s an A/B test you’ve performed that surprised you and why?

I conducted a A/B test that changed one word on a CTA button between first person and second person, and was surprised that first person performed better.

0 Upvotes
BAworinde
Participant

What’s an A/B test you’ve performed that surprised you and why?

Well, I haven't done an Email A/B test.

 

However, I have performed it twice on my social media posts on LinkedIn and X.

 

In the first post, I changed the headline. And it saw a 50% increase. I got an extra 50 likes and generated leads.

 

In the second post, I changed the content length. I made it short and more engaging. It also performed well. 

 

I remain a big supporter of A/B testing both for emails and even other social media platforms. 

NMeskel
Member

What’s an A/B test you’ve performed that surprised you and why?

Hello, I have used A/B testing in my social media class where we tested certain ad campaigns. 

0 Upvotes
DNanda
Member

What’s an A/B test you’ve performed that surprised you and why?

Hi Everyone,

Daisy this side,ya I have learned and performed A/B testing during my inbound classes.

It works great for analyzing the context in email and gives a better understanding where our email exists. 

0 Upvotes
Irtazat
Member

What’s an A/B test you’ve performed that surprised you and why?

Currently, working as a freelance resume writer, promoting my service through social media, and hoping to progress more.

Although haven't performed, but subject lines and content length intrigue me to try.

JeannetteG
Participant

What’s an A/B test you’ve performed that surprised you and why?

I have not performed an A/B test yet. 

0 Upvotes