What’s an A/B test you’ve performed that surprised you and why?

chrlee
HubSpot Employee
HubSpot Employee

Tell us about an A/B test you've conducted in email marketing. Give us some context about your company and industry, then tell us about the parameters of your experiment. What were the results and why did they surprise you?

557 Replies 557
SirDavid
Participant

I'm Super excited about A/B testing to compare which works better in subsequent subject lines i will be using in emails.

0 Upvotes
DChiquillo
Member

I sell children's clothing. I want to test CTA to see which generates more conversion. I also want to test CTA through different type of images in emails.  

0 Upvotes
OTkhorik
Member

I have yet to perform an A/B test but I am excited to try. 

0 Upvotes
TNguyen79
Member

One A/B test that surprised me was around subject line personalization in email campaigns

0 Upvotes
ATho22
Member

Sometimes I have been surprised with the amount of response on something as simple as a link. And on the contrary, how much someone avoids clicking on a link. 

0 Upvotes
LorraineB
Participant

We are only at the beginning stages of our email campaign but I can't wait to try this out

0 Upvotes
PMilenković
Member

Performed A/B testing on Facebook Ads, Instagram, and some on Youtube. I can't wait to apply this knowledge to email marketing!

0 Upvotes
BScarbeary
Member

YouTube Thumbnails. 

0 Upvotes
PAlade
Member

I haven't tried A/B testing before but I honestly can't wait to try.

0 Upvotes
Pragya_kujur_25
Member

I am a student. I am open to experiences of A/B testing but haven't got the chance yet.

PKr3
Member

I haven't tested one.

0 Upvotes
Absovi
Member

I have tried A/B testing on CTA's and content pattern to see the better results.

EIschiu-Gutie
Member

I am currently a marketer for a physical therapy clinic. We are soon to open a new clinic and are formulating 2 emails that are slightly different to conduct A/B testing, such testing as not yet been conducted yet.

HHill13
Member

In a recent A/B test at my company, which operates in the hospitality industry, we experimented with two different subject lines for our email campaigns. One subject line was personalized with the recipient's name, while the other was more generic. We expected the personalized version to perform better, as personalization typically increases open rates. However, to our surprise, the generic subject line had a significantly higher open rate. After analyzing the results, we realized that the more direct and intriguing tone of the generic line resonated more with our audience, who preferred a straightforward approach over personalized messaging

SNM
Member

We have tried A/B testing on CTA's and content pattern to see the better results.

0 Upvotes
aladya
Member

I haven't done one yet but knowing that my target audience is gen-z I probably have to make it as short as possible.

0 Upvotes
CHilliard0
Member

I haven't done one yet, but I plan to use HubSpot to do it. 

0 Upvotes
RudroDipta
Member

Not yet. But want to execute it with hubspot

 

0 Upvotes
VMilf
Member

An A/B test I performed was on testing subject lines: one was framed as a question, and the other was not. It was surprising both gave the same open rates, despite advice that a subject line in the form of a question would perform better.

0 Upvotes
jb20
Member

For my Substack newsletter, an email writing platform for writers, I A/B tested the best days and times to schedule an email to reach my audience. I initially would post after I finished writing. After looking at analytics and time zones, I found that the best days were Wednesdays and Fridays in the evenings. 

 

My experience with A/B testing comes from using other platforms for running ads, testing YouTube titles and thumbnails, and my Substack newsletter.

 

I have yet to use an email marketing tool for my main website. My online business focuses on providing self-development and personal finance content to singles. 

0 Upvotes
Crysis007
Member

Trying to work towards my 1st campaign.

0 Upvotes