What’s an A/B test you’ve performed that surprised you and why?

[chrlee]

Tell us about an A/B test you've conducted in email marketing. Give us some context about your company and industry, then tell us about the parameters of your experiment. What were the results and why did they surprise you?

[KKrejberg]

I have yet to try an A/B test but I will take note for the day I do.  

[SirDavid]

I'm Super excited about A/B testing to compare which works better in subsequent subject lines i will be using in emails.

[DChiquillo]

I sell children's clothing. I want to test CTA to see which generates more conversion. I also want to test CTA through different type of images in emails.  

[OTkhorik]

I have yet to perform an A/B test but I am excited to try. 

[TNguyen79]

One A/B test that surprised me was around subject line personalization in email campaigns

[ATho22]

Sometimes I have been surprised with the amount of response on something as simple as a link. And on the contrary, how much someone avoids clicking on a link. 

[LorraineB]

We are only at the beginning stages of our email campaign but I can't wait to try this out

[PMilenković]

Performed A/B testing on Facebook Ads, Instagram, and some on Youtube. I can't wait to apply this knowledge to email marketing!

[BScarbeary]

YouTube Thumbnails. 

[PAlade]

I haven't tried A/B testing before but I honestly can't wait to try.

[Pragya_kujur_25]

I am a student. I am open to experiences of A/B testing but haven't got the chance yet.

[PKr3]

I haven't tested one.

[Absovi]

I have tried A/B testing on CTA's and content pattern to see the better results.

[EIschiu-Gutie]

I am currently a marketer for a physical therapy clinic. We are soon to open a new clinic and are formulating 2 emails that are slightly different to conduct A/B testing, such testing as not yet been conducted yet.

[HHill13]

In a recent A/B test at my company, which operates in the hospitality industry, we experimented with two different subject lines for our email campaigns. One subject line was personalized with the recipient's name, while the other was more generic. We expected the personalized version to perform better, as personalization typically increases open rates. However, to our surprise, the generic subject line had a significantly higher open rate. After analyzing the results, we realized that the more direct and intriguing tone of the generic line resonated more with our audience, who preferred a straightforward approach over personalized messaging

[SNM]

We have tried A/B testing on CTA's and content pattern to see the better results.

[aladya]

I haven't done one yet but knowing that my target audience is gen-z I probably have to make it as short as possible.

[CHilliard0]

I haven't done one yet, but I plan to use HubSpot to do it. 

[RudroDipta]

Not yet. But want to execute it with hubspot

[VMilf]

An A/B test I performed was on testing subject lines: one was framed as a question, and the other was not. It was surprising both gave the same open rates, despite advice that a subject line in the form of a question would perform better.

[jb20]

For my Substack newsletter, an email writing platform for writers, I A/B tested the best days and times to schedule an email to reach my audience. I initially would post after I finished writing. After looking at analytics and time zones, I found that the best days were Wednesdays and Fridays in the evenings. 

My experience with A/B testing comes from using other platforms for running ads, testing YouTube titles and thumbnails, and my Substack newsletter.

I have yet to use an email marketing tool for my main website. My online business focuses on providing self-development and personal finance content to singles.