What’s an A/B test you’ve performed that surprised you and why?

[chrlee]

Tell us about an A/B test you've conducted in email marketing. Give us some context about your company and industry, then tell us about the parameters of your experiment. What were the results and why did they surprise you?

[ESledge]

The most surprising A/B test I've performed was due to the use of less text and more labelled images, sent at a later time in the evening. Perhaps suggesting the readers wanted less readable content later at night, and more visuals - images/videos.

[Jasim1]

great

[KMoffa]

I had seen an article suggesting using all lowercase letters in a subject line and thought it was silly. I ended up doing an AB test for proper punctuation vs all lowercase in the SL and to my surprise, the all lowercase SL had a significantly higher open rate.

[Docdondacc]

not yet but Excited to work on one 

[Adler100]

Excited to work on one 

[ericanickerson]

The most interesting A/B test I've ran recently has actually been around time sends not content. We have been using smart sending times (times that are when people are most engaged with opening email) to help target the best times for us to send emails. 

[sabhrant]

i have just completed my course, and thrilled to perform one.

[TOgijo]

 I am currently in the learning phase and have not yet conducted an A/B test, but I hope to do so in the near future.

[REli-Morris]

As a learning and development company, we wanted to see if  click through rates could be improved by using buttons or images for links to case studies.  We found that the sample groups preferred clicking meaningful text links which provided more of a context.

[MSharma420]

I am tet to perform one, as I am in my learning phase. 

[MAmmar29]

I am yet to perform one.

[galazyman]

What’s an A/B test you’ve performed that surprised you and why?

I am yet to perform one! 

[LSithole]

I haven't performed an A/B testing before.

[LukeB5G]

I split tested 2 subject lines. One was "Therapy Product Sale Ending soon" and the other was "Final hours for discounted therapy products". I expected the 2nd one to perform better since I didn't capitalize every first letter in the title and because it mentioned the word "discounted" instead of sale. I was completely wrong. The first title performed much better with almost double the amount of opens and clicks.

[PUzowuru]

I have not perform A/B test before

[kp6]

I had performed an A/B test when i wanted my friends to buy a product from me, self made products actually and they chose the one version A because i had written some quotes on them and didn't choose version B because it was plain yet attractive.

[bopoto]

i have not performed an A/B test before

[ACarpenter8]

One that I did in the past was changing how pricing for airline tickets was displayed. Version A had the lowerst price listed first in a left to right line up. Version B had the highest price listed first in a left to right line up. Although most people still bought the lowest price, we did see a significant uptick in higher booking values off Verision B.

[L---Bryce]

Cool find!

[AMondragon22]

This isn't an A/B test in marketing; rather, as a BPO QA, I implemented two different coaching and training approaches for two groups of agents. After a week, I evaluated their progress to identify the most effective methods for coaching and training.

[Qqbariha]

This isn't an A/B test in marketing; rather, as a BPO QA, I implemented two different coaching and training approaches for two groups of agents. After a week, I evaluated their progress to identify the most effective methods for coaching and training.