# How would you go about conducting an email experiment?

**URL:** <https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513>\
**Category:** Study Group: Email Marketing\
**Created:** [July 11, 2021, 8:29pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513 "2021-07-11T20:29:21Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Justin\_Champion](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/justin_champion/32/55518_2.png) [@Justin\_Champion](https://community.hubspot.com/u/Justin_Champion)\
**Post date:** [July 11, 2021, 8:29pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/1 "2021-07-11T20:29:21Z")

</div>

Consider this: Your manager asks you to improve the click-through rate of your monthly newsletter. How would you go about conducting an experiment? What would you be looking to improve (and why)?

_\*To learn more about this, check out the [Testing Your Marketing Emails](https://hubs.la/H0V8vDH0) lesson via HubSpot Academy._

---

<div class="post-metadata">

**Author:** ![evalopez](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/evalopez/32/22074_2.png) [@evalopez](https://community.hubspot.com/u/evalopez)\
**Post date:** [July 12, 2021, 8:48pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/2 "2021-07-12T20:48:47Z")

</div>

I would create 2 seperate sets of emails. I would change the headline to sample A and for sample B I would change the body but keep the headline to try and see if there’s a difference in the way it is being received.

---

<div class="post-metadata">

**Author:** ![TMustapha](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/tmustapha/32/31639_2.png) [@TMustapha](https://community.hubspot.com/u/TMustapha)\
**Post date:** [July 13, 2021, 9:28am UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/3 "2021-07-13T09:28:05Z")

</div>

I will use A/B testing

---

<div class="post-metadata">

**Author:** ![WafiKhalil](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/wafikhalil/32/3609_2.png) [@WafiKhalil](https://community.hubspot.com/u/WafiKhalil)\
**Post date:** [July 13, 2021, 1:38pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/4 "2021-07-13T13:38:45Z")

</div>

Sure will make an A/B testing, and improve the Boby Copy, Body design, Body image, Email CTA, and Email signature

to see the differences and look at tyhe confidence level

---

<div class="post-metadata">

**Author:** ![KReyes](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/kreyes/32/31851_2.png) [@KReyes](https://community.hubspot.com/u/KReyes)\
**Post date:** [July 14, 2021, 1:51am UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/5 "2021-07-14T01:51:23Z")

</div>

I will use A/B testing.

---

<div class="post-metadata">

**Author:** ![jcorona64](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/jcorona64/32/82448_2.png) [@jcorona64](https://community.hubspot.com/u/jcorona64)\
**Post date:** [July 15, 2021, 9:32pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/6 "2021-07-15T21:32:45Z")

</div>

The email’s body copy, design, images, CTA and signature. Perhaps the content is not resinating with our customers. A/B testing between two different emails should give me the results I need to improve the monthly news letter.

---

<div class="post-metadata">

**Author:** ![Tlambert13](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/tlambert13/32/86357_2.png) [@Tlambert13](https://community.hubspot.com/u/Tlambert13)\
**Post date:** [July 15, 2021, 11:35pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/7 "2021-07-15T23:35:00Z")

</div>

A/B testing

---

<div class="post-metadata">

**Author:** ![SAMUEL6](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/samuel6/32/78471_2.png) [@SAMUEL6](https://community.hubspot.com/u/SAMUEL6)\
**Post date:** [July 17, 2021, 4:06am UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/8 "2021-07-17T04:06:39Z")

</div>

Test.

---

<div class="post-metadata">

**Author:** ![LAkers](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/lakers/32/99678_2.png) [@LAkers](https://community.hubspot.com/u/LAkers)\
**Post date:** [July 19, 2021, 12:55pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/9 "2021-07-19T12:55:21Z")

</div>

I would use A/B testing. Changing subject lines, body content and CTA on 2 different version emails to test which one had the higher CTR.

---

<div class="post-metadata">

**Author:** ![AMcIntyre](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/amcintyre/32/48852_2.png) [@AMcIntyre](https://community.hubspot.com/u/AMcIntyre)\
**Post date:** [July 19, 2021, 2:33pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/10 "2021-07-19T14:33:03Z")

</div>

Test subject lines, header copy, placement of CTA buttons, time and date of email send

---

<div class="post-metadata">

**Author:** ![system](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/system/32/124_2.png) [@system](https://community.hubspot.com/u/system)\
**Post date:** [July 20, 2021, 10:17pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/11 "2021-07-20T22:17:56Z")

</div>

I would have a specific purpose for why I am testing and what I hope to get out of it. Next, I would design the test. I would test for elements for click rates by focusing on one goal at a time.

---

<div class="post-metadata">

**Author:** ![Rebecca10](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/rebecca10/32/41549_2.png) [@Rebecca10](https://community.hubspot.com/u/Rebecca10)\
**Post date:** [July 21, 2021, 9:55pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/12 "2021-07-21T21:55:56Z")

</div>

To address anemic open rates, test the subject line (as a start). Create 2 emails with different subject lines but all other elements the same. Deploy and analyze results. If the test results are statisically significant, and one population has better open rates than the other, use it to inform subject line best practices in the future.

---

<div class="post-metadata">

**Author:** ![CCrisler](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/ccrisler/32/95715_2.png) [@CCrisler](https://community.hubspot.com/u/CCrisler)\
**Post date:** [July 22, 2021, 12:32am UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/13 "2021-07-22T00:32:32Z")

</div>

I would use A/B testing

---

<div class="post-metadata">

**Author:** ![GNecastro](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/gnecastro/32/95715_2.png) [@GNecastro](https://community.hubspot.com/u/GNecastro)\
**Post date:** [July 22, 2021, 2:05pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/14 "2021-07-22T14:05:56Z")

</div>

I would create a new edition of the email and send that to half of my clients while the other half received the original.

---

<div class="post-metadata">

**Author:** ![StephC](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/stephc/32/58551_2.png) [@StephC](https://community.hubspot.com/u/StephC)\
**Post date:** [July 22, 2021, 2:58pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/15 "2021-07-22T14:58:15Z")

</div>

Use A/B testing- which I now totally get, thanks Courtney!

---

<div class="post-metadata">

**Author:** ![abhijeetgaurav5](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/abhijeetgaurav5/32/87988_2.png) [@abhijeetgaurav5](https://community.hubspot.com/u/abhijeetgaurav5)\
**Post date:** [July 23, 2021, 3:41am UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/16 "2021-07-23T03:41:35Z")

</div>

I would have a specific purpose for why I am testing and what I hope to get out of it. Next, I would design the test. I would test for elements for click rates by focusing on one goal at a time.

---

<div class="post-metadata">

**Author:** ![JUpton](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/jupton/32/78108_2.png) [@JUpton](https://community.hubspot.com/u/JUpton)\
**Post date:** [July 23, 2021, 3:39pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/17 "2021-07-23T15:39:08Z")

</div>

We need to understand what is causing the click-through rate to remain at unsatisfactory levels. This would require multiple tests with each requiring different versions. By the end of the test period (say two quarters), we need to know if it’s the copy, the visual design, the images used, the call to action, the email signature, or a combination of these elements that requires improvement. Each test would need at least two versions, so this whole batch of testing needs at least 10 emails to be sent out, and for the open rate to be monitored to make sure you weren’t sending out too many in a short space of time. More emails might be required, but by the end of the intitial test period, it’s hoped you should have at least some idea of what might need further testing or further work.

---

<div class="post-metadata">

**Author:** ![Jainfinity](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/jainfinity/32/5125_2.png) [@Jainfinity](https://community.hubspot.com/u/Jainfinity)\
**Post date:** [July 23, 2021, 5:30pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/18 "2021-07-23T17:30:04Z")

</div>

I will be A/B testing with version A as traditional approach

- Heading will be same
- Body of version B will include some bold and italic words
- body text will be more in version B
- CTA will be changing.

---

<div class="post-metadata">

**Author:** ![LMcLean](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/lmclean/32/99782_2.png) [@LMcLean](https://community.hubspot.com/u/LMcLean)\
**Post date:** [July 23, 2021, 5:34pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/19 "2021-07-23T17:34:03Z")

</div>

Using A/B testing, I would create 2 versions of the newsletter with different subject line and preview text. Since the newsletter is monthly, I would test over a 2-3 month period to analyze the click-through rates with the intent to improve contact engagement levels.

---

<div class="post-metadata">

**Author:** ![nmonroe](https://d10pqhm3lwygmk.cloudfront.net/user_avatar/community.hubspot.com/nmonroe/32/43872_2.png) [@nmonroe](https://community.hubspot.com/u/nmonroe)\
**Post date:** [July 23, 2021, 9:08pm UTC](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513/20 "2021-07-23T21:08:55Z")

</div>

a/b testing would be great with handling this situation because I would have a purpose in creatingthe test and an idea on how to design it.

[Next page](https://community.hubspot.com/t/how-would-you-go-about-conducting-an-email-experiment/40513.md?page=2)
