How would you go about conducting an email experiment?

Champion
HubSpot Employee
HubSpot Employee

Consider this: Your manager asks you to improve the click-through rate of your monthly newsletter. How would you go about conducting an experiment? What would you be looking to improve (and why)?

 

*To learn more about this, check out the Testing Your Marketing Emails lesson via HubSpot Academy. 

367 Replies 367
AlixJouan
Member

Testint first the email by myself to be sure there is no problem and that the links work... then doing 2 sample of "test" contact, seeing in which group the emails are the more open and which one has the bigger number of clicks

0 Upvotes
cmares
Contributor

A/B testing or analyzing the change I have made to the campaign for a series of weeks or months.

0 Upvotes
Paul_M
Contributor

Context & Value

Analyze the quality of the recipients (engagement history)

Attach the values that that contact group aspires for (where they are in the buyer’s journey) into the email copy.

Split them into 2 groups and send contact group 1 email with copy 1 and contact group 2, email with copy 2.

 

CTA

A/B Test with 2 email copies;

1) brief Text-based email copy

Use of short brief Text with hyperlink and ensure that there is Typography hierarchy that draws attention to the CTA

 

2) Image based email copy

Use an Image that informs customer to take certain action with the help of leading lines. e.g Ice cream cone tips, winding roads, pointing hands. 

 

The idea here is to find out which email copy and CTA that respective contact groups reacts to most. There should b a desired performance target to ensure that the experiement is a success.

STrepeck
Member

To start, I would send a mock email to friends/family to gain their input before moving onto colleagues. Once I get the input from friends/family, I would then move onto A/B, CTA, etc. testing with my colleagues to determine which route is the best. I would also then play around with the subject line to make sure it is not a reason that spam happens frequently. I think that by delegating certain parts of the testing process to certain people (whatever that may look like) is important to gain an accurate picture of the process as well as where to improve/develop among other areas.

BOtai
Member

I would conduct testing around the CTA which could involve testing placement or the actual phrasing of the CTA itself as it is closely tied to the goal of sending my email

 

0 Upvotes
SMishra69
Member

subject line 

0 Upvotes
GLloyd61
Participant

Subject line A/B test - Open rates
CTA - Clich through rates

0 Upvotes
VHammons
Contributor

I would conduct testing around the CTA which could involve testing placement or the actual phrasing of the CTA itself. 

0 Upvotes
maheenansari28
Member

I would focus on the areas of CTA since the manager wants to improve CTR. I would focus on the communication aspect of the email. Making sure the message and content are conveying to the contact clearly. 

MaryA1
Contributor

The subject line is the first thing everyone reads, then the preview text. I would test adjusting different parts of the email separately, like the first paragraph, the style of conversation and then the CTA, to see how the newsletter converts better

Agentdelaney
Participant

The subject line is the first thing everyone reads, then the preview text. Those 2 are crucial to getting open rates.  Starting there makes sense 

Emildeca1
Member

For me it is the subject line to get my potential customer to open the email in the first place. No conversions without the open first. Compelling subject lines are a crucial part of email marketing in my experience.

MLemus
Member

Since the manager is asking for an improvement in the CTR and not the Open Rate, I would imply that even though the emails with the newsletter are been opened, the percentage of readers that are clicking on the link included is not enough. For that reason,  I would focus on the message and CATs. The body of the email must be related to the subject, would have to be intereting enough and valuable for the reader. The use of keywords in the links and through out the email would be also helpful to increase the CTR. 

AWang8
Contributor

I would focus upon the text in the subject line to determine if it reflected the content and appealing.

0 Upvotes
ELedbetter
Member

I would do an A/B test to determine if subject lines with a token in them improve open rates

HNoble
Participant

I would start with doing an A/B test on the sender name to see if people are more likely to open an email coming from our church name, vs. the name of the lead Pastor. 

0 Upvotes
PDabas
Member

A/B testing is required on the subject lines, images, body text and CTA. Set a goal, identify segmentation, prepare relevant content, publish contents, run a/b test, analyse the data, improve.

DDallow
Participant

A/B test body copy, design and images and CTA and signature. 

0 Upvotes
Elfee
Participant

I have already done some A/B testing with the subject line, preview text, and body text. Now I need to review and analyze them.

AUdoh6
Participant

I would test things like the subject line and CTA to help improve click through rate.

DKathleenB
Member

execute an A/B testing strategy