How to Set up an A/B Test Email Campaign
Email marketers! Are you looking for a way to test and improve the impact of your emails?
With A/B Test Campaigns, you can now test up to 6 different versions of an email campaign with your recipient list.
By testing multiple variations of your email campaigns, you can get valuable insight to help create content that resonates with your audience and drives them to action.
Try out A/B Test Campaigns today and see why they’re the best way to measure the success of your emails. Follow the guide below to get started.
Please Note:
- A minimum 10 contacts are needed for each variation. At least 40 total contacts are needed to conduct any split test.
- A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedule.
- If no results are revealed by the end of the stipulated timeframe, the initial variation will be declared as the winning variation by default.Step 1: Go to Marketing > Emails > Select "Campaign" from the dropdown. After creating a new Email Campaign, there is an option to enable "A/B Testing."
Please Note:
A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedule.
Step 2: Choose which you would like to split test: Email subject line or Email content.
Email Subject Line (Optimize Open Rates) - It is necessary to play around with the length of the subject line or add personalization to get better open rates. Email subject lines are the first thing the recipients will see when receiving an email campaign since subject lines are visible to them before they even open your campaign.
Email Content (Optimize Click Rates)- You can test different elements in the campaign content that could influence or not the conversion or action from the recipients, like different section titles, article length, call-to-action buttons, images, videos, and more.
Step 3: Choosing the A/B Test Duration time frame
A/B testing is a key part of any email marketing strategy, and properly selecting the duration time frame is essential to success. It is important to consider how long it will take for customers to recognize, read, and act on emails when determining the duration time frame, as this can impact your results.
In this step, we select the time period after the combinations are sent out, compared to the results for open or click rates.
Data collected during the test phase can be used to determine the email campaign's winning combination. Test duration is between 30mins to 24 hours.
Please Note:
During the duration that is set, if there were no results for click or open rate as chosen, by default the first variation will be sent out as winning variation.Step 4: Choosing the number of split test variations
The number of variations in the email campaign will be based on the strategy that you are following. To set the Test Size, use the slider to decide what percentage of contacts will receive different variations. You can also set the slider to variations to 50%.
Please Note:
A minimum 10 contacts are needed for each variation. At least 40 total contacts are needed to conduct any split test. 
Step 5: Choose the Winning Criteria
Select which winning metric you want to measure: Unique Open Rate or Unique Click Rate.
Step 6: Testing your A/B Split test
Once the A/B Test emails are prepared, and you are happy, you may test the email campaign or preview the campaign by clicking on the 3 dots.
To publish/launch your campaign to the selected receipts, please set the delivery method to either 'Send Now' or 'Schedule For Specific Date/time'.
Please Note:
A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedule.Once the email campaigns are sent out, you may check the enhanced statistics and reports of variations and overall email campaigns (Mentioned at 5:19secs)
A/B Testing In Email Campaigns allows you to test up to 6 different versions of an email!
To use A/B testing for Email Campaigns:
Go to
Marketing > Emails > Email Campaign
Create a new email campaign and click the A/B Testing tab
Choose whether you'd like to split test the Email subject line or the Email content
Set the A/B Test Duration time (after this amount of time, the winning version will be sent to the rest of the contacts)
Set the number of variations you want to test.
Note
- A minimum of 10 contacts are needed for each variation (creating 4 emails to split test would require 40 contacts, 10 for each test).
Choose whether the Winning Criteria will be Unique Open Rate or Unique Click Rate
Set the Delivery method (Send Now or Schedule the Campaign)
Note
- A/B test campaigns will currently not work for batch schedule or RSS schedule.
Once the email campaigns are sent out, you can check the enhanced statistics and reports of variations and overall email campaigns.
