Use A/B Testing for Click Throughs

If you were to test your campaign content based on click-throughs, you’ll want to test different versions of an email while keeping your subject line and preheader text the same.

Make sure you have selected to A/B Test based on ‘Click Throughs’ when creating a new campaign.

Edit your default email

1. Scroll down to the ‘Email’ section in the campaign builder
2. To edit the content for Test A, click on ‘Open Editor’. You can learn how to use Movio Cinema’s email editor in the email editor section
   
   
   
   
3. Select your ‘From Name’ – you can choose to use different email senders using Conditional Content
4. Enter your subject line and preheader text. Note, Test A and Test B share the same email header. You can edit it from any test version using the Email Editor
5. Click on ‘Open Editor’ for Version B, and repeat step b)
   
   
6. Click on ‘Add URL Parameters’ to add custom parameters to each URL within your campaign This is useful to track link clicks and can be used for external analytics such as Google Analytics
7. Select if you think one test will significantly* outperform the other?
   • If you select Yes, the tests will be sent to a smaller number of recipients in order to maximize the number of members who receive the campaign
   • If you select No, the tests will be sent to a larger number of recipients in order to more accurately identify the winning test

   NOTE: Movio Cinema would consider one test significantly outperforming the other if there were more than a two percentage points difference. For example, if you think Test A will have a 25% open rate, and Test B will have a 20% open rate, this is a 5 percentage points difference

8. If you would like to know how many contacts are in each A/B Test, click on the calculator icon to ‘Calculate A/B test size’
9. Click ‘Save’

Delivery

1. Select when you would like your ‘winning’ campaign to be sent by clicking on the calendar icon
2. Select when you’d like your tests to be sent:
   • You can choose to execute the tests immediately (minimum 3 hours)
   • Alternatively, you can ‘Select a time’ and use the sliding bar to determine the length of your tests (maximum 7 days)
3. Click 'Save’
   Please note, we highly recommend that you test your campaigns for as long as you can. Ideally, please allow for two days
   
   

Testing

Prior to sending your tests and winning campaign to your recipient list, you must send an internal test email. This will allow you to test the email campaigns before sending the final campaigns to your members. This is where you can build your sign-off workflow.

1. Hand select one or more individuals who should receive the test campaigns
2. Additional recipients can be added to the list by selecting the ‘Add’ button and filling in the appropriate information
   
   
   
   
3. Select which tests you’d like to send. You can either send Both, Test A, or Test B
4. Click on ‘Send Tests’ to send a test campaign to your test recipients
   
   
   

Execute Campaign

1. After all the required settings are configured, the ‘Execute’ campaign button will be enabled
2. Click on ‘Execute’
3. After reviewing the settings, enter your password in the editable field
4. Click ‘Execute’ at the bottom of the window