Split testing in Deliver allows for the creation and testing of two different versions of a message to see which results in more opens or clicks. Split testing is only available for Deliver mailings or outreach form/event communications, and are not available for system emails, even if they were customized in Deliver.

When utilizing split testing, you will create two separate versions of a mailing that will both be contained within one Deliver mailing in your database.

To set up a Deliver mailing for split testing:

1. Select Deliver in the top navigation bar.

2. Select New Mailing 

3. After setting up a recipient list, select Edit Message, and craft the first version of the message to be tested.

4. In the dropdown next to the subject line, select "Version 1" to mark this draft as the “A” in “A/B Testing” and then save the message.

5. Select Edit Message again. This time, select "Version 2" from the dropdown. The subject field and message body will clear of text so that you can create a second email.

6. Craft the second version of the message to be tested and save the message.

7. Once both versions of the message are configured, a new icon will appear next to the icon that allows switching between desktop and mobile previews. This new icon can be used to toggle your view between the two versions of your mailing.

8. Select the Send Mailing button to configure send settings for the mailing. Split Testing settings will appear as one of your options now that two versions of the mailing have been created:

   • Split Testing: Choose if you want Deliver to send a few of each version, only Version 1, or only Version 2 during the testing period.

   • Sample Size: Set a sample size for the mailing test. Typically, you would set a sample size for half or less of your intended recipients, and the mailing will not be sent to more than this number during the sample period.

   • Sample Period: Define how long you want the mailing test to run, from a few hours to multiple days. 

   • Action after sample period: You can choose from several actions for Slate to take once the sample period has ended. Choose to deactivate the mailing, or have Deliver send to the rest of the recipient list using either the version that received the most opens or the version that received the most clicks during the sample period.

9. After setting up the rest of your Send Settings, select the Send Mailing button in the popup to activate the split test mailing.

Is split testing only available for campaign messages?

No, split testing may be used for both campaigns and one-off or individual Deliver mailings.