How A/B Split Testing Works

What’s the best day to send your email marketing campaign? Weekdays? Weekends? What time? Early morning, or late afternoon? What kind of subject line works best? Something with a hard sell? Or something more subtle and informative? Will people open your email if you include “FREE” in the subject line?

The only way to know for sure is to experiment with your campaigns. The most common way to experiment is to run an A/B split test.

A/B Split Testing

You can use MailChimp’s email optimizer to run A/B tests on subject lines, from names and send dates and send times.

A/B Split Test Ideas

Here are some quick ideas for A/B testing experiments that you can run on your email campaigns with MailChimp:

  • What day of the week gets you better open rates?
  • What time of day works best for your promotional (e-coupons, special sales, “act now!” etc) campaigns?
  • What day/time works best for your informative “newsletter” campaigns?
  • What subject line style works best? Hard sell? Soft sell?
  • Should your subject line always include your company name? Or should it be a long, descriptive subject line detailing what’s inside the message?
  • Is it better to use your company’s name in the “From” line, or a human’s name?
  • Does time of day affect overall click rate?

Running A/B split tests on your email marketing campaigns used to be pretty complicated. You had to setup “random slice” segments, create two campaigns, check stats, then send a final campaign. Most people barely have enough time to send one campaign, let alone two additional tests. Well, we just made A/B testing your email campaigns easy and automatic.

A/B Testing With MailChimp’s Email Optimizer

With our patent-pending MailChimp Email Optimizer, you simply select the type of test you want to run, and the size of your sample groups. We take care of the rest, automatically.