A/B split tests

What number of contacts do you need to have to make an a/b split test worthwhile?

roshodgekiss roshodgekiss, 4 years ago

That's a good question, kas2 - I guess as many as it takes to see a significant result. That may be 100, 500 contacts, or whatever is required to reach a conclusion like, 'Version A had a 20% better open rate than Version B'. For a bit of mathematical fun on this topic, I recommend reading this post :)


Get in touch with us on Twitter: http://twitter.com/campaignmonitor
We're also on Facebook: http://facebook.com/campaignmonitor
elizabethmc, 4 years ago
roshodgekiss :

That's a good question, kas2 - I guess as many as it takes to see a significant result. That may be 100, 500 contacts, or whatever is required to reach a conclusion like, 'Version A had a 20% better open rate than Version B'. For a bit of mathematical fun on this topic, I recommend reading this post :)

Thanks for the link. I found it helpful and interesting! ;)

Join 200,000 companies around the world that use Campaign Monitor to run email marketing campaigns that deliver results for their business.

Get started for free
1-888-533-8098