A/B split tests

What number of contacts do you need to have to make an a/b split test worthwhile?

roshodgekiss roshodgekiss, 5 years ago

That's a good question, kas2 - I guess as many as it takes to see a significant result. That may be 100, 500 contacts, or whatever is required to reach a conclusion like, 'Version A had a 20% better open rate than Version B'. For a bit of mathematical fun on this topic, I recommend reading this post :)


Get in touch with us on Twitter: http://twitter.com/campaignmonitor
We're also on Facebook: http://facebook.com/campaignmonitor
elizabethmc, 5 years ago
roshodgekiss :

That's a good question, kas2 - I guess as many as it takes to see a significant result. That may be 100, 500 contacts, or whatever is required to reach a conclusion like, 'Version A had a 20% better open rate than Version B'. For a bit of mathematical fun on this topic, I recommend reading this post :)

Thanks for the link. I found it helpful and interesting! ;)

200,000 companies around the world can't be wrong.

From Australia to Zimbabwe, and everywhere in between, companies count on 
Campaign Monitor for email campaigns that drive real business results.

Get started for free
1-888-533-8098