Split-testing or A/B Testing is incredibly important for webmasters. Everyone should be split testing their websites to make sure that people are able to use your site, even if you aren’t selling anything. It’s just makes good sense.
Let me share with you an example of one time that split testing saved my [you know what]:
When I launched the WordPress Landing Page Theme a couple of weeks ago, I used GWO (Google Website Optimizer) to test different variations of the copy on the page. One of the variations I tested included a Flash slideshow of the different looks, or skins, that the Theme included. I personally really liked the slideshow because, among other reasons, it used Futura Bold as the font and it was sort of a shout out to Wes Andersen.
So I made one of the variations the exact same as the rest, except that this slideshow was included. And you know what happened?
Not one of the users who saw that version converted.
After some further investigation, it turned out that this slideshow was causing a ton of browsers some serious problems. Not only was the slideshow not being shown, but it was also messing up the rest of the page. Since the slideshow was at the top of the page, it meant that damn near everything was totally messed up.
Without Split Testing, this never would have been so obvious
So what do you use to split test?
Well I’ve suggested Google Website Optimizer on my Tools I Use list, and as an additional tool to help with your analytics in Google Analytics is Killing My Website, but it looks like there is a new player on the scene.
It’s called Genetify. See the super-cool demo.
If you aren’t too technically savvy, I would still stick with GWO. But if you know your way around CSS, then check out this comparison of Genetify and GWO.
I’m not going to go into the specific of why Genetify is different and (maybe) better, since the Genetify project at Github could do a much better job. But I’d suggest you all check it out!
Thanks goes out to Brian Cray for telling me about Genetify during some disc golf today. Check out Brian’s hit article about A/B Testing to learn more.
Want More out of WordPress?
I can show you how to get more traffic, make WordPress do amazing things, and how to make more money with your website by converting your visitors into customers. Click the button to the right to get a free estimate.
{ 1 trackback }
{ 5 comments… read them below or add one }
Check out Mixpanel for analytics as well, a YCombinator company –
http://mixpanel.com/
And a great writeup on using it with Rails –
http://www.bingocardcreator.com/articles/tracking-with-mixpanel.htm
Very cool. I, too, use Google Website Optimizer, but it’s handy to know what else is out there. Thanks.
Do you have any test results to share or upload to A/B Tests?
Rex,
I don’t personally have any results to share, but this is a great article on 8 other case studies:
http://visualwebsiteoptimizer.com/split-testing-blog/8-ab-split-multivariate-testing-case-studies/
Best,
Brad
@Brad – thanks for the link above, and I will go check it out. Have you had a sec to check out Performable or A/B Tests? Please follow us on Twitter (@Performable and @abtests)