I Hereby Abolish The Word ‘TEST’
That’s right, I will no longer refer to multivariate & split tests as ‘Tests’. From now on, I declare them ‘CONTESTS’, and here’s why:
Tests are boring. Tests are work. Tests require studying, memorization, writing, and a #2 pencil. I’m done with all that.
On the other hand, CONTESTS are a blast! It is so much unbelievable fun to get back ‘Contest’ results like this:
We had a ‘contest’ with 7 different variations of the main headline on the page, and 7 out of 7 beat the control, 5 won by enough to be statistically significant.
The biggest winner (and the one that is now the new control) got 21% more click thrus than the old control!
Tell me that isn’t fun.
See what I’m sayin’? Contests are fun! Tests are boring.