A/B testing is a great technique to experiment with changes to your product. At Etsy we make extensive use of them to test out ideas; we’ve got 30+ running right now. Although the concept is simple, the execution is a bit tricker then you’d think. This covers the common, and a few of the not so common, mistakes that can skew your results.
Video producer: http://madisonpl.us/ux/