On the Web: 7 Keys to E-Commerce Tests That Matter

4. Test Significant Metrics
Only test response metrics that can produce a statistically significant result. If you have 50,000 email addresses and a typical email campaign produces 50 orders, you don't have enough quantity for an email creative test that uses the number of orders as the "response" metric. You won't get enough respondents on either side of the test.