Shop Talk:

Again, these results are absolutely fascinating. Almost nobody in our industry looks at data this way; most look at matchback results, which are highly biased. Mail/holdout tests provide far more accurate outcomes and are far more interesting to interpret than standard matchback analytics.

–— Kevin Hillstrom is president of MineThatData, a database marketing consultancy. Reach Kevin at kevinh@minethatdata.com.