Model Development

Evaluate and Test

Now you’re at the point where the new model can be built and the statistician is showing you a couple of tables suggesting that it works great. But there’s too much at stake to simply roll out a new modeling scheme. Test into it first. Here are two suggestions:

Compare old to new segmentation. Run a simple head-to-head test of your previous selection criteria against the new scheme that incorporates your model to identify/analyze the unique names selected. Then set up in-the-mail test keys comprised of nth name selections from both unique name populations to get a good measure of the response lift and return on investment the new model is achieving.