A method for presenting measurements of modeling performance for a plurality of modeling algorithms is described. The method displays a lift chart on an output display device. The lift chart has at least three lift curves, each of said three lift curves corresponding to a result obtained from executing one of the plurality of modeling executions with each lift curve being rendered on the output device using a different, visual indicia.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A computer program product residing on a computer readable medium for displaying results of modeling of expected behavior from execution of a plurality of modeling algorithms that model the expected behavior, comprises instructions for causing a computer to: run the plurality of models on a set of test data to produce results of the expected behavior from the models and to produce data that can be converted into a measure of the expected behavior; produce a visual representation, in the form of a lift chart or a receiver operating characteristic curve, of the results of modeling the expected behavior; compare performance of the results of modeling the expected behavior to performance of a stored model; render the results of modeling the expected behavior on an output device using different visual indicia to represent the different results of modeling the expected behavior.
2. The computer program product of claim 1 wherein the modeling algorithms are recency, frequency, monetary, Classification and Regression (CART), Chi squared Automatic Interaction Detection (CHAID) decision trees, linear regression algorithms, logistic regression algorithms, back propagation neural networks, leader/K-means clustering algorithms, step-wise search for input variable selection algorithms, genetic search for input variable selection, parametric tuning algorithms, cross-tabulation algorithms, and affinity matrices algorithms.
3. The computer program product of claim 1 wherein the visual representation displays results of running different variations of the same modeling algorithm.
4. The computer program product of claim 1 wherein the visual representation displays results of running different models of the same modeling algorithm.
5. A computer program product residing on a computer readable media for displaying results of modeling expected behavior comprises instructions for causing a computer to: execute models of expected behavior based on different algorithm types; generate a lift chart from results obtained from execution of a model; compare performance of the model to performance of a stored best model of the same algorithm type; if the performance of the executed model is better than the performance of the stored model, store lift data generated by the executed model; and update a display with a new lift chart having lift curves that are assigned unique visual indicia for a best model of each algorithm type.
6. A computer program product residing on a computer readable medium for displaying results of modeling expected behavior comprises instructions for causing a computer to: execute models of expected behavior based on the same algorithm type; generate a lift chart from results obtained from execution of the models; compare performance of the models to performance of a stored model of the same algorithm type; rank lift data generated by the models; and update the display based on the rank assigned to the lift data with a new lift chart having lift curves that are assigned unique visual indicia for the models of the same algorithm type.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
October 21, 1998
July 31, 2001
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.