Machine Learning Times
Machine Learning Times
EXCLUSIVE HIGHLIGHTS
Effective Machine Learning Needs Leadership — Not AI Hype
 Originally published in BigThink, Feb 12, 2024.  Excerpted from The...
Today’s AI Won’t Radically Transform Society, But It’s Already Reshaping Business
 Originally published in Fast Company, Jan 5, 2024. Eric...
Calculating Customer Potential with Share of Wallet
 No question about it: We, as consumers have our...
A University Curriculum Supplement to Teach a Business Framework for ML Deployment
    In 2023, as a visiting analytics professor...
SHARE THIS:

8 years ago
Predictive Analytics Basics: Six Introductory Terms and The Five Effects

 

Here are six key definitions—and The Five Effects of Prediction—from my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die (Revised and Updated, 2016). Note: A complementary copy of this book will be provided for all attendees at two Predictive Analytics World events coming to New York in October: PAW Business and PAW Financial.

NASA Stamp

1. Predictive analytics—Technology that learns from experience (data) to predict the future behavior of individuals in order to drive better decisions.

In this definition, individuals is a broad term that can refer to people as well as other organizational elements. Most examples in this book involve predicting people, such as customers, debtors, applicants, employees, students, patients, donors, voters, taxpayers, potential suspects, and convicts. However, predictive analytics also applies to individual companies (e.g., for business-to-business), products, locations, restaurants, vehicles, ships, flights, deliveries, buildings, manholes, transactions, Facebook posts, movies, satellites, stocks, Jeopardy! questions, and much more. Whatever the domain, PA renders predictions over scalable numbers of individuals.

2. Predictive model—a mechanism that predicts a behavior of an individual, such as click, buy, lie, or die. It takes characteristics (variables) of the individual as input and provides a predictive score as output. The higher the score, the more likely it is that the individual will exhibit the predicted behavior.
Predictive Models Images
3. Artificial intelligence—advanced machine capabilities that are by definition impossible to achieve since, once achieved, they have necessarily been trivialized (by way of being mechanized) and are therefore not impressive in the subjective sense of “intelligence,” so they no longer qualify. To put it another way, the word “intelligence” has no formal definition, so why use it in an engineering context? However… I still feel like IBM’s Watson seems truly intelligent when watching it play the TV quiz show Jeopardy!. I’m like, “Wow!” This definition is not an excerpt from the book Predictive Analytics, but it does summarize one of my conclusions in the book’s chapter on Watson.

4. Uplift model—A type of predictive model that predicts the influence on an individual’s behavior that results from applying one treatment over another. Synonyms include: differential response, impact, incremental impact, incremental lift, incremental response, net lift, net response, persuasion, true lift, or true response model.

The uplift score output by and uplift model answers the question, “How much more likely is this treatment to generate the desired outcome than the alternative treatment?” For more information, see the article Personalization Is Back: How to Drive Influence by Crunching Numbers (which includes links for further reading at the end), Chapter 7 of Predictive Analytics, and, for more technical citations, the Notes corresponding to that chapter, which may be downloaded as a PDF at www.PredictiveNotes.com.

5. Vast search—the term that industry leader (and Chapter 1’s predictive investor) John Elder coined for predictive modeling’s intrinsic automation of testing many predictor variables and the associated peril of stumbling across a correlation with the target variable that may be perceived as significant—if considered in isolation without considering the search that was employed to unearth it—but that in fact was only due to random perturbations. Synonyms include: multiple comparisons trap, multiple hypothesis testing, researcher degrees of freedom, over-search (akin to overfit), look-elsewhere effect, the garden of forking paths, fishing expedition, cherry-picking findings, data dredging, significance chasing, and p-hacking.

For more information, see my article “HBO Teaches You How to Avoid Bad Science,” Chapter 3 of the 2016 updated edition of my book, Predictive Analytics, and, for more technical citations, the Notes corresponding to that chapter, which may be downloaded as a PDF at www.PredictiveNotes.com.

6. Automatic Suspect Discovery (ASD)—In law enforcement, the identification of previously unknown potential suspects by applying predictive analytics to flag and rank individuals according to their likelihood to be worthy of investigation, either because of their direct involvement in, or relationship to, criminal activities.

Further info: This topic is explored in a special sidebar on the NSA’s use of predictive analytics within the ethics and privacy-focused chapter of Predictive Analytics (Chapter 2)—excerpted as an article here. Also see my Newsweek op-ed on this topic.

ASD provides a novel means to unearth new suspects. Using it, law enforcement can hunt scientifically, more effectively targeting its search by applying predictive analytics, the same state-of-the-art, data-driven technology behind fraud detection, financial credit scoring, spam filtering, and targeted marketing.

A note on automation: ASD flags new persons of interest who may then be elevated to suspect by an ensuing investigation. By the formal law enforcement definition of the word, an individual would not be classified as a suspect by a computer, only by a law enforcement officer.

The Five Effects of Prediction:

i) The Prediction Effect: A little prediction goes a long way.

ii) The Data Effect: Data is always predictive.

iii) The Induction Effect: Art drives machine learning; when followed by computer programs, strategies designed in part by informal human creativity succeed in developing predictive models that perform well on new cases.

Ensemble Models

iv) The Ensemble Effect: When joined in an ensemble, predictive models compensate for one another’s limitations so the ensemble as a whole is more likely to predict correctly than its component models are.

v) The Persuasion Effect: Although imperceptible, the persuasion of an individual can be predicted by uplift modeling, predictively modeling across two distinct training data sets that record, respectively, the outcomes of two competing treatments.

This article was originally published in KDnuggets.

Excerpts included with permission of the publisher from Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die, Revised and Updated Edition (Wiley, January 2016) by Eric Siegel, Ph.D. Siegel is the founder of the Predictive Analytics World conference series which includes events for business, government, healthcare, workforce, manufacturing, and financial services —executive editor of The Predictive Analytics Times, and a former computer science professor at Columbia University. For more information about predictive analytics, see the Predictive Analytics Guide

Leave a Reply