October 28th 2013

Learn from Big Data How to Predict the Future

Business Intelligence Software


I was honored to have my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die reviewed by Doug Lautzenheiser at the Business Intelegence Software blog. Here is an excerpt from the review.

Learn from Big Data How to Predict the Future

Experts believe our collection of Big Data will double every two years until 2020. 

Much of those digital artifacts come from people like you and me as we "Like" things on Facebook, buy books over the web, post blog entries, and share smartphone photos on Instagram. Yet only a fraction of this data is actually being used.  

So what should we do with it?

Eric Siegel says that most valuable thing we can do with data is to "learn from it how to predict."

The founder of the Predictive Analytics World conference, Dr. Siegel is also the author of the bestselling book, "Predictive Analytics," with the catchy subtitle of "The Power to Predict Who Will Click, Buy, Lie, or Die." 

I read his work right on the heals of taking a Coursera MOOC on Data Analysis and was pleased to get Siegel's common-sense clarifications of the same academic topics.

Throughout the book, Siegel provides real-life examples of how organizations use data and software to infer something unknown, perhaps imperfectly but often with surprising accuracy.

For example, Siegel covers how the retail giant Target Corporation uses predictive analytics to decide which of its shoppers might be pregnant and how financial services giant Chase predicts which customers might pay off mortgages early (good for the homeowner but bad for Chase since they lose interest payments).

Click here to read the full review at Business Intelligence Software blog.

No Comments yet »

October 21st 2013

Are We Puppets in a Wired World?

I was honored to have my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die reviewed by Sue Halpern in The New York Review of Books. Here is an excerpt from the review.

… In other words, you are not only what you eat, you are what you are thinking about eating, and where you 've eaten, and what you think about what you ate, and who you ate it with, and what you did after dinner and before dinner and if you 'll go back to that restaurant or use that recipe again and if you are dieting and considering buying a Wi-Fi bathroom scale or getting bariatric surgery and you are all these things not only to yourself but to any number of other people, including neighbors, colleagues, friends, marketers, and National Security Agency contractors, to name just a few. According to the Oxford professor Viktor Mayer-Schönberger and Kenneth Cukier, the "data editor" of The Economist, in their recent book Big Data:

Google processes more than 24 petabytes of data per day, a volume that is thousands of times the quantity of all printed material in the US library of Congress … Facebook members click a "like" button or leave a comment nearly three billion times per day, creating a digital trail that the company can mine to learn about users' preferences.

How all this sharing adds up, in dollars, is incalculable because the social Web is very much alive, and we keep supplying more and more personal information and each bit compounds the others. Eric Siegel in his book Predictive Analytics notes that "a user 's data can be purchased for about half a cent, but the average user's value to the Internet advertising ecosystem is estimated at $1,200 per year." Just how this translates to the bottom line is in many cases unclear, though the networking company Cisco recently projected that the Internet will be worth $14.1 trillion by 2022.

For the moment, however, the crucial monetary driver is not what the Internet will be worth, it's the spread between what it costs to buy personal information (not much) and how much can be made from it…

Click here to read the full review in The New York Review of Books

No Comments yet »

October 14th 2013

A tale of two books on decision-making


I was honored to have my book,  Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die reviewed by Vijay Mehrotra — check it out.

A tale of two books on decision-making

By Vijay Mehrotra

Daniel Kahneman is a psychologist who was awarded the 2002 Nobel Prize for his influence on the burgeoning field of behavioral economics. I recently read his bestselling 2011 book “Thinking Fast and Slow” [1]. The book begins with a set of chapters collectively entitled “Two Systems.” This is where the book’s title comes from: System 1 [the “Thinking Fast” from the book’s title] “operates automatically and quickly, with little or no effort and no sense of voluntary control,” while System 2 [“Thinking Slow”] is engaged in “the effortful mental activities that demand it, including complex computations …” [2].

Kahneman then proceeds to illustrate how these Systems interact. He presents several examples in which System 1’s assessment processes are simplistic and biased. System 2, while capable of making much better decisions, is shown to be “lazy” as a result of the volume and variety of demands that leave it in a busy and depleted state. The tendency toward lazy System 2 processes, it turns out, is also why so many people turn out to be quite unskilled at probabilistic reasoning and associated decision-making; it is simply much, much easier for System 1’s automatic (and often incorrect) heuristics to be deployed than for System 2 to break away from its many other demands.

My System 2 was exhausted by the time I finished “Thinking,” so I simply started reading the next book that was sitting on my nightstand, which was Eric Siegel’s “Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die” [3]. Siegel is a former computer science professor, an experienced analyst and more recently the founder of the Predictive Analytics World conference series. As its title suggests, he has written a book that focuses on data-driven predictions, which he collectively labels as “predictive analytics” (PA).

The centerpiece, or rather centerfold, of the book is a list of more than 100 success stories that involve PA, grouped into categories ranging from “Financial Risk and Insurance” to “Family and Personal Life.” In turn, each chapter tells its own tale through these PA success stories. For example, in the chapter that explores the ethical and privacy implications of using data for prediction (“With Power Comes Responsibility”), Siegel illustrates the key ideas through the story of HP’s model for predicting the likelihood of employees leaving the company and Target’s algorithm and processes for predicting which customers were likely to be pregnant, while in the last chapter (“Persuasion by the Numbers”) he shines a bright light on U.S. Bank, Telenor (a Norwegian telecommunications company) and the Obama 2012 campaign.

Click here to read the full review in Analytics-Magazine.org


No Comments yet »

October 7th 2013

Why I Became a Believer in Artificial Intelligence

big think

Big Think originally published this transcript of my own words. The article relates to my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die.

Why I Became a Believer in Artificial Intelligence

I’ve been asked periodically for a couple of decades whether I think artificial intelligence is possible.  And I taught the artificial intelligence course at Columbia University.  I’ve always been fascinated by the concept of intelligence.  It’s a subjective word.  I’ve always been very skeptical. And I am only now newly a believer.  

Now this is subjective: my opinion is that IBM’s Watson computer is able to answer questions, and so, in my subjective view, that qualifies as intelligence.  I spent six years in graduate school working on two things.  One is machine learning and that’s the core to prediction – learning from data how to predict.  That’s also known as predictive modeling.  And the other is natural language processing or computational linguistics.  

Working with human language really ties into the way we think and what we’re capable of doing and that does turn out to be extremely hard for computers to do.  Now playing the TV quiz show Jeopardy means you're answering questions – quiz show questions.  The questions on that game show are really complex grammatically.  And it turns out that in order to answer them Watson looks at huge amounts of text, for example, a snapshot of all the English speaking Wikipedia articles.  And it has to process text not only to look at the question it’s trying to answer but to retrieve the answers themselves.  Now at the core of this it turns out it’s using predictive modeling.  Now it’s not predicting the future but it’s predicting the answer to the question. 

The core technology is the same.  In both cases it involves learning from examples.  In the case of Watson playing the TV show Jeopardy it takes hundreds of thousands of previous Jeopardy questions from the TV show having gone on for decades and learns from them.  And what it’s learning to do is predict whether this candidate answer to this question is likely to be the correct answer.  So it’s going to come up with a whole bunch of candidate answers, hundreds of candidate answers, for the one question at hand at any given point in time.  And then amongst all these candidate answers it’s going to score each one.  How likely is it to be the right answer?  And, of course, the one that gets the highest score as the highest vote of confidence – that’s ultimately the one answer it’s going to give.   

Click here to read the rest of this transcript at bigthink.com

No Comments yet »

October 1st 2013

Data Mine or Data Yours? Info Wars and the Escalating Arms Race



I originally published this article in Expert Marketer Magazine. The article relates to my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die.

Data matters.  It’s the very essence of what we care about. 

Personal data is not equivalent to a real person—it’s much better. It takes no space, costs almost nothing to maintain, lasts forever, and is far easier to replicate and transport. Data is worth more than its weight in gold—certainly so, since data weighs nothing; it has no mass.

Data about a person is not as valuable as the person, but since the data is so much cheaper to manage, it’s a far better investment. Alexis Madrigal, senior editor at The Atlantic, points out that a user’s data can be purchased for about half a cent, but the average user’s value to the Internet advertising ecosystem is estimated at US $1,200 per year.

Data’s value—its power, its meaning—is the very thing that also makes it sensitive. The more data, the more power. The more powerful the data, the more sensitive. So the tension we feel around data governance is inevitable. If nobody cared about some piece of data, nobody would try to protect it, and nobody would want to access it or even bother to retain it in the first place. Data mining industry leader John Elder reflects, “The fact that it’s perceived as dangerous speaks to its power; if it were weak, it wouldn’t be a threat.”

Ever since the advent of paper and pen, this has been the story. A doctor scribbled a note, and the battle to establish and enforce access policies began.

But now, digital data travels so far, so fast, between people, organizations, and nations. Combine this ability of data to go anywhere at almost no cost with the intrinsic value of the stuff that’s traveling, and you have the makings of a very fickle beast, a swarm of gremlins impressively tough to control. It’s like trying to incarcerate the X-Men’s superhero Nightcrawler, who has the ability to teleport. It’s not confined to our normal three dimensions of movement, so you just can’t lock it up.

Click here to access the full published article as a PDF


No Comments yet »

September 24th 2013

The Risk of Prejudice in Computerized Prediction

I originally published this article in Profiles in Diversity Journal. The article relates to my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die.

The Risk of Prejudice in Computerized Prediction

Today’s predictive technology introduces a new risk of prejudice on a massive, automated scale. Predictive analytics predicts what each person will do so that companies and government agencies can operate more effectively. In some cases, this technology does drive life-changing decisions. Large organizations like Hewlett-Packard inform human resource decisions by predicting whether each employee is likely to quit, and states such as Oregon and Pennsylvania analytically predict whether each convict will commit crime again (recidivism) in order to make sentencing and parole decisions.

Given this influence on the lives of individuals, predictive analytics introduces a new risk of prejudice in two ways:

1. Prediction of minority status. Fueled with data, computers automatically detect one’s minority status. A new study from the University of Cambridge shows that race, age, and sexual orientation can be accurately determined by one’s Facebook likes. The capacity to predict grants marketers and other researchers access to unvolunteered demographic information. Some such personnel may be keen on managing and using this information appropriately, but have not necessarily been trained to do so.

2. Prediction with minority status. When utilizing predictive analytics, it is difficult to avoid incorporating minority status into the predictive model as one basis of prediction. There is no place this threat is more apparent than in law enforcement, where computers have become respected advisers that have the attention of judges and parole boards.

While science promises to improve the effectiveness of law enforcement, when the organization formalizes and quantifies decision making, it inadvertently instills existing prejudices against minorities. Why? Because prejudice is cyclical, a self-fulfilling prophecy, and this cycling could be intensified by the deployment of predictive analytics.

Click here to read the rest of this article at DiversityJournal.com

No Comments yet »

September 18th 2013

Prediction Isn’t Just About Stocks. Predictive Persuasion


I think you'll find this Forbes blog post by David Leinweber of interest!:

Prediction Isn't Just About Stocks. Predictive Persuasion

David Leinweber, Contributor

Prediction isn’t just for the stock market. Trading is just one of many ways to cash in on quantitative foresight. For mass marketing – and even presidential campaigns – it’s another story. In those areas, putting odds on the future generates a different kind of power: the power to influence and persuade people – the power to not only predict but to actually change the future.

Persuasion by way of prediction is a whole other side to the big data world.

Predictive persuasion has a nice ring to it… and I bet you’ll never guess exactly what it is that companies predict in order to persuade. There’s a surprise twist in how it works. You already know that the whole point of marketing a product (or political candidate) is to influence consumers. But most don’t know that the new trend to do so goes beyond predicting consumer (and voter) behavior. Instead, those in power secure their lead by predicting how to best convince you. They increase their influence by predicting not your behavior, but how to influence your behavior. This technique is the bottom line in “mathematical seduction.” Predictive technology hasn’t only advanced and become more precise – it just got under your skin.

You’ve probably heard of the classic 1936 book, “How to Win Friends and Influence People.”  Perhaps the modern master of turning these ideas into science and software is the current occupant of 1600 Pennsylvania Avenue, who efforts in this direction were described in remarkable detail in a recent NY Times Magazine feature.

Click here to read the rest of this article at Forbes.com

No Comments yet »

September 16th 2013

Siri, You Can Drive My Car

big think

This transcript was originally published in Big Think. The article relates to my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die.

Siri, You Can Drive My Car

The main thing that’s going to happen with predictive analytics is that it’s just going to become more pervasive.  It’s going to be more ingrained.  It’s going to be used more and more.  We’re already being predicted all the time.  It’s influencing our experience – it’s hard to know how much.

I like to look at the year 2020 and say, “Well, what’s gonna happen when you’re driving to work?”  So one of the things that’s happening now is that your Smartphone is being more integrated with your car.

It either has its own integration to the cell network or you’re just docking your Smartphone. Either way you’re on the Web when you’re driving.  You’re connected.  You’re connected to the Cloud.  You’re connected to the ability to predict.  And this is going to actually affect a whole bunch of things, even just in your first hour of the day commuting to work in a car.  So you try to start the car and it takes some biometric readings and it says, “Hey, that’s not really you.” And it won’t let you start the car to prevent theft of the car.  It gives you recommendations of where to go grab breakfast.  It’s recommending restaurants knowing that you’re going to turn off the recommendations if you don’t like them.  It’s going to reroute your drive based on predictions.  Not just current traffic conditions but predictions of traffic to come – and use that to reroute the way you’re commuting to work.

Click here to read the full article in bigthink.com

No Comments yet »

September 9th 2013

Review of “Predictive Analytics” by Stephen Few

Perceptual Edge

I was honored to have my book,  Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die reviewed by Stephen Few — check it out

Predictive Analytics — Eric Siegel Lights the Way

Predictive analytics is one of the most popular IT terms of our day, and like the others (Big Data, Data Science, etc.), it’s often defined far too loosely. People who work in the field of predictive analytics, however, use the term fairly precisely and meaningfully. No one, in my experience, does a better job of explaining predictive analytics—what it is, how it works, and why it’s important—than Eric Siegel, the founder of Predictive Analytics World, Executive Editor of the Predictive Analytics Times, and author of the new best-selling book in the field, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die.

Predictive analytics is a computer-based application of statistics that has grown out of an academic discipline that is traditionally called machine learning. Yes, even though computers can’t think, they can learn (i.e., acquire useful knowledge from data). Siegel defines predictive analytics as “technology that learns from experience (data) to predict the future behavior of individuals in order to drive better decisions.” (p. 11)

I appreciate the fact that Siegel doesn’t gush about the wonders of data and technology to the hyperbolic degree that is common today; he keeps a level head as he describes what can be done in realistic and practical terms. Here’s what he says about data:

As data piles up, we have ourselves a genuine gold rush. But data isn’t the gold. I repeat, data in its raw form is boring crud. The gold is what’s discovered therein.(p. 4)

Click here to read the full article in PerceptualEdge.com

No Comments yet »

September 3rd 2013

The Computer Knows Who You Are

Market Watch


I originally published this article in WSJ MarketWatch.com. The article relates to my book, Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die.

The Computer Knows Who You Are

Commentary: Peril, promise and the price of predictive technology

As computers are entrusted to make judgment calls traditionally decided by people, should we worry?

There’s a surprising twist. While some question whether the prescient machines that drive decisions by way of induction and prediction are trustworthy, an emerging problem is that they often predict too well. Predictive technology is so powerful, it reveals a future often considered private.

Millions of operational decisions in finance, marketing, law enforcement, and health care are now machine-driven — often with improved dexterity — using electronic predictions of human behavior, one person at a time. The technology to do this, predictive analytics, is a booming practice that’s taken hold across many industries.

Computerized prediction will never be perfect — like people, prognostic technology often gets it wrong, although in many applications it turns out to be more accurate than people are. But predictive analytics can cause difficulties not only when its predictions are wrong, but when its predictions are right.

Click here to read the full article in WSJ MarketWatch.com

No Comments yet »

« Prev - Next »

  • Subscribe Via Email

    Get a daily digest of new posts delivered to your inbox:

  • Predictive Analytics Book: The Power to Predict Who Will Click, Buy, Lie, or Die
  • Recent Posts