Machine Learning Times
EXCLUSIVE HIGHLIGHTS
GenAI Owns the Hype, but Predictive AI Is Thriving
  EDITOR’S NOTE: This article is adapted from the...
The Data Disconnect: A Key Challenge for Machine Learning Deployment
  EDITOR’S NOTE: This article is excerpted from The...
A Brief History of Why Machine Learning Projects Stall
  EDITOR’S NOTE: This is the preface to The...
Hybrid AI Emerges To Tame LLMs – And Not A Moment Too Soon
 Originally published in Forbes The great potential of LLMs is...
SHARE THIS:
  • Jun 1, 2024
  • Comments Off on The Danger Zone in Data Science: Why mediocre ML is so dangerous to the business
  • Industry News, Left-hand
  • 2923 Views

2 years ago
The Danger Zone in Data Science: Why mediocre ML is so dangerous to the business

 

Originally published in Delphina, May 29, 2024.

When I (Duncan) was on Uber’s Marketplace team, we would (semi) joke that we were lurching from crisis to crisis.

Our dozens of core machine learning products directly controlled billions of company dollars — targeted promotions, surge pricing, driver incentives, ETAs, pool matching, upfront rider fares, subscription upsells, the list goes on. We lived in paranoia that these were fundamentally broken in a way that would sink the business.

Every week brought a new potential Data Science Disaster. The turmoil would always start the same way: someone would find something suspicious in the data. It might have been a spike in our internal metrics like “zeros”, which measured riders who opened the app and didn’t see any cars available. Were we under-surging and losing riders because of poor reliability? Had we deployed too many rider promos? The wrong driver incentives?

Or it could have been a tweet — perhaps a celebrity saw a fare that seemed high, and then they walked 20 feet and the price changed materially — and of course screenshots went viral and started spiraling.

To continue reading this article, click here.

Comments are closed.