Machine Learning Times
EXCLUSIVE HIGHLIGHTS
Hybrid AI Emerges To Tame LLMs – And Not A Moment Too Soon
 Originally published in Forbes The great potential of LLMs is...
AGI Is Infeasible. Instead, Pursue Superhuman Adaptable Intelligence
  Originally published in Forbes On a recent episode of the...
Artifact-Driven Development: Making It Possible to Query Large Analytics and AI Projects
 A practical introduction to making complex project structure explicit...
Incoherent AGI Hype Spurs An Industrywide Pivot To Hybrid AI
  Originally published in Forbes Recently on The Dr. Data Show,...
SHARE THIS:
  • Jun 1, 2024
  • Comments Off on The Danger Zone in Data Science: Why mediocre ML is so dangerous to the business
  • Industry News, Left-hand
  • 2815 Views

2 years ago
The Danger Zone in Data Science: Why mediocre ML is so dangerous to the business

 

Originally published in Delphina, May 29, 2024.

When I (Duncan) was on Uber’s Marketplace team, we would (semi) joke that we were lurching from crisis to crisis.

Our dozens of core machine learning products directly controlled billions of company dollars — targeted promotions, surge pricing, driver incentives, ETAs, pool matching, upfront rider fares, subscription upsells, the list goes on. We lived in paranoia that these were fundamentally broken in a way that would sink the business.

Every week brought a new potential Data Science Disaster. The turmoil would always start the same way: someone would find something suspicious in the data. It might have been a spike in our internal metrics like “zeros”, which measured riders who opened the app and didn’t see any cars available. Were we under-surging and losing riders because of poor reliability? Had we deployed too many rider promos? The wrong driver incentives?

Or it could have been a tweet — perhaps a celebrity saw a fare that seemed high, and then they walked 20 feet and the price changed materially — and of course screenshots went viral and started spiraling.

To continue reading this article, click here.

Comments are closed.