Machine Learning Times
EXCLUSIVE HIGHLIGHTS
Our Last Hope Before The AI Bubble Detonates: Taming LLMs
  Originally published in Forbes To know that we’re in...
The Agentic AI Hype Cycle Is Out Of Control — Yet Widely Normalized
  Originally published in Forbes I recently wrote about how...
Predictive AI Must Be Valuated – But Rarely Is. Here’s How To Do It
  Originally published in Forbes To be a business is...
Agentic AI Is The New Vaporware
  Originally published in Forbes The hype term “agentic AI”...
SHARE THIS:

3 years ago
The Science of Price Experiments in the Amazon Store

 
Originally published in Amazon Science, April 14, 2023.  

The requirement that at any given time, all customers see the same prices for the same products necessitates innovation in the design of A/B experiments.

The prices of products in the Amazon Store reflect a range of factors, such as demand, seasonality, and general economic trends. Pricing policies typically involve formulas that take such factors into account; newer pricing policies usually rely on machine learning models.

With the Amazon Pricing Labs, we can conduct a range of online A/B experiments to evaluate new pricing policies. Because we practice nondiscriminatory pricing — all visitors to the Amazon Store at the same time see the same prices for all products — we need to apply experimental treatments to product prices over time, rather than testing different price points simultaneously on different customers. This complicates the experimental design.

In a paper we published in the Journal of Business Economics in March and presented at the American Economics Association’s annual conference in January (AEA), we described some of the experiments we can conduct to prevent spillovers, improve precision, and control for demand trends and differences in treatment groups when evaluating new pricing policies.

To continue reading this article, click here.

4 thoughts on “The Science of Price Experiments in the Amazon Store

  1. The core challenge for Amazon’s Pricing Labs is how to conduct A/B experiments for new pricing policies when all customers must see the same prices for the same products at any given time. While Amazon’s product prices already dynamically adjust based on factors like demand, seasonality, and economic liteblue.it.com trends (often driven by machine learning models), the inability to test different price points simultaneously on different customer segments complicates standard A/B testing methodologies.

     

Leave a Reply