Machine Learning Times
EXCLUSIVE HIGHLIGHTS
2 More Ways To Hybridize Predictive AI And Generative AI
  Originally published in Forbes Predictive AI and generative AI...
How To Overcome Predictive AI’s Everyday Failure
  Originally published in Forbes Executives know the importance of predictive...
Our Last Hope Before The AI Bubble Detonates: Taming LLMs
  Originally published in Forbes To know that we’re in...
The Agentic AI Hype Cycle Is Out Of Control — Yet Widely Normalized
  Originally published in Forbes I recently wrote about how...
SHARE THIS:

3 years ago
The Science of Price Experiments in the Amazon Store

 
Originally published in Amazon Science, April 14, 2023.  

The requirement that at any given time, all customers see the same prices for the same products necessitates innovation in the design of A/B experiments.

The prices of products in the Amazon Store reflect a range of factors, such as demand, seasonality, and general economic trends. Pricing policies typically involve formulas that take such factors into account; newer pricing policies usually rely on machine learning models.

With the Amazon Pricing Labs, we can conduct a range of online A/B experiments to evaluate new pricing policies. Because we practice nondiscriminatory pricing — all visitors to the Amazon Store at the same time see the same prices for all products — we need to apply experimental treatments to product prices over time, rather than testing different price points simultaneously on different customers. This complicates the experimental design.

In a paper we published in the Journal of Business Economics in March and presented at the American Economics Association’s annual conference in January (AEA), we described some of the experiments we can conduct to prevent spillovers, improve precision, and control for demand trends and differences in treatment groups when evaluating new pricing policies.

To continue reading this article, click here.

4 thoughts on “The Science of Price Experiments in the Amazon Store

  1. Very good article, the sharing is quite interesting and useful for me. I have learned a lot from your post. hope that you will have more new articles in the near future! This fnaf security breach game game will be entertaining to play while you are bored at work or home.

     
  2. Really good research! Noticed this myself, since a lot of hunting gear/firearm accessory prices corelate with hunting seasons(usually it’s rising right before seasons and then slowly drops during, same trend with guns itself like https://gritrsports.com/guns/ but since those aren’t on Amazon itself, it doesn’t matter as much).

     
  3. The core challenge for Amazon’s Pricing Labs is how to conduct A/B experiments for new pricing policies when all customers must see the same prices for the same products at any given time. While Amazon’s product prices already dynamically adjust based on factors like demand, seasonality, and economic liteblue.it.com trends (often driven by machine learning models), the inability to test different price points simultaneously on different customer segments complicates standard A/B testing methodologies.