Sofia Marchetti

Director of Experimentation · Booking.com

Sofia has run experimentation at one of the highest-volume testing programmes in Europe, where thousands of tests run at once and most of them are wrong.

She argues that sample size is a product decision, not a statistics one: it is a choice about how much you are willing to pay to be sure.

Her sessions are blunt about the tests that should never have been run.