Skip to main content
Browse by:

Effective March 10, 2020, all Duke-sponsored events over 50 people have been cancelled, rescheduled, postponed or virtualized.
Please check with the event contact regarding event status. For more information, please see

ECE/CS Seminar: Controlled Experiments: An indispensable tool for modern developers

Event Image
Icon calendar
Tuesday, November 20, 2018
Icon time
12:00 pm - 1:00 pm
Icon speaker
Jennifer Beckmann, Principal Engineering Manager for the Microsoft Office Experimentation team
Icon series
ECE/CS Seminar

Controlled experiments, or A/B tests, are the gold standard for optimizing websites. From Amazon's checkout flow to Google's search results, A/B tests can help companies improve workflows to download software, sign-up for subscriptions, click on content, or make a purchase. But, controlled experiments have roots far beyond optimizing websites for conversion. In its simplest form, controlled experiments help establish a causal relationship of a change for a target audience.

Microsoft takes the basics of controlled experiments, and applies the concept in unsuspecting places to help software development teams restructure the way they think about shipping even the most mundane changes. This talk will give you a flavor of how Microsoft products like Bing, Office, and Xbox to weave controlled experiments into the day-to-day software engineering processes. From trusting the data to using it to make backlog decisions, you will learn how controlled experiments are an essential tool to making informed decisions at Microsoft.