How long to test

  • Estimate
  • Model 08

Difficulty 3 of 5

Baseline conversion is 10 percent. Detect a 1 percent relative lift, to 10.1 percent, at 95 percent confidence (z = 1.96) and 80 percent power (z = 0.84). 100,000 new independent users/day split equally between 2 arms. How many whole days must the test run?

Play level

The question

Answer with one number in days.

One change feed keeps serving in stepTap or press Space to change the write paths

Goals and limits

p99 latency
under 200 ms
Monthly cost
under 10 USD/mo
Traffic
100 req/s

Concepts

How players did

Player results load from the server.

All levels