Peeking bias

Checking a running test repeatedly and stopping the moment p crosses α inflates the false-positive rate well above the nominal 5%. The slider sets how many interim looks an analyst takes. The plot is a Monte Carlo estimate over 1,500 simulated experiments at each setting.