Abstract:
Claims of large lifts in A/B tests are widespread, yet many are only supported by small online experiments that are likely underpowered. Trustworth...
When something goes horribly wrong mid-experiment, should you stick to the plan or stop the test? A story about two statisticians, and possibly a bear.
Abstract:
Underpowered studies (below 50% power) suffer from the winner’s curse: A statistically significant positive estimate must exaggerate the true treat...