The Sample Ratio Mismatch (SRM) test can be used to detect a wide variety of data quality issues that may affect online experiments (aka A/B tests). Only expected proportions and observed sample counts are required as input for this procedure, so this test can be used even in cases where experimenters only have access to summary statistics; such as when using third-party tools.
Tired of testing for SRM manually?
This extension automatically performs the Sample Ratio Mismatch test and flags potential issues on supported experimentation platforms.