Test power
The probability of noticing an effect of a given size if it really exists.
Formula
Power = 1 − the probability of missing the effect
How to read
The power is chosen by the analyst. Lower power means a larger risk of missing a real lift.
Where it is discussed
Topics
- Customers and loyalty
- Marketing budget and testing impact
- CRM and the customer base: retention, segments, win-back
Calculations
- Survey sample size and margin of error: how many answers are needed and what can be read by segment
- A/B test on proportions: sample size, duration and reading the result