Understanding Geo Lift Test Results
Rockerbox's Test Results UI offers the summary-level outcomes and insights needed to interpret and act on test results delivered by Rockerbox's Incrementality Testing
Test Results Overview
- Measure incremental ROAS and CPA of the tested channel
- Compare key testing outcomes across all testing KPIs
- Understand statistical significance of each test result, building the confidence needed to act on test results
No Lift Observed: a test may conclude that no lift is observed in the below scenarios, meaning that the test had less of a result than expected. In these case Lift %, Confidence, and Incremental KPI will not be reported.
- Hold Out Result > Predicted
- Heavy Up Result < Predicted
- Hold Out Result > Predicted
- Heavy Up Result < Predicted
If the confidence level is < 0.8, confidence and incremental KPI will not be shown as results are not statistically significant. This is often seen if lift is positive but a small %.