IMGE Testing Hub — Always-On Experimentation & Test Results
Hypothesis
If we add a thermometer on a soft ask landing page, users will be more likely to submit an answer to the quiz or sign their name because of a bandwagon effect.
Experiment Design
We designed two identical versions of the content. One linked to a soft ask landing page with no thermometer, and the other linked to a landing page with a thermometer showing users how many previous users had signed the petition below. We randomly divided our list in half, sent the emails, and recorded the results. Our sample metric was emails sent, and our testing metric was the number of conversions.
Results
57.4% relative increase in conversions for the treatment group. 99% confidence interval.
650
Control Sample
735
Treatment Sample
100
Control Testing
178
Treatment Testing
Key Takeaways
The inclusion of a signature thermometer drew significantly more conversions.
Share This Test
Test Details
Vertical
Marketing
KPI
Conversions