Does upfront fee disclosure improve checkout?
Study design
Assign 4,000 eligible app users evenly before they see the checkout. Keep assignment stable across sessions and analyse users in their original group.
Instrument and data fields
Record assignment, eligible user ID, paid order and refund within seven days. Ask a sample of abandoners which cost they expected before checkout.
Simulated evidence
Current layout: 180 paid orders and 22 refunds from 2,000 users. Upfront fees: 200 paid orders and 18 refunds from 2,000.
Check before drawing a conclusion
Write down the comparison you would make and the unit each row represents. Identify one explanation the study design cannot rule out, then describe how it would affect the decision.
Reveal the worked analysis
After refunds, the observed paid-order rate is 7.9% versus 9.1%, a 1.2 percentage point difference. Check the uncertainty and contribution per assigned user before rollout.
The trial describes eligible app users during the test. Fee changes or a shift in traffic could change the result.