A/B Testing
Test different offer variations to find what converts best. A/B testing lets you compare up to 2 options for each upsell step and measure which performs better.
How it works
When A/B testing is enabled, customers are randomly shown one of the test variations. The app tracks performance metrics for each variation so you can identify the winner.
What you can test
You can create variations for any of these elements:
| Element | Description |
|---|---|
| Offer title | Test different headlines and messaging |
| Discount type & value | Compare percentage vs fixed amount, or different discount levels |
| Template | Test different layout designs |
| Countdown display | Test with/without countdown timer |
| Countdown text | Test different urgency messages |
| Expiration time | Test different offer durations |
| Free shipping | Test with/without free shipping offer |
| Product layout | Test scrollable vs standard layout |
Metrics tracked per variation
Each option shows its own stats on the offer step:
- Views: number of times the option was displayed
- Orders: number of orders created from this option
- Revenue: revenue generated by this option's orders
- Conversion rate: orders divided by views, shown as a percentage
Setting up an A/B test
Step 1: Open your offer
Navigate to your offer's edit page and go to the upsell step you want to test. On the step card, find the Create A/B test button at the bottom.
Step 2: Create the A/B test
Click Create A/B test. This splits the step into Option 1 and Option 2, each with its own products and layout.
Step 3: Configure each option
Set up Option 1 and Option 2 with the variations you want to compare. Use the Edit layout & content button (which now lets you pick Option 1 or Option 2) to open each option's layout. For example:
- Change the discount from 10% to 15%
- Use a different template
- Adjust the countdown timer text
Step 4: Save and monitor
Save your offer. The app automatically splits traffic between the two options and tracks performance for each.
Step 5: Review results
Each option's views, orders, and revenue appear directly on the step card. Compare:
- Which option gets more orders?
- Which generates more revenue?
- Which has a higher conversion rate?
Step 6: Pick a winner
Once you have enough data, open the A/B test action menu on the step card and choose Stop A/B test. You will be asked to choose the option you want to keep as your active offer, then click Confirm and exit. The chosen option becomes the live offer and the test ends.
To clear performance data without ending the test, choose Reset analytics from the same menu. This resets views, orders, and revenue for all options to 0 and does not affect your setup or traffic split. To discard the test entirely before saving, use Remove A/B test.
Best practices
- Run tests long enough — wait for at least 100 impressions per variation before drawing conclusions
- Test one element at a time — changing multiple things makes it hard to know what caused the difference
- Start with high-impact elements — test discount value and offer title first, as they have the biggest impact on conversions
- Reset analytics from the A/B test action menu if you make changes mid-test to get clean data
Availability
A/B testing is available on the upsell steps of each offer type:
- Post-purchase upsell: Upsell #1, Upsell #2, Downsell, Upsell #3, and Downsell #2
- Thank you page upsell: Upsell step
- Order status page upsell: Upsell step