# A/B Testing

Test different offer variations to find what converts best. A/B testing lets you compare up to 2 options for each upsell step and measure which performs better.

{% embed url="<https://d2798l25hiaz3h.cloudfront.net/GmCCBS0w5BWp.webp>" %}

## How it works

When A/B testing is enabled, customers are randomly shown one of the test variations. The app tracks performance metrics for each variation so you can identify the winner.

### What you can test

You can create variations for any of these elements:

| Element               | Description                                                      |
| --------------------- | ---------------------------------------------------------------- |
| Offer title           | Test different headlines and messaging                           |
| Discount type & value | Compare percentage vs fixed amount, or different discount levels |
| Template              | Test different layout designs                                    |
| Countdown display     | Test with/without countdown timer                                |
| Countdown text        | Test different urgency messages                                  |
| Expiration time       | Test different offer durations                                   |
| Free shipping         | Test with/without free shipping offer                            |
| Product layout        | Test scrollable vs standard layout                               |

### Metrics tracked per variation

* **Impressions** — number of times the variation was shown
* **Total Orders** — number of orders created from this variation
* **Total Revenue** — revenue generated by this variation

## Setting up an A/B test

### Step 1: Open your offer

Navigate to your offer's edit page. In the upsell step you want to test (Upsell #1, Upsell #2, or Downsell), look for the **A/B Test** toggle.

### Step 2: Enable A/B testing

Turn on the A/B test toggle. This creates **Option A** (your current settings) and **Option B** (a new variation).

### Step 3: Configure Option B

Modify the settings for Option B. For example:

* Change the discount from 10% to 15%
* Use a different template
* Adjust the countdown timer text

### Step 4: Save and monitor

Save your offer. The app will automatically split traffic between the two options and track performance.

### Step 5: Review results

Check the A/B test results in your offer's analytics. Compare:

* Which option gets more orders?
* Which generates more revenue?
* Which has a higher conversion rate?

### Step 6: Pick a winner

Once you have enough data, stop the A/B test and keep the winning variation. Click **Stop A/B test** to save the results and apply the winner.

## Best practices

* **Run tests long enough** — wait for at least 100 impressions per variation before drawing conclusions
* **Test one element at a time** — changing multiple things makes it hard to know what caused the difference
* **Start with high-impact elements** — test discount value and offer title first, as they have the biggest impact on conversions
* **Reset analytics** if you make changes mid-test to get clean data

## Availability

A/B testing is available for all upsell steps:

* **Post-purchase upsell**: Upsell #1, Upsell #2, and Downsell
* **Thank you page upsell**: Upsell step
* **Order status page upsell**: Upsell step


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://help.aov.ai/aov-post-purchase-upsell/advanced-settings/ab-testing.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
