Home Help Center What to Do After Verifying the Winning Template for Your Test

What to Do After Verifying the Winning Template for Your Test

Once you’ve verified a winning template in GemX, the experiment phase is over, but the optimization process is not.

This guide walks you through what to do next to ensure you:

  • Apply the winner correctly

  • Avoid data disruption

  • Lock in revenue gains

  • Continue optimizing with confidence

Install GemX Today and Get Your 14 Days Free Trial
GemX empowers Shopify merchants to test page variations, optimize funnels, and boost revenue lift.

Step 1: Double-check the Winner Before Applying

Before you make any changes live, you need to confirm:

  • The winner has higher conversion rate or revenue per visitor

  • Statistical confidence is strong enough

  • The test ran long enough (no early stop bias)

  • No tracking issues during the experiment

Open the Performance detail panel in GemX for an overall comparison between two testing templates.

If you’re unsure how to interpret results, review:

Tip: Do not apply a winner based only on a short-term spike.

Step 2: Apply the Winning Template

Once verified, you can apply the winner to 100% of the traffic.

To apply the winning template, follow this guidance:

  1. Go to GemX Dashboard

  2. Open the completed experiment

  3. Click Make Winner

  4. Select the winning variant

  5. Confirm the action

click make winner in gemx

After confirmation:

  • All traffic will be directed to the winning template

  • The experiment will stop collecting data

  • The losing variant will no longer be shown

Learn  more: If you need detailed steps, see: How to Apply the Winning Template in GemX

Step 3: Verify Live Behavior on Your Store

After applying the winner, here is the checklist you should do:

  • Open your storefront in an incognito window

  • Clear cache

  • Test on both desktop and mobile

  • Go through the funnel (i.e.: Product → Cart → Checkout)

Make sure:

  • The correct template is loading

  • No broken layout or missing sections

  • Tracking events still fire properly

This is especially important if you were running both Template Testing for page-level tests and Multipage Testing for full-funnel experiments.

Step 4: Document the Insight (Not Just the Result)

A winning template is not just a “better design”, it validates a hypothesis.

Try to ask and define:

  • What exactly changed?

  • Why did it improve performance?

  • Was it messaging, layout, CTA placement, trust elements?

These questions help you turn your test result into a reusable insight.

For example, instead of writing "Variant B won with +8% CR"

You can write:

Simplifying the hero headline and moving the CTA above the fold increased the add-to-cart rate among mobile users.

This allows you to build a repeatable testing framework.

Step 5: Monitor Post-Test Performance

Applying the winner does not guarantee permanent up lift.

It’s a must for Shopify store owners to monitor the key metrics such as conversion rate, revenue per visitor, add-to-cart rate, and also funnel drop-off (if your test is a Multipage Testing one).

Within GemX, you can use...

...to watch performance for at least 1–2 weeks after rollout.

If performance drops during this time period:

  • Check traffic sources

  • Check seasonality

  • Check if behavior has changed

Please note that sometimes, external factors influence post-test results.

Step 6: Decide What to Test Next

Remember: Optimization is iterative. After applying a winner, ask:

  • What bottleneck remains?

  • Which metric is still underperforming?

  • Where is the biggest drop-off?

You can take advantage of GemX's built-in analytics, such as:

  • Page Analytics to identify weak sections

  • Journey Analysis to identify funnel leaks

  • Order Analytics to understand revenue impact

store orders listing in gemx order analytics

Then, it’s time to create a new hypothesis and launch the next experiment.

This is how you build a testing culture, not just run isolated tests.

Common Mistakes to Avoid

1. Apply the winner too early

Stop the test before statistical confidence leads to false winners.

2. Forget to verify tracking

Always ensure analytics continue working after applying the template.

3. Ignore device differences

Sometimes desktop wins but mobile underperforms. Review device-level data.

device differences in test results

4. Not save your experiment learnings

Without documentation, you’ll repeat the same tests later.

Need more hands-on support?
Book an onboarding call to get guided setup and expert help.

FAQs

Does applying the winner delete experiment data?
No. Applying the winner does not delete any experiment data. All historical experiment data remains available in the Analytics tab, including traffic distribution, conversion metrics, and performance comparisons between variants. This allows teams to review past experiments, analyze learning over time, and document the impact of each change. Keeping historical data ensures that insights from the experiment remain accessible for future optimization decisions and reporting.
Can I revert to the original template?
Yes. You can revert to the original template if needed. This can be done by manually switching back to the previous version in your page settings or by creating a new experiment using the original template as the control. Many teams choose this approach when they want to validate results again or test additional variations. Reverting does not affect historical data from the previous experiment, so you can continue learning from past performance.
What happens to the traffic split after applying the winner?
Once the winning variation is applied, the traffic split automatically changes so that 100% of visitors are directed to the selected winning template. This ensures that all users experience the version that performed best during the experiment. The experiment itself is finalized, but its historical performance data remains available for analysis in the experiment dashboard.
Should I pause the experiment instead of applying the winner?
Pausing an experiment is useful when you want to temporarily stop traffic distribution while reviewing results or investigating anomalies. However, pause is only a temporary state. If you have enough data and are confident that one variation clearly outperforms the others, using the Make Winner option is the recommended action. Applying the winner finalizes the experiment and directs all traffic to the best-performing version.

A/B Testing Doesn’t Have to Be Complicated.

GemX helps you move fast, stay sharp, and ship the experiments that grow your performance

Start Free Trial

Start $1 Shopify