Home Help Center How to Create a Product Price Testing Experiment in GemX

How to Create a Product Price Testing Experiment in GemX

Product Price Testing in GemX allows you to compare your current product price with a different price and determine which one delivers better results. You can test one product or a group of products, allocate traffic between two prices, and compare performance metrics such as Revenue and Conversion Rate.

This guide explains how to create, preview, and launch a Product Price Testing experiment in GemX.

What Is Product Price Testing?

A Product Price Testing experiment compares the following two versions:

  • The Control (Original) is the product with its current price. This version serves as the baseline for the experiment.

  • The Variant is the product version with the price that you want to test against the Original.

GemX distributes eligible visitors between the Original and Variant according to the traffic split that you select. As the experiment collects data, GemX Analytics shows how each price performs and helps you make a pricing decision based on actual customer behavior.

Product Price Testing is available on both Page Optimize and Funnel Optimize plans.

Run Smarter A/B Testing for Your Shopify Store
GemX empowers Shopify merchants to test page variations, optimize funnels, and boost revenue lift.

Before You Start

Before you create an experiment, make sure that:

  • Your Shopify store has GemX: CRO & A/B Testing installed and activated.

  • You have a clear pricing hypothesis and know which price you want to test. If you need help defining your hypothesis, refer to How to Run a Test From My Hypothesis.

  • The product that you want to use as the Control has an Active status and is available on the Online Store sales channel.

  • You have decided whether GemX should duplicate the Control or whether you want to use an existing product as the Variant.

Important note: The price should be the only difference between the Control and Variant. Both products should use the same title, description, images, options, and other product information so that the experiment can isolate the impact of the price change.

How to Set Up a Product Price Testing Experiment

Step 1: Create a New Experiment

From your Shopify Admin, open Apps > GemX: CRO & A/B Testing and click Create new experiment.

Create a new experiment from the GemX dashboard

Then select Product Price Testing as the experiment type.

Select Product Price Testing in GemX

GemX will create a new Product Price Experiment with the Draft status.

create new product price experiment with draft status

Step 2: Select the Control Product

In the Product price setup section, select the product whose current price will serve as the baseline.

choose product for the control

You can search or browse the product list to find the appropriate product, then click Select product.

Select the Control product for a Product Price Testing experiment.

Important note: GemX only displays products that have an Active status and are available on the Online Store sales channel.

After you select a product, GemX will add it to the experiment as the Control.

the 'control' product price

Step 3: Set Up the Variant Product

The Variant contains the price that you want to compare with the Original. GemX provides two ways to prepare this product.

Click Set price for the Variant

Option 1: Duplicate the Control and Set a New Price

This option is suitable when you have not prepared a separate Variant product.

Select Duplicate Control to let GemX automatically duplicate the selected Control product and set it as the Variant one.

The duplicated Control product will serve as the Variant one

Duplicate the Control product to create a price-test Variant.

From here, you can click Edit price to access the duplicate in a new tab. When the Shopify product page opens, update the price for the product or its individual variants.

Edit the Variant product price in Shopify

Once done, click Save in Shopify, and return to GemX to continue the experiment setup.

click Save to save your test price

Important note: Do not change other product information on the duplicate. The test price should be the only difference between the two products.

Option 2: Choose an Existing Product

This option is suitable when you have already prepared a separate product with the price that you want to test.

choose existed product

Select Choose existing product, then search for and select the appropriate product.

You can click Edit price to open the product in Shopify and check its current pricing.

you can edit the current price of the variant product

If you update the price, click Save in Shopify before returning to GemX. You should also confirm that the selected product matches the Control in every aspect other than price.

Step 4: Review the Experiment Settings

The settings panel at the top of the experiment shows how GemX will run the test. By default, the experiment displays the following settings:

  • The Winning metric is Revenue.

  • The Traffic split assigns 50% to the Original and 50% to the Variant.

  • The Device setting includes all devices.

  • The Visitor setting includes all visitors.

  • The Traffic source setting includes all sources.

  • The Market & language setting includes all markets.

advanced settings for product price testing

If you want to change the traffic allocation, click the edit icon next to Traffic split. You can then move the slider to adjust the percentage of eligible visitors assigned to each version.

Click the edit icon to adjust the traffic split

A 50/50 split usually provides the most balanced comparison because both versions collect data at a similar rate. To understand other allocation options, refer to How Does Traffic Splitting Work in GemX?.

Step 5: Save and Preview Both Versions

After both products are ready, review their names, Shopify links, and displayed prices. Click Save when all information is correct.

Before you launch the experiment, use Preview to inspect both the Original and Variant.

Preview the both products and their current price

During the preview, confirm that:

  • Each version displays the intended product price.

  • Every product variant displays the correct price.

  • Customers can add the product to their cart successfully.

  • The cart and checkout display the expected price.

  • No product information other than the price has changed unintentionally.

If you identify an issue, return to Shopify to correct the product before starting the campaign.

Step 6: Start the Experiment

When both versions are ready, click Start experiment. The confirmation dialog will display the experiment information for one final review.

Click Start experiment to laucnh your test

After you confirm, GemX will start the experiment and distribute eligible visitors between the Original and Variant according to your traffic split.

Live product price testing in GemX

Manage Your Product Price Experiment

After the experiment goes live, GemX Analytics allows you to compare the Original and Variant using Revenue, Conversion Rate, and other available metrics.

Check your product price experiment analysis

Try to keep both products unchanged while the experiment is active. Additional product changes can introduce new variables and make the results more difficult to interpret.

The following guides can help you monitor the test and decide when the results are ready for evaluation:

Need more hands-on support?
Book an onboarding call to get guided setup and expert help.

FAQs About Product Price Testing

Why Can’t I Find a Product in the Control Product List?
GemX only displays products that meet the experiment requirements. Open the product in Shopify and confirm that its status is Active. The product must also be available on the Online Store sales channel.

After you update the product, return to GemX and reopen the product picker. If the product still does not appear, refresh the GemX app so that it can load the latest product information from Shopify.
When Should I Choose an Existing Product for the Variant?
The Choose existing product option works best when you have already prepared a separate product with the price that you want to test.

Before you add the product to the experiment, compare it with the Control and confirm that both products use the same title, description, images, options, and other relevant information. Only the intended price should be different.

If you have not created a separate product, Duplicate Control and set price is usually the simpler option because GemX creates the Variant from the selected Control.
Can I Change Product Information Other Than the Price?
GemX recommends keeping all product information except the price consistent throughout the experiment. If the Variant also uses different images, descriptions, or product options, the results will not show whether the price or another change caused the performance difference.

If you want to evaluate product content or page design, create a separate experiment for that change. Each experiment should answer one clear hypothesis so that its results remain easy to interpret.
Realted Topics: 
help-center
,
Price Testing

A/B Testing Doesn’t Have to Be Complicated.

GemX helps you move fast, stay sharp, and ship the experiments that grow your performance

Start Free Trial

Start $1 Shopify