Test typesShopify
Test what shoppers see inside Shopify checkout.
Trust badges, a delivery promise, a notice or an upsell, shown per test group in up to three places in checkout. Checkout tests need Shopify Plus.
How a checkout test works
Benchmyrk adds one block to Shopify checkout through a checkout UI extension. What the block shows depends on the shopper's test group.
Setup in Benchmyrk
Give each version its blocks: a message, a notice, trust badges, a delivery promise or a product upsell, in slot 1, 2 or 3. The control is your checkout as it is today.
Place the block in Shopify
In Settings, Checkout, Customize, add the Benchmyrk test block where each slot should appear, for example under the contact details or above the payment methods. You place it once; each test changes what it shows.
On your storefront
The Benchmyrk script gives each shopper a test group and carries it into checkout in a cart attribute, the same way every Benchmyrk test reaches orders.
In checkout
The block reads the shopper's group and shows that group's block for its slot. Shoppers in the control, or in a group with nothing in that slot, see nothing extra.
Who is counted
A shopper joins the test when the block reports their group from checkout, with analytics consent. Shoppers who never reach checkout don't dilute the result.
Paid order
Orders, revenue and gross profit per shopper are credited to the group. An upsell added in checkout also counts as its own goal.
| Step | What happens |
|---|---|
| Setup in Benchmyrk | Give each version its blocks: a message, a notice, trust badges, a delivery promise or a product upsell, in slot 1, 2 or 3. The control is your checkout as it is today. |
| Place the block in Shopify | In Settings, Checkout, Customize, add the Benchmyrk test block where each slot should appear, for example under the contact details or above the payment methods. You place it once; each test changes what it shows. |
| On your storefront | The Benchmyrk script gives each shopper a test group and carries it into checkout in a cart attribute, the same way every Benchmyrk test reaches orders. |
| In checkout | The block reads the shopper's group and shows that group's block for its slot. Shoppers in the control, or in a group with nothing in that slot, see nothing extra. |
| Who is counted | A shopper joins the test when the block reports their group from checkout, with analytics consent. Shoppers who never reach checkout don't dilute the result. |
| Paid order | Orders, revenue and gross profit per shopper are credited to the group. An upsell added in checkout also counts as its own goal. |
Blocks you can test
Plain text and Shopify's own checkout components, so every block looks like the rest of your checkout.
Trust badges
One to four badges, each an icon from Shopify's checkout set with a short label such as "Free returns".
Delivery promise
Your own wording, such as "Ships within one business day". Benchmyrk never works out a date for you.
Notice
A Shopify banner in an info, success or warning tone, with a heading and optional text.
Message
An optional heading and up to 300 characters of text, for a guarantee or a note about your packaging.
Upsell
A product from your catalog with an Add button. Shopify prices it as usual, and each add counts toward the upsell goal.
Why checkout tests need Shopify Plus
This is Shopify's rule for every app, not a Benchmyrk plan limit. Shopify's developer documentation says: "Checkout UI extensions that render on the information and shipping and payment steps in checkout are available only to stores on a Shopify Plus plan" (shopify.dev, checked 10 Oct 2026).
Benchmyrk reads your store's plan from Shopify each time a checkout test starts, and tells you plainly when it can't run. Shopify development stores can try checkout tests before you upgrade a live store.
- Not on Plus? Shopify's Thank you and Order status pages work on every plan except Starter: see Thank you page tests.
- Prices never change in a checkout test. To test what shoppers pay, use price tests or offer tests, which run on every plan.
What to test first
Start where shoppers hesitate. These are examples of tests to run, not results.
- 01
Example: trust badges or nothing
Secure payment, free returns and a guarantee near the payment step, against your checkout as it is. Judge it on orders per shopper who reached checkout.
- 02
Example: a delivery promise
"Ships within one business day" under the shipping methods, against no message. Only promise what your warehouse already does.
- 03
Example: a small add-on upsell
A low-priced item that suits most carts, such as socks with shoes. Watch order value and gross profit per shopper, not only how many add it.
- 04
Example: one message or two
If badges help, test whether adding a notice about your returns policy helps further, or crowds the page.
How long to run it
A checkout test only counts shoppers who reach checkout, so it reaches its sample sooner than a page test would at the same traffic. Most of those shoppers already intend to buy, which also means changes tend to be small.
Example: if 40% of shoppers who reach checkout place an order, spotting a rise to 44% needs about 2,389 shoppers per version. Spotting a rise to 42% needs about 9,493. Both figures assume 95% confidence and 80% power.
Run full weeks, at least two, so weekday and weekend shoppers are both in the result. Plan yours with the sample size calculator, and see how long to run a test.
- Until a test reaches its planned sample, Benchmyrk calls a winner only on a p-value that stays valid however often you look. How results are judged.
Good to know
- Shopify Plus or a Shopify development store only: Basic, Shopify and Advanced stores can't show app blocks inside checkout.
- You place the block in Shopify's checkout editor. Shopify doesn't tell apps where a block is placed, so the test page warns until the block has shown a group to a real shopper.
- One live checkout test per store, with up to three slots.
- Buy it now and accelerated checkout buttons on product pages skip the cart, so those shoppers see no block and aren't counted, in every group alike.
- Shoppers who decline analytics aren't counted, in every group alike.
- Which shipping rates and payment methods show isn't tested yet: checkout tests change content, not options.
- Preview links don't reach checkout before launch. Shopify's checkout editor shows where each slot sits.
- Checkout tests are new: covered by automated tests, not yet run on a live store.
Questions
Do I need Shopify Plus to run a checkout test?
Yes. Shopify allows app blocks on the information, shipping and payment steps of checkout only on Shopify Plus and development stores. Benchmyrk checks your plan with Shopify before a checkout test starts.
I'm on Basic, Shopify or Advanced. What can I test after the cart?
The Thank you and Order status pages, which Shopify opens to every plan except Starter. Price, offer and shipping tests also change what checkout charges, on every plan.
Will a checkout test change my prices or shipping rates?
No. A checkout test only changes what the Benchmyrk block shows. Prices, discounts and rates stay as Shopify calculates them, and an upsell is priced by Shopify as usual.
Does it affect other apps' checkout blocks?
No. Benchmyrk only changes what its own block shows. Other apps' blocks stay the same for every group.
Which shoppers are in the test?
Shoppers who reach checkout with a Benchmyrk test group and have allowed analytics. They are counted from the moment the block shows their group, whether that group has a block in that slot or not.
Find out what your checkout is missing.
We'll go through a checkout test with you: which block to place, where, and how the result is judged. Or install the Shopify app and set one up.