Resources
Run better tests on your store.
Guides, a free calculator and a glossary for planning and reading A/B tests, plus the docs and every release note. Written from how Benchmyrk works, with sources.
Guides
Sample size and test duration: how long to run an A/B test
How many visitors an A/B test needs and how long that takes: the four inputs, the formula Benchmyrk uses, worked examples and what to do with low traffic.
5 min read
Price testing on Shopify without Plus
How to show and charge different prices to different shoppers on any Shopify plan: the options Shopify allows, how Benchmyrk does it, and the limits.
5 min read
SRM: when your A/B test split looks wrong
What a sample ratio mismatch is, how Benchmyrk detects it, worked examples, the usual causes on ecommerce stores, and what to do when a test is flagged.
4 min read
Tools and references
- Free toolSample size calculatorVisitors per variant and days to run, from your baseline, minimum detectable effect and traffic. The same formula as the app.
- Glossary53 A/B testing termsPlain definitions, an example each, and how Benchmyrk handles it.Sample ratio mismatch (SRM)Minimum detectable effect (MDE)Chance to beat controlCUPEDPeekingHoldout
- DocsInstall, run tests and connectShopify and script-tag install, planning and reading tests, GA4, webhooks, MCP and the server SDK.
- Latest on the blogChecking a test every day: what it does to false winnersWe ran 1,000 simulated A/A tests through Benchmyrk's results engine and checked them daily. How often each stopping rule called a winner that wasn't there.
- Latest releaseGuides, a glossary and a sample size calculator on the website · See the changelog
- CompareHow Benchmyrk comparesSourced, dated comparisons, including where the other tool is stronger.
Rather talk it through?
We'll look at where tests could pay off on your store and show the product on demo data. Or start the free trial on Shopify.