Growth experimentation

Create a structured experimentation system that prioritises high-impact tests, produces valid results, and builds institutional knowledge with every cycle.

Growth experimentation

Introduction

I have been testing since 2010, before most B2B companies even knew what a growth experiment was. I am CXL certified in experimentation, I built the testing programme for NU.nl (the largest news site in the Netherlands), and I have run A/B tests for dozens of brands across SaaS, e-commerce, and lead generation.

Most companies either skip testing entirely or run random experiments without a clear plan. Both waste time. The ones that grow fastest have a simple system: a backlog of ideas ranked by potential impact, a clean process for running tests, and a habit of documenting what they learn so every experiment builds on the last.

This playbook gives you that system. You will learn how to collect and prioritise experiment ideas, write hypotheses that actually teach you something, set up tests properly, and turn results into repeatable wins. No statistics degree required, just discipline and curiosity.

Chapters

1

Building your backlog

Random testing wastes time and teaches you nothing. Learn how to collect experiment ideas systematically and prioritise them based on potential impact so you always know what to run next.

2

Creating strong hypotheses

Most experiments fail before they start because the hypothesis is vague or untestable. Learn how to write hypotheses that are specific enough to prove or disprove and tied to metrics that matter.

3

Setting up experiments

A winning test means nothing if the setup was flawed. Learn how to configure experiments properly in VWO, ad platforms, and email tools so your results are actually valid.

4

Analysing and acting on results

Statistical significance is just the beginning. Learn how to interpret results correctly, avoid false positives, and turn winning experiments into permanent improvements across your growth engines.

5

Run your monthly experiment cycle

Execute the full experiment loop each month: select from your backlog, launch, monitor, close, and document what you learned.

6

Reprioritise backlog by impact and effort

Re-score your experiment backlog each quarter using updated data so you always run the highest-leverage tests first.

7

Compound learnings across experiments

Build a knowledge base from past experiments so new tests build on proven insights instead of starting from scratch every time.

8

Scale winning experiments across channels

Take validated wins from one channel and systematically test whether they work in others to multiply the impact of what already works.

Growth experimentation

tools

VWO

VWO

VWO provides A/B testing, personalisation, and behaviour analytics to optimise website conversion rates through data-driven experimentation.

Rating

Rating

Rating

Rating

Rating

From

393

per month

Hotjar

Hotjar

User behaviour analytics platform showing heatmaps, session recordings, and feedback from real website visitors. Understand exactly how people use your site.

Rating

Rating

Rating

Rating

Rating

From

39

per month

Microsoft Clarity

Microsoft Clarity

Microsoft Clarity provides free session recordings, heatmaps, and user behaviour analytics without traffic limits or time restrictions.

Rating

Rating

Rating

Rating

Rating

From

0

per month

Notion

Notion

Flexible workspace for docs, wikis, and lightweight databases ideal when you need custom systems without heavy project management overhead.

Rating

Rating

Rating

Rating

Rating

From

12

per month

Books

Lean Startup

Eric Ries

Rating

Rating

Rating

Rating

Rating

Lean Startup

A disciplined approach to experiments. Define hypotheses, design MVPs and learn before you scale.

Hacking growth

Sean Ellis

Rating

Rating

Rating

Rating

Rating

Hacking growth

A practical framework for experiments and insights. Build loops, run tests and adopt a cadence that ships learning every week.

Wiki

Sample size

Calculate how many users you need in experiments to detect meaningful differences and avoid declaring winners prematurely based on insufficient data.

P-value

Interpret experiment results to understand the probability that observed differences occurred by chance rather than because your changes actually work.

Minimum viable test

Design experiments that answer specific questions with minimum time and resources to maximise learning velocity without over-investing in unproven ideas.

Hypothesis testing

Structure experiments around clear predictions to focus efforts on learning rather than random changes and make results easier to interpret afterward.

Control group

Maintain an unchanged version in experiments to isolate the impact of your changes and prove causation rather than correlation with external factors.

Statistical significance

Determine whether experiment results reflect real differences or random chance to avoid making expensive decisions based on noise instead of signal.

A/B testing

Compare two versions of a page, email, or feature to determine which performs better using statistical methods that isolate the impact of specific changes.

Monthly Recurring Revenue (MRR)

Track predictable monthly subscription revenue to monitor short-term growth trends and make faster decisions than waiting for annual revenue reports.

Growth hacking

Deploy fast, low-cost experiments to discover scalable acquisition and retention tactics, learning through iteration rather than big bets.

Related topic

Growth management

How do you make all four engines work together instead of in isolation?

Growth experimentation

Other playbooks

Data & dashboards

Data & dashboards

Build the dashboards and data pipelines that show your growth engines in one view so you can spot bottlenecks and make decisions in minutes, not meetings.

Planning & project management

Planning & project management

Set up project boards, sprint rhythms, and communication habits that keep growth work on track without endless status meetings or lost context.

Increase pricing

Increase pricing

Raise prices strategically through better packaging, value communication, and positioning so revenue grows without adding customers.

Increase line items

Increase line items

Develop cross-sell and upsell motions that expand accounts by solving more problems for customers who already trust you.

Increase contract length

Increase contract length

Build retention strategies, success milestones, and renewal processes that keep customers committed for longer periods.

Improve win rate

Improve win rate

Strengthen your closing approach — objection handling, negotiation, and follow-through — so more proposals turn into signed contracts.

Keep reading