Run growth experiments like a product team
Growth
By Ali
Most companies run tests the way people buy lottery tickets: occasionally, hopefully and without a plan. Growth teams that win treat experiments as a product with a backlog, a rhythm and a scoreboard.
Start from the biggest leak
Before testing button colours, find where customers drop off. A simple funnel report usually shows one step losing far more people than the rest.
Write a hypothesis you can lose
“If we show delivery dates on product pages, more mobile shoppers will reach checkout, because uncertainty about delivery is the top reason in our exit survey.” A good hypothesis names the change, the metric and the reason.
Prioritise ruthlessly
- Impact: how many customers and how much revenue it touches
- Confidence: how much evidence supports it
- Effort: how many days it takes to build and measure
Keep a weekly rhythm
Thirty minutes every Monday: review last week’s results, decide what ships, choose the next tests. Share the losses as openly as the wins.
Know when to stop a test
Decide the sample size before launch and do not peek at results every morning. Small sites rarely have the traffic for tiny changes, so test bold ideas that could move the metric by ten per cent or more, and use qualitative research to explain why a test won or lost.
Keep a library of learnings
Every finished experiment gets a one-paragraph summary: what we changed, what happened and what we believe now. After a year, that library is worth more than any single win, because new team members stop repeating old tests.
At Atlas Outdoor, 24 tests over five months lifted mobile conversion by 54%. Only nine of them won; the system made all of them useful.