One Knight in Product1 Jun 2023

Doing the Splits to Accelerate your Product Growth (with Andres Glusman, CEO @ DoWhatWorks & A/B Test Enthusiast)

Andres Glusman is the Cofounder and CEO of DoWhatWorks. Prior to DoWhatWorks he led product and growth at Meetup where he was a pioneer in the lean startup movement. He has been running tests online since the late 1990s and is passionate about human behaviour. We spoke about the power of split testing, when you can do it, and when you can't.

Episode highlights:

1. Split tests are a great way to work out how to grow

Otherwise known as A/B tests, split testing involves systematically varying a user experience for different groups of users & then comparing the end result to see how those changes impacted behaviour for better (or worse).

2. Four out of five split tests fail to move the needle

These are terrible odds, but the good news is that terrible odds aren't hard to make a little better. It's important to get as much signal from as many sources as possible upfront so you have the best chance of success.

3. These signals can come from anywhere

Split-testing is a great way to learn, but it's not the only way to learn. Make sure you use a mixture of experiments, surveys, qualitative inputs, feedback and any other data source you can get your hands on. It's all signal.

4. There's only so much juice you can squeeze from a lemon

You need to be careful that you're going overboard. It's possible to test too much & get caught in eternal loops. It comes down to fear of mistakes but, unless you're putting medicine in someone, you can make a mistake.

5. Yes, B2B people can do split-tests too

You don't have to have a mass-market B2C app to get good tests going. There's scope to experiment in B2B but you need to do your homework, get as much data as you can upfront & make sure you put your chips on the right part of the table.

Contact Andres

You can catch up with Andres on LinkedIn.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(275)

Eric Ries: From Corrupted to Incorruptible - How to Build Mission-First Companies That Last

On this episode, I speak to Eric Ries, entrepreneur, multiple-time founder and bestselling author of The Lean Startup. Eric has spent years working with founders, leaders and organisations on how comp...

28 Aug 1h 5min

Barry O'Reilly - How to Keep the Humanity in Artificial Organizations

On this episode, I speak to Barry O'Reilly, entrepreneur, executive adviser and author of Lean Enterprise, Unlearn and his latest book, Artificial Organizations. Barry works with senior leaders around...

18 Aug 1h 6min

Pavel Samsonov - AI Can Build the Solution... You Still Have to Design the Problem

On this episode, I speak to Pavel Samsonov, Principal UX Designer at Justworks and author of The Product Picnic newsletter. Pavel has spent his career working across UX, service design and product man...

25 Jul 1h 9min

Be Kaler Pilgrim - Where Does Product Go Wrong in PE-Backed Firms?

On this episode, I speak to Be Kaler Pilgrim, founder of Smithfield Search and original founder of Futureheads Recruitment. Be has spent more than three decades helping organisations build technology ...

2 Jul 57min

Petra Wille - Strong Product Leadership in the Age of AI

On this episode, I speak to the returning Petra Wille, product leadership coach, author of Strong Product People, and founder of the Product at Heart conference. Petra has spent years helping product ...

19 Mai 1h 5min

April Dunford - Obviously Awesome 2.0 : What's New With Product Positioning? (with April Dunford, Author “Obviously Awesome“ and “Sales Pitch“)

On this episode, I am joined for a third (and probably final!) time by April Dunford, renowned positioning expert and author of Obviously Awesome and Sales Pitch. We explore what's changed in her upda...

17 Apr 1h 13min

The State of B2B Product Management (with me, Saeed Khan and guest host Janna Bastow)

On this episode, we try something a little different. ProdPad and Mind the Product co-founder Janna Bastow joins as guest host to interview me and Saeed Khan about our recently released research repor...

2 Apr 1h 6min

CPO Stories: Nick Kenn - Winmau

On this episode, I speak with Nick Kenn, interim Chief Product Officer at Winmau, the world's leading darts brand. Nick's career spans companies such as Betfair and Redbubble, and he now operates in i...

26 Mar 55min