Product Discovery Done Right: Lean Product, Zume Pizza's $420M Failure, and a Live Runkeeper Teardown - Product Builder Podcast episode with Eyal David
00:38:07

Product Discovery Done Right: Lean Product, Zume Pizza's $420M Failure, and a Live Runkeeper Teardown

Host: · Guest: Yaniv Yaakubovich · About the host

In this episode

  • Real discovery means talking to customers as frequently and deeply as possible, even before you build; without it, the product team turns into 'technicians' who build according to the CEO's emails.
  • The Lean Product method is organized into eight blocks — from the business and its problems, through the users and the outcomes they expect, to the solutions, and finally the hypotheses and the things you must test the fastest.
  • Segmenting the audience is critical: 'when you sell to everyone, you sell to no one' — like Runkeeper's challenge versus a more focused audience.
  • In a small startup with no traffic there's no statistical significance; you look for trends and back them with qualitative testing and conversations with customers.
  • Before building a new feature, use a resource you already have — for example, changing the microcopy of a notification that lands the user in the payment flow with personal context.
  • All tests must be focused on the users and their outcomes, not just on the business — that's how you create sustainable products that customers love.

Episode Description

Yaniv Yaakobovich, a product management consultant and co-founder of Verve PM, explains how to do Product Discovery right — namely, talking to customers as frequently and deeply as possible before you build. Through the $420 million failure of the startup Zume Pizza, and a live exercise of the Lean Product method on the running app Runkeeper, the episode shows how to break a business down into users, outcomes, solutions, and testable hypotheses — even when there's no traffic and no statistical significance.

Read the full transcript
Full transcript with speakers and timestamps

Selected quotes

“There was one small problem. Or big. That we didn't talk to customers.”
— Yaniv Yaakobovich
“The right way is to talk to customers. As frequently as possible. And as deeply as possible.”
— Yaniv Yaakobovich
“When you sell to everyone, then you sell to no one, probably.”
— Yaniv Yaakobovich

Questions & answers

What is the Lean Product method that Yaniv teaches?

A discovery framework Yaniv learned at PayPal and brought to Israel. It's built from eight blocks: at the top, the business and its problems/outcomes; below it, the users and the outcomes they expect; between them, a list of solutions; and at the bottom, three blocks of the hypotheses and the things you need to test the fastest to validate them.

Why is Zume Pizza considered an example of a discovery failure?

The startup raised hundreds of millions of dollars and built robots and trucks for baking pizza, but the product team barely talked to customers — they built according to the CEO's emails and deals. The result: burnt pizza, a lack of basic coupons, and products that didn't answer a real need.

What is Runkeeper's main challenge as a product?

The model is a B2C subscription (a premium account), and that's always a challenge. The free version is 'good enough' — tracking and history exist for free — so it's hard to give enough value in premium for people to upgrade, without hurting the free experience. Since the acquisition by Asics, there's an added challenge of linking the conversion to selling shoes and gear.

How do you approach testing in a small startup that has no traffic?

You don't try to reach statistical significance that will take forever. You define that you're looking for trends and back them with a lot of qualitative testing and conversations with customers. If you see that 50%-60% don't do the action you expected — you stop and consider, even without significance.

What is the first step Yaniv recommends a Runkeeper PM start with?

A simple system of notifications that land the user in the payment flow, with context of who they are and what's known about them — using an existing resource and changing the microcopy, instead of building a new feature from scratch.

Product Management Product Discovery Customer Discovery Lean Product Segmentation A/B Testing Startups Product Management