UDEHA

A book about evidence that became a vocabulary

Ries was right about the loop, and a decade of borrowing his words hollowed it out

Eric Ries · The Lean Startup · 2011

A pitched arch opening onto a small glowing cube, shards ringing its base.

What the book is really about

Strip the case studies and Ries is making one argument. A company operating under real uncertainty cannot measure progress the way an established business does, because shipped features and hit deadlines only mean something when you already know who the customer is. What it can measure is how much less uncertain it became this month.

Everything else follows from that. The build-measure-learn loop is meant to be read backwards: decide what you need to know, decide what result would tell you, then build the smallest thing capable of producing that result. Innovation accounting is the discipline of picking that number before you start, so a good month and a busy month stop looking identical. The pivot is the scheduled consequence — a decision you put in the diary while you are still calm, not a crisis you have at the end of the runway.

That is a book about how to make decisions with almost no information. It is not a book about building software quickly, which is how it is most often summarised.

The obstacle it speaks to

The primary blockage is Building Without Buyers: the months of work that go in before a single person has agreed to pay, defended by the entirely reasonable-sounding claim that it is not ready to show anyone yet.

Ries's diagnosis of this is the sharpest thing in the book. He calls the finished-but-unwanted product a form of waste, and the word is chosen deliberately, because the alternative reading is that the work was virtuous and merely unlucky. Six months of building is not neutral. It is capital spent to postpone one uncomfortable conversation.

The loop presses on two neighbours as well. Premature Optimization — three weeks making the system survive a load nobody is generating — is exactly the work that feels most like engineering and least like exposure. And Vanity Metrics Obsession gets the clearest treatment anywhere: a cumulative number that only ever goes up cannot tell you whether anything is working, because it will keep going up during a quarter in which nothing worked. Cohorts and rates can go down, which is the entire reason they are useful and the entire reason nobody wants to look at them.

Three ideas that change behaviour

Write the belief down as a number before you build. Not we think there is demand, but we believe that of the next hundred people who see this page, at least eight will pay. The sentence is worth a fortnight of debate because it can be wrong, and a belief that cannot be wrong will never be tested by anything.

Report on cohorts, not totals. Take the people who arrived in one week and follow only them. Every improvement claim you can make survives this test or dies to it, and the totals on your dashboard are quietly rigged to survive.

Put the decision date in the diary at the start. Pivot or persevere is a much easier question in week one, when it is hypothetical, than in month nine, when it is an admission. Scheduling it is what stops persevere from becoming the default nobody ever chose.

Where it falls short

Take the argument seriously and then say the honest part: much of what the book set in motion is now the opposite of what it argued.

The minimum viable product became cover. In practice, MVP is what a team calls a bad version of the intended product when they want to ship it without owning the quality — which is not a test of anything, because a customer refusing a broken thing tells you nothing about whether they wanted the working one. Ries meant the smallest experiment that could return an answer. The word now means the smallest thing you could get away with.

The loop is run without a hypothesis. Build, measure and learn are three verbs, and only the first two happen reliably. Teams ship, they read the dashboard, they discuss it, and because nobody wrote down in advance which result would change the plan, no result changes the plan. Learning turns into its own vanity metric, and it is the hardest one to challenge, because a team that talks about learning sounds like a team that is doing this properly.

And there is a decade of cargo-culting on top. Sprints, standups, experiment backlogs and pivot decks are the visible residue of a book about evidence, and a company can carry the whole vocabulary while running on the founder's taste. The tell is simple: ask when the last experiment returned a result that changed a decision. If there is a long pause, the vocabulary is running without the method underneath it.

The case studies are also survivors, told backwards. That is not a flaw unique to this book, but the loop looks far more legible in retrospect than it does on the Tuesday you are standing in the middle of it.

What to do this week

Take the thing currently being built and write one sentence about it, in this shape: we believe that of the next [number] people who [specific action], at least [number] will [pay, book, reply] by [date].

Fill in every bracket with something checkable. If you cannot fill one in, that is not a writing problem — it is the discovery that nobody has decided what this work is supposed to prove, and finding that out is the most valuable thing this week can produce.

  • Decisions
  • The offer
  • Systems

What it speaks to

Read more in the Library

More on the shelf