Competing Against Luck (book review)

Clayton Christensen developed The Innovator’s Dilemma to help established organizations understand that when they serve their most profitable customers it leaves them susceptible to innovators who enter the low-end of the market but serve the customers better and move up the market to become the newly established organization.

There’s also a solution.

Why were innovators successful?

They’re undercapitalized, under-experienced, and underwhelming relative to the established company.

The answer was Jobs To Be Done, told in Christensen’s et al. book Competing Against Luck.

Jobs is a way to describe the functional, social, and emotional progress a person wants to make in a given context.

Christensen’s work includes the milkshake example, where he and a team found that people bought milkshakes first thing in the morning. They ‘hired’ the shake to entertain them on the commute and provide some calories. They also finished before work so as not to be judged by their colleagues.

Christensen’s experiences included buying his son a milkshake. This is a different set of functional, social, and emotional progress a person wants to make in the context of being a dad in the afternoons.

This contrast is Jobs.

It’s work to find, but worth it. The process of understanding the job, the context, the progress, and all the parts creates a sustainable advantage (aka profits and avoidance of the market mechanism).

Think about Netflix. If a capitalized and connected Hollywood mogul wanted to compete with Netflix, they could buy all the streaming rights but that misses all the work: physical networks, social networks, technology, production, and so on.

Jobs exist for solutions to enduring and persistent problems. Snapchat was preceded by the IM, which was preceded by the extra-long telephone cord which was preceded by passing notes in class.

Kids talking to each other without adults’ oversight is an enduring and persistent problem.

A large example from the book covers the Southern New Hampshire University online program. Once the staff adopted a Jobs perspective they noticed two sets of customers.

The first was conventional high school graduates who wanted a conventional college experience.

The second was adult learners who needed information, training, and accreditation yesterday.

SNHU found the context was a parent alone at the kitchen table at night and looking for immediate information. Their functional progress was training and certification. Their emotional progress was as role models for their kids.

A university seems like a singular thing. But in the context of these two customers, it must act differently.

With hindsight, Jobs stories are obvious – and we’ve shared plenty – but to find them takes clustering data. The interviews are hard, especially relative to the alternative innovations of: cheaper, faster, sooner, shipped, or a different color.

Some clustering insights:

GM’s OnStar division listened to customer calls and found that it was people who were in an unfamiliar place and wanted to feel safe. OnStar wasn’t directions so much as security.

V8’s product manager saw things through the eyes of their customers who wanted to “eat” their fruits and vegetables. V8 is a juice whose competition isn’t in the juice aisle.

Intuit found that customers didn’t want tax optimization so much as tax minimization. Make this painless, fast, and damn sure I don’t get audited we don’t have time for that.

Along with Bob Moesta’s books, Competing Against Luck is the best introduction to Jobs. Though a touch academic, the sections are fast and full of examples and theories.

1400s Portugal’s Innovator’s Dilemma

It’s the late 1400s and Christopher Columbus needs money.

People know, (Gutenberg, 1440) the world isn’t flat. But people don’t know what’s out there.

Marco Polo (1295) reported that there’s a lot out there and it’s not that far. But there’s no consensus that westward from Portugal, Spain, and England is anything more than some rocky island.

“By late 1491,” Christopher Columbus, “is about ready to give up.” “England wasn’t going to (fund him)” said Dominic Sandbrook, “the most plausible alternative to Spain doing it is Portugal but their eastern ventures are successful.” Portuguese sailors found a route around the tip of Africa to India. They don’t need to explore.

The innovator’s dilemma exists within the explore/exploit dichotomy because of incentives: ESPN go brrrr. If it were obvious, there would be no dilemma.

This is Dali’s The Discovery of America by Christopher Columbus at the St. Petersburg Dali museum (January ’22). It’s not a large museum but these paintings are huge – 14 feet tall!

Sandbrook says that Columbus embraced his namesake who carried the poor and weak across a river. Columbus felt like he ‘carried Christ’ across the Atlantic. That’s how he saw himself. That context gives that painting a different meaning.

If pre-1900s trade excites you, look up For All the Tea in China by Sarah Rose. It’s the of Scottish botanist Robert Fortune’s EIC’s sponsored trip to sneak tea out of China.

NBA’s broadcast innovation dilemma

Disruption theory (2:00 minute YouTube HBR explainer) describes how leading companies serve their customers through product improvements rather than invention.

Keurig’s innovation was capsule coffee and sustains their company with ideas like Brew ID which “recommends recipes with easy step-by-step instructions.”

It’s an innovation dilemma because sustaining innovations makes the money printers go brrr, like at ESPN.

These sustaining innovations fail when the customer Jobs-to-be-done changes.

“We started doing it for free,” Nate Duncan said on Wharton Moneyball in December 2022 about his NBA Strategy Stream show, “with the idea of eventually doing something like this back in the 2016/2017 season. We did it pretty much unpaid – our Patreon subscribers would throw us a few bucks but they weren’t obligated to – and we just built up a lot of reps doing it in the bad old days.”

Think about that. Duncan and his partner Danny Leroux worked “pretty much unpaid” to broadcast NBA games.

But they found an audience. They found an adapting JTBD.

Disruption theory also describes how leading companies can create both sustaining and disruptive innovations. One aspect is a separate P/L. But that takes financial, temporal, and status capital. Within any organization, what executive is going to suggest an unprofitable bet to create something people might want? No way.

But that’s disruption theory.

Should you build *magic*?

When talking about Jobs To Be Done, Bob Moesta notes that there are two ways to innovate. Supply-side innovation is internally driven. Organizations know their capabilities, limitations, and business model and build from that position. This type of innovation is more efficient, has limited scope (and costs!), and uses the language of the organization.

Alternatively, demand-side innovation is externally driven. Jobs theory is demand side as is the Mom Test and IDEO’s invention through iteration. This type of innovation includes prototypes and feedback, lots of questions, and uses the language of the customers and consumers. 

“Any sufficiently advanced technology,” Arthur C. Clarke wrote in 1962, “is indistinguishable from magic”. 

That quote highlights this aspect. Technology users want it to feel like magic. Builders use advanced technologies.

Face ID is magic. 

“What Apple did with Face ID was take a really hard computer science problem, and using a lot of complicated technology, create something with a simple name. I intuitively know what Face ID is just from the name. It’s also intuitive to use. I looked at it and was in. There’s an opportunity to do something like that (for crypto). Multiparty computation is not the right marketing term for what the average person might use.”

Brian Armstrong to Ben Horowitz. 

Uber is magic. 

“At first glance Uber might just look like a simple app—after all, the premise was always to hit a button and get a ride. But underneath its deceptively basic user interface was a complex, global operation required to sustain the business. The app sat on a vast worldwide network of smaller networks, each one representing cities and countries. Each of these networks had to be started, scaled, and defended against competitors, at all hours of the day.”

Andrew Chen, The Cold Start Problem.

The wrong lesson here is to think customers want magic. It’s situational! Shopping and buying are different

There is no best way to innovate, only trade offs. But Clarke gives us a nice framing for technology.

ESPN’s innovation dilemma

One pant leg on is a local maximum. One problem is solved but the larger set is not.

Clayton Christensen’s series on disruption and innovation is about local maximums.

Money machine go brrr is a strong incentive to keep printing. Maximizing a profitable business makes sense, which is the dilemma! Organizations find themselves looking good in one pant leg.

The solution to local maximums is exploration. But this is costly – money, status (uh oh), time, reputation. Plus the stakeholder’s opinions.

The solution, Clayton Christensen writes, is separation. Different groups with different strategies, finances, and when possible physical locations.

Solutions via exploration are important because customer and consumer preferences – their JTBD – change.

“We are all under the Disney umbrella,” Brian Burke said, “ESPN.com is a huge enterprise with an army of people and is a revenue generator in so many ways. It’s difficult to change course. FiveThirtyEight is agile, nimble, and experimental so (publishing there) was a great opportunity”.

ESPN.com go brrr.

Which is the dilemma, and Disney/ESPN uses FiveThirtyEight as the exploration solution. Who knows if Burke’s writing approach is better, but the publishing strategy is a solution to the innovator’s dilemma.

“The next ESPN.com” will be different. Whatever is next will have a different business model than the current Great Firms (Christensen’s subtitle). Whatever is next will have a different maximum. It will be a short vertical video or the degradation of the sport monoculture or something we can’t predict today.

Or even an analytic forward analysis from Brian Burke.