MY SIDE WON!!!

No, not President Obama. Not the Democratic party either and not any ballot initiatives, state constitutional amendments, or other specific candidates either.

Nate Silver won this election, and it matters to all of us.

Silver, in case you somehow managed to ignore all political polling this election season, is the polling class’s version of Moneyball’s Paul DePodesta (Peter Brand in the movie) — a hard data and analytics guy whose results proved superior to gut feelings and personal preferences.

Longtime readers will recall that KJR is affiliated with the Competence Party — a mythical organization built on eleven principles, three of which are:

  • Our decisions will always begin by examining the evidence. And we will recognize that when our cherished principles collide with the evidence, the evidence wins. Every time.
  • With new evidence we will reconsider old decisions. Without it, we won’t.
  • We will never mistake our personal experience for hard evidence. Personal experience is the evidence we know best. It’s also a biased sample.

Nate Silver is our kind of guy, and this last election just might turn out to be a turning point (given Malcolm Gladwell’s advocacy of “the power of thinking without thinking” in Blink I refuse to say “tipping point”) … where was I? Oh, yes, Silver’s dead-on predictions provide a reason for cautious optimism that in the contest for business decision-making’s soul, evidence and analysis might regain (or maybe just gain) primacy.

If they do, there’s a lesson to be learned from comparing how Nate Silver did so well to how Wall Street’s equally nerdy “quants” fared so poorly.

It’s a simple lesson, too. Here’s what it isn’t — that Nate Silver was of better character and integrity than the quants. I’m not saying he is and I’m not saying he isn’t. I’m saying that if we place our bets based on character, we’re likely to place them quite poorly.

No, it’s a matter of incentive. Silver won by having the most accurate predictions. He’s a celebrity because he called 49 states correctly. Or maybe 50, depending on whether Florida ever does declare a winner, and, if it does, who it is. In spite of all the gas he took during the run-up to the election about being biased (and really, does anyone think anyone decides who to vote for based on opinion poll results?), his only bias was in needing to be the most accurate analyst out there.

Compare that to the quants. Their financial rewards were front-end loaded — they made their money when their financial instruments sold out. They had every reason to understate risk and overstate payoff.

This doesn’t mean they did so deliberately. It’s much more likely they “knew” the picture was great (and knew the answer management wanted to hear). They sold themselves, and so didn’t dig deeply enough into the underlying assumptions of the models.

They rationalized, that is, and did so with surpassing sophistication.

Nate Silver, in contrast, didn’t just aggregate poll results. He dug into the methodologies followed by each poll to determine their relative trustworthiness, and weighted them accordingly.

Business leaders who want Nate Silver results will need to be very careful to avoid rewarding analysts who follow the quant model. They’ll be making decisions based on what the analysts tell them, so if there’s even a whiff of a preferred answer in the wind, some analysts will smell it and unconsciously fiddle things to get it.

And most managers, faced with conflicting analyses, will unfailingly choose the analysis that tells them what they want to hear.

Which is why KJR has made such a fuss, so often, about the critical role the business culture plays in all this, and in particular establishing a culture of honest inquiry.

If your “quants,” analysts, “data scientists,” or … call them by their proper name and background, statisticians … operate within a culture of honest inquiry, they will give you unbiased answers, because what you care about is whether they turn out to be right or not. Otherwise, I, Silverishly, predict their predictions won’t be reliable.

There’s a danger in the Nate Silver model, by the way, not that I’m particularly worried about it. It’s the impact of relying on aggregators rather than front-line researchers. If the lesson learned here is that aggregating the work of multiple polls is what led to Silver’s best-in-class results, that will give us fewer source polls and more aggregation of those polls. That would be bad, because without reliable polls to draw on, aggregation is nothing more than garbage in, garbage out.

On the other hand, “garbage” might be just the right metaphor for most pre-election coverage.

Entirely Irrelevant but I Just Can’t Stand It department: “High-paying jobs are available for people who learn how to run a key software program used by retail companies, several executives told Gov. Mark Dayton on Friday. And they’d like to see the state establish a training program.” (“IT execs tout Oracle software, ask state to help train workers,” Adam Belz, StarTribune, 10/26/2012).

Want to bet that next week the same characters will be complaining about too-high tax rates and the need to shrink government? And here’s a surprise: One of the companies making the pitch provides exactly this sort of training.

Speaking of retailers …

Not Entirely Irrelevant, but Close and I Can’t Stand It Either department: Just last summer Best Buy’s board of directors paid four of its top executives millions of dollars in “retention bonuses” (“Do retention bribes make sense?Keep the Joint Running, 7/2/2012).

Here we are, less than four months later, and Hubert Joly, Best Buy’s new CEO, has provided an exit-door instruction manual (“Don’t let it hit you in the glutes on your way out of it”) to three of the four executives bribed by the board to stay.

I don’t know whether Joly made the decision for the right reasons, the wrong reasons, or no reasons at all. It does seem likely the executives whose names are all over Best Buy’s current mess aren’t likely to be the right ones to guide it out of its current mess.

I’m skeptical, though, that Joly is the right person to guide it, either. He comes out of the hospitality industry, and is emphasizing improved hospitality (read “customer service”) at Best Buy as its path to success. And like it or not, (I don’t), customer service seems to have fallen by the wayside as a business strategy.

Consider air travel. Do you choose the carrier that provides the best flying experience? Pay for the first-class upgrade? Or buy the cheapest ticket? Since industry deregulation began, ticket prices have fallen more than 40% according to the Air Transport Association, while the air travel experience has become 247% more unpleasant, according to everyone I know who travels a lot.

Want something more provably quantitative? Economy-class seats are 17″ to 18″ wide. The average male human is 21.7″ wide. Do the math.

More math: Women are 15″ wide on average, so the airlines are causing men to victimize women by overlapping into their seat space, whether we want to or not.

Next consider Pricegrabber.com. It’s quite successful; all it does is let you comparison shop so you can buy from the lowest-price provider that isn’t likely to swindle you.

But this is all business-to-consumer … B2C for we acronym-besotted denizens of the 21st century. How about B2B? My one-word answer: China.

Before the advent of the world wide web, business supply chain theory focused on forming stable, long-term, trust-based relationships with suppliers. Now it focuses on shopping for the low-cost provider.

Some high-service exceptions remain. The Apple Store, for example, is legendary for its superb customer support. Bose has a similar reputation; I experienced its reality personally some years back. Apple and Bose can afford great support through a simple expedient: They don’t have to discount, or at least, they don’t have to discount so much that their margins are squeezed.

Quite the opposite: Apple and Bose products are perceived to be unique. For plenty of consumers they have no direct competitors.

Where is this taking most companies? Into a world where price and convenience are what matter most. The customer experience, no matter how phenomenal, will be the tie-breaker, nothing more. It won’t support much in the way of higher prices or better margins.

Which loops us back to Best Buy and Hubert Joly. If price and convenience are what companies win on, shouldn’t Joly be focusing on making Best Buy the best buy again, like it used to be?

Here’s why this all matters to you as an IT leader: Like it or not, our primary job in most companies is going to continue to be what it  has been for decades — helping to keep incremental costs as low as possible in every part of the business.

All that other stuff — business intelligence, improved decision-making, participation in strategy and so on? That still matters. It still matters a lot.

But it’s the surround, not the core, or at least, that’s how it is and will be everywhere IT supports businesses that win on price and convenience.

Sadly, that appears to be a growing fraction of the total.