When my eldest daughter Kimberly was three, she got her first ruler. She happily wandered around the house, measuring everything in sight. She did a good job, too. For example, she established beyond the slightest doubt that I weighed exactly 39 inches, 39 being the biggest number she knew.
As we discussed last week, plenty of business measures similarly apply precise numbers and inappropriate units to the wrong concepts. Doing it right matters a lot, because once you establish performance and quality measures, employees will move the measures in the desired direction.
They may drive your organization off a cliff while doing it, but they’ll move those measures. You can count on it. And you can’t finesse the problem by using weasel words like, “These measures are important, but use your common sense.” What your employees just heard is, “We know we’re supposed to establish measures, but we’re really running this company according to our daily whims.” If you don’t always want waste, for example, to go down, don’t measure waste — measure something else for which you can establish consistent performance goals. (By the way, a lot of consultants use the term “metrics,” probably for the same reason we call records “rows” or “tuples” when they’re in a relational database. That is to say, for no good reason.)
Enough carping (or trouting, if you like classier fish) – what’s the process for establishing good measures? Here are some guidelines you may find useful:
1. Decide what’s important: List the most important products and services you deliver. The list should have no more than seven entries (more and you’ll confuse people instead of enlightening them). The list should be specific, in plain language, exclude adjectives and adverbs, and should refer to results as end-users define them. For example, you don’t deliver “reliable access to corporate computing resources.” “Reliable” is an adjective which will translate to a measure later on. “Corporate computing resources” is vague and abstract. Substitute “terminal emulation services to corporate mainframe computers.”
Some IS managers like the idea of “Function Points.” Function points may be a really nifty tool for evaluating your effectiveness in developing applications, but in this context all they do for end-users is obfuscate, and that means they give you verbiage to hide behind. If you deliver data-entry screens, reports, and batch maintenance programs, say so.
2. Define, in end-user terms, goals for those results: We’re not ready for numbers yet. We’re being slow and methodical, and for a reason – to force ourselves to think through the issues. The common goals tend to invoke the gods of reliability, performance, and cost. These apply often, but not always, so make sure these are what you care about.
3. Turn your goals into preliminary measures: Here you translate English to Math. Don’t be clever, and above all don’t use indicators – it’s easy to improve an indicator without improving your business. If, for example, you think your end-users value reliable fileservers, establish “Percent Availability” as a measure. Psychologically, positive measures are probably superior to negative ones, so availability has an edge over down-time.
4. Test your measures: Make sure each measure behaves properly. In other words, imagine every situation you can, and make sure the measure always goes up when things improve, and goes down when it gets worse.
Usually, you’ll have to do some fiddling. Imagine a lawn-mower manufacturer that has decided to reduce the number of defects. Up goes a chart showing the percentage of defect-free mowers shipped each week. Week after week, the percentage edges higher as employees drive down the number of defects. That’s good, isn’t it?
Not really. Turns out, mowers exhibit two kinds of defect: bad paint jobs and defective blades that shatter, amputating customers’ feet. Because they can fix the paint problem easily, employees pay close attention to it.
Usually, you’ll have to do some tuning. In this case you’d categorize defects and assign different weights to them based on their relative importance.
5. Publicize the results: Make sure everyone sees how you’re doing. Show graphs on the wall. Share results with key customers or end-users. Don’t forget your boss. And by all means, make a big fuss with your staff when the measures improve. They’ll deserve your praise.
Measurement can be a powerful tool in the IS management toolbox. Use it well and performance will improve. Use it poorly and only the measure will improve.