Did we give up too easily?

We used to automate processes. Back in the early days, before we called ourselves Information Technology, Information Systems, or Management Information Systems, that’s what we did.

We didn’t optimize processes, orchestrate them, or develop metrics to assess their performance. We obliterated them, replacing them with computer programs that called on humans only when an input or decision was required the computer couldn’t handle on its own.

To be fair, we didn’t always do this all that well. Some of these automations sped up business processes that contributed little business value beyond keeping some people busy who otherwise might have caused all sorts of mischief.

There were also quite a few cases where the program paved a metaphorical cow path, faithfully reproducing in automated form every process step that had previously been executed by a bored human being, even if these steps had nothing at all in common with what an engineer might construct if given the goal and a blank sheet of paper.

But even with these flaws, IT’s predecessors delivered orders-of-magnitude improvements in business efficiency. And then Something happened, and suddenly, overnight, IT became the biggest bottleneck to business improvement.

My theory is that Something = Methodology, but perhaps I’m being unfair. I’m not, after all, a business historian, so while I lived through some of the mayhem, my personal mayhem experience isn’t a statistically significant random sample.

Based on my personal experience, direct and second-hand through colleagues, here’s the way process automation happened back in the good old days we neocodgers see in the warm glow of imperfect memory:

Someone from the business would drop by EDP (electronic data processing, IT’s ancient forebear), sit on the corner of a programmer’s desk, and ask, “Can you get the computer to do x?”

After a short discussion the answer was either yes or no, and if it was no, a longer discussion usually led to a useful alternative the computer was capable of.

The programmer would go off and program for a week or so and call the business person back to review the results and suggest course corrections. In not all that long the computer had automated whatever it was the business person wanted automated.

Usually, in the interim, other notions occurred to the business person, who, while reviewing how the solution to the initial request was progressing, would ask, “Can you also get the computer to do y?”

Over a span of a few years these solutions to business problems accumulated, turning into the big legacy systems many businesses still rely on.

If we’d only had the wit to call what we were doing a methodology and label it Agile.

Had we done so we might have avoided quite a lot of the discreditation that happened to IT during the years of waterfall wasteland that, starting in the early 1980s, transformed us from the department that automated stuff, generating enormous tangible business benefits, to the Department of Failed Projects.

For that matter, had we continued in our quest to automate the bejeezus out of things in our naively Agile sort of way, disciplines such as Lean and Six Sigma might never have achieved their current level of prominence.

Not that Lean and Six Sigma are terrible ideas. In the right contexts they can lead to solid business improvement.

What they’ve turned into for some businesses, though, are Strategic Programs, and religions for some practitioners. For these devoted adherents they’re the answer to all questions, before actually asking the questions.

What they’ve also turned into is a sort of IT-less shadow IT — a way to improve business processes without any need to involve IT, and, more important, without having to ask the Department of Failed Projects to deliver very much.

Let’s imagine the executive team at some enlightened (or misguided — your call) company reads the above and, convinced, calls to ask how best to return IT to its process automation roots. What would a modern version look like?

Mostly, it would treat each process as a black box that turns inputs into outputs. IT’s job would be to understand what the inputs and outputs are, and to develop, through a combination of inference and listening to the experts, an algorithm that reliably turns the defined inputs into the desired outputs.

That’s it — the entire methodology in one paragraph, understanding that “algorithm” can hide a lot of complexity in its four syllables.

Might this work? Beats me. It’s an idea I’m just starting to play with. Next week I might strenuously disagree with this week’s me.

Don’t hesitate to weigh in.

I can’t help it.

Gartner has discovered the need for “Bimodal IT.”

What I can’t help: Pointing out that once again, Gartner has discovered something KJR’s subscribers (back then it was InfoWorld’s “IS Survival Guide”) read about a long time ago … in this case, 1996, when I wrote:

You can’t ignore the Web, and so, probably for the first time, you have to start thinking about serving your company’s RPCs (real paying customers). That will change everything.

Remember when you did feasibility studies, requirements analyses, external designs and internal designs before you got around to coding systems a few years later? Forget it. You’re going to start working in marketing time.

What’s marketing time? That’s how long your company takes to get new products, services, and pricing programs into the public awareness to beat your competition. Years? Forget it. You’re going to be working in months. Sometimes weeks. That means a whole different way of designing and building systems.

Well, better very, very late than never at all, and give Gartner credit for publicizing the concept.

So bimodal IT it is, and publishing precedence be damned.

What you care about is making bimodal IT happen. On that subject there’s a point neither Gartner nor I have explored: The challenge of culture.

Culture is loosely defined as “how we do things around here.” It’s a collection of informal, unwritten rules, enforced with iron discipline through the application of peer pressure.

IT started by automating a lot of the drudgery associated with core accounting. It had a batch-oriented culture which was fine: Accounting is a batch-oriented discipline. It had no tolerance for defects, which also was fine: Accounting balances the books to the penny.

Speed? Speed wasn’t all that important compared to making sure systems provided reports everyone could trust. And by the way, with punch-card-driven batch systems that provided accounting reports, there wasn’t a lot of opportunity for ambiguity when the question was whether a system did what it was supposed to do.

For the most part, the mental habits IT acquired in learning to support accounting are still valid … when it comes to supporting accounting and other “systems of record.” Even if the underlying systems rely on overnight batch processing, they’re supporting a discipline that considers the end of the month and end of the year to have mystical properties.

Okay, that was mean. A more charitable view is that unlike most other departments, Accounting cares enough about the accuracy of its numbers to verify them on a regular basis.

And this emphasis on accuracy reinforces the traditional slow-and-steady culture that pervades so many IT organizations.

Enter bimodal IT. Systems of record don’t go away, and continue to rely on this slow and steady way of viewing the world. But now, coexisting with slow and steady is a need for an entirely different IT culture — one obsessed with speed; one that recognizes when systems have reached the exalted state of good enough and whose members are happy to put good-enough into production.

It’s a culture where late is just as serious a defect as a calculation error, and where poor aesthetics (the marketing buzzword is “ugly”) gets as much attention as overall functionality.

Want to make bimodal IT happen? We can talk methodologies and architectures until we’re blue in the face (speaking of aesthetics) and when we’re done we can’t escape the need for two radically different IT cultures coexisting in the same organization.

The question is whether this is feasible or fantasy.

It’s a good question. For guidance, look at differing cultures in the business as a whole. The view isn’t promising: Accountants talk about the bureaucrats in HR, who sneer at the bean-counters in Accounting in return. Marketing complains about the propeller-heads in IT, who make snide comments about the marketing crazies in return.

And so on. In the business at large, different cultures clash.

How about inside IT? Still not so promising. Among sysadmins members of the Unix and Windows subcultures tend to disrespect each other. Elsewhere, IT operations staff have been known to gripe about developer teams trying to push buggy code into production, while the developers in question gripe about the bureaucracy of the change control board (CCB).

Think that’s bad? Just imagine the resentment of slow-and-steady Accounting developers. While they still have to deal with the CCB, the DevOps teams supporting Marketing practice continuous integration and get to bypass the CCB altogether.

That’s your dilemma. You have to foster two very different IT cultures. And you know before you start that they’ll almost inevitability clash.

* * *

What should you do about it? Great question. But it will have to wait until next week. With any luck I’ll come up with something between now and then.