What’s sad and surprising about architecture is how seldom anything good comes of it.

Or, for that matter, how seldom anything at all comes of it.

I have no statistics, only experience … personal and anecdotal … and that experience says most attempts to institute an enterprise technical architecture management (ETAM) function die on the vine.

And of those that don’t die, most turn into bureaucracies — ivory-tower white-paper factories that demonstrate the brilliance of their authors much more than they promote effective technology implementations.

What goes wrong?

It starts, I think, with the goal of most ETAM implementations. They take the classic consulting approach: Document current state, design desired future state, document the gaps, and develop a plan to close them.

This is, to all appearances, perfectly logical. And familiar.

It’s also perfectly waterfall, complete with waterfall’s crushing shortcoming: By the time you reach the finish line, not only has the finish line moved somewhere else entirely but you aren’t even playing the same game anymore.

By the time you’re able to start implementing the ideal future state you’ve designed it’s already lost relevance.

Finish implementing it? If you have a good pair of binoculars you can see the continuously evolving ideal future state accelerating into the distance, the rate with which you can close the gap paling in comparison to the rate with which the gap grows in magnitude.

And that doesn’t take into account the additional delays that result from the corporate project governance process. After all, architecture-driven projects have to flow through it right along with all the others, competing for staff, budget and capital with everything else that might provide important business value.

So tear out the goal. ETAM’s purpose isn’t to get the enterprise to its ideal future state because it can’t ever get the enterprise to its ideal future state.

Agile ETAM sets a different goal: To shape events so that the enterprise is constantly migrating to a better architectural state.

Don’t sneeze at better. Better is better than not getting any better. Far better.

Which is why, for the past several years, I’ve been developing an agile approach to enterprise technical architecture management.

Not enterprise technical architecture management in support of Agile, which is a different matter, although Agile ETAM does support Agile development quite nicely.

Agile ETAM is, in fact, doubly agile. It (1) improves the enterprise technical architecture iteratively and incrementally, and (2) implements an ETAM function within IT iteratively and incrementally as well.

It starts with a foundation, as most architectures do that are intended to support enduring structures and not tents or movie sets. In this case the foundation consists of:

  • A sketch of the business architecture and strategy IT has to support (a sketch is generally sufficient for IT’s needs).
  • Current-state issues (for example, here).
  • Design goals — a consolidated view of what support for the business strategy and architecture plus remediation of current state issues looks like.
  • Design principles — what “good” means.

The design principles are the stable core of it. Business strategies may come and go, but IT’s decision to (for example) adopt an ERP-centric application and information layer instead of a federated architecture will inform project design decisions throughout.

As will the principle it leads to: “Use the module that comes with the ERP suite when it’s close enough, and when it isn’t, buy when we can and build when we have to.”

Many enterprises adopt the principle of never upgrading to stay current, only when new capabilities that will provide direct business value warrant it.

It’s almost always a mistake, because once you’ve skipped a couple of releases, getting current is almost as painful as converting to a different product entirely. Regardless, one of your principles should be about release currency, and just in case this isn’t clear, “we’ll make case-by-case decisions” is the opposite of operating from a stable core principle.

Once you’ve established a core set of design principles — maybe a dozen of them — you’re in a position to influence things, because from this point forward every project team has the design principles to use as a touchstone against which to gauge its design decisions.

The rules here are simple:

  1. Every project has to make design decisions consistent with the design principles.
  2. Every project has to leave the technical architecture more consistent with them than it was when the project started.

Is this all there is to Agile ETAM? Of course not.

It’s akin to Agile development methodologies, which start by building the smallest irreducible core of a system and then add on to it.

This is ETAM’s smallest irreducible core.

Jimmy Dean should never have recorded “Big Bad John.” His squeaky tenor just doesn’t fit the lyrics — they demand a Johnny Cash baritone.

Still, Dean got some things right — his sausages, for example.

And, he gave us a useful quote: “I can’t change the direction of the wind, but I can adjust my sails to always reach my destination.” It will never make it on despair.com, but that’s okay. Cynicism is more fun, but figuring out how to make things work is what pays the bills.

My last two columns have talked about the direction of the wind (“An imperfect storm,” 2/24/2014 and “More storm warnings,” 3/4/2014) — trends you can’t do much to affect, and do have to respond to:

  • Cloud 3.0 — enterprise-class computing that includes cloud-based applications.
  • Shadow IT — the growing amount of information technology implemented without IT’s involvement.
  • The digital enterprise — a grab-bag; right now its most important elements are smart products, the so-called “internet of things,” and all of the opportunities possible when you put the two together.
  • Income disparity — and the rising demand for luxuries and uniqueness by those on the lucky end of this trend.
  • The rise of business practices over processes — practices being the way to organize how work gets done so as to be able to deliver uniqueness.

Your challenge: Adjusting your sails so IT can at least survive these trends and maybe even enjoy the outcome. Suggestions:

Get the relationship right. I know you’re tired of hearing me rant and rave about moving beyond the supplier/internal-customer relationship model to a fully collaborative alternative. I also know I talk to IT leaders all the time who haven’t made the transition.

It matters in this context because in your brave new world of embracing shadow IT, a collaborative relationship is what will stop shadow IT from become rogue IT.

Automated regression testing. Take this to the limit, and beyond.

Cloud 3.0 means multi-cloud plus inside-the-firewall infrastructure provisioning. Multi-cloud, and especially multiple cloud solutions managed directly by the lines of business, means patch management and version management move outside IT’s control.

With automated regression testing you might be able to persuade the lines of business that IT should test cloud-vendor-induced configuration changes before they’re put into production. Without it, IT will once more be positioning itself as a bottleneck rather than an enabler.

Redefine the “I” in “IT.”

Except for shadow IT, all of these trends mean more work for IT, not less. Even cloud computing doesn’t mean IT has less work to do. You’ll be managing multi-cloud systems. Think monitoring for availability and performance. Think more reliance on your WAN. Think about what restoring from backup now means. Especially, think about integration.

This is the redefinition of “I” — from “information,” which never truly encompassed IT’s responsibilities anyway, to “integration,” which completely describes where IT is essential.

Look, like it or not, sales managers everywhere understood the difference between cloud-based shadow IT and the installed alternative. Installed software meant asking IT to unlock sales reps’ laptops so they could install Act! and asking IT to provide a server so their laptops could synchronize to a shared database.

The Cloud meant buying licenses from Salesforce, doing everything through the browser, and getting the shared database too, all with no IT involvement.

So encourage Shadow IT. Get rid of as much responsibility for the applications portfolio as you can. For individual applications, shadow IT’s drawbacks are diminishing, and this also eliminates the “This application doesn’t do what I need” vs “The specs were wrong” arguments that now dominate many business/IT relationships.

But integrating the applications? Only IT … “Integration Technology” … can make this happen.

Which gets us to enterprise technical architecture management (ETAM). This is a long-running personal favorite, and it’s only going to be more important in the future.

A multi-cloud environment with lots of quasi-independent line-of-business and departmental IT departments adding to the application layer is akin to a bunch of developers adding buildings to a community without building codes or well-designed water purification, electricity-delivery and sewage treatment systems to connect to.

In particular, the ETAM function should choose the company’s integration technology system and define the company’s data integration engineering requirements.

Data integration is what causes the most trouble when it comes to accidental architecture. Without a clean, clear, well-engineered approach, shadow IT will exacerbate the situation exponentially.

Okay, okay. “Polynomially” is more accurate, but who’s counting?

* * *

15 years ago in KJR’s predecessor, InfoWorld’s “IS Survival Guide”: An app dev methodology that looks a lot like Agile, two years before the Agile Manifesto.

Way back in 1996, I recommended viewing yourself as a product, not an employee.

And ten years ago, how to avoid the proximity trap — the tendency to pay more attention to those who have access than to those who have answers.