Rants
Questions
Soapbox
Best Practices
Apply today for a FREE subscription to CIO Magazine!
Mon, Mar 24, 2008 15:29 EDT

|
Posted by: Michael Hugos in Soapbox Topic: Personal ManagementBlog: Doing Business in Real Time
Current Rating: |
Every profession has at its core an encounter with a central reality. For the sports professional, it’s the encounter with the ball (or maybe the opposing player trying to take that ball away); for the stock trader, it’s the encounter with financial uncertainty; for the airline pilot it’s the encounter with gravity. I think for the IT professional, it’s the encounter with complexity.
Our profession uses highly complex stuff to do what we do. Our reason for existing is to deal with that complexity and shield others from having to do so. Whether it’s moving a data center, installing a new application package or developing a custom designed system, we experience a dizzying rush of details as we contemplate all the things that need to get done and all the things that could go wrong.
Because of that rush of details, that overwhelming flood of complexity, I feel fear every single time I start a project. I even believe that if I’m not afraid, it’s a sign I must be missing something (or worse - that I don’t care).
So it comes down to figuring out how to deal with my fear and manage the encounter with complexity that comes along with every new project. IT projects happen when people need to respond to business challenges (there are only challenges, never problems), and challenges come in two flavors – good and bad.
In the first flavor, people come to you with smiles on their faces and tell you about a great opportunity if only you can do something for them. In the second flavor, people come to you with worried looks on their faces and say they need something done in a hurry or terrible things will happen. I’ve noticed both flavors taste much alike.
In both cases, the talk zooms back and forth from high level big picture stuff to low level minute details. The air is charged with emotion, with people taking either an overly optimistic or an overly pessimistic view of the situation. Either way, I usually wind up hearing more minute details than I can handle and getting only a vague big-picture view of how all these details fit together.
Then the conversation stops. And people always have just two questions on their minds. They turn to me with searching expressions on their faces and ask: “So what’s it going to cost?” and “When can you get it done?”
They are simple questions, but answering them involves all the complexity inherent in the people, process, and technology that would be or could be used to deal with these challenges. This is the point when I really feel afraid. Ernest Hemingway said people carry fear in their knees. He may have been right, for I often feel a tingling sensation there along with butterflies in my stomach. This must be my body preparing for fight or flight.
At this moment, I try to remember three things. First, take a deep breath. Second, take another deep breath. Third, very few problems are really as hard as they at first seem. If I make it to the second deep breath, I know I’m off to a good start. Then I collect myself and say, “That’s a very interesting challenge you have, and I want to help.”
This reassures people and gives me a chance to constructively influence the situation instead of just being a stick in the mud or an obstructionist. Then I continue with, “Let’s start this project by defining the challenge and what we need to do to meet it. Next, we’ll design a system to do that, and then
Great post. I'm going to send it to a few people around.
Thank you, Michael!
Great post, Michael. I remember taking those deep breaths but I wish I knew about the third step then…. Indeed nothing is ever that complicated as it first appears.
The interesting corollary to this complexity is that once the project is deployed, managing it does not get less complicated. Actually with each passing year, things in Application Management and Data Centers get progressively more complex. It appears that the defacto in a data center is never to “remove” any system but rather built upon it. The typical infrastructure started with some monolithic mainframe applications, added some client server application that interfaced to the mainframe applications. Then the Web revolution came. Now a whole new level of complexity was added on top of that. These days we’re piling up SOA and Virtualization on top of that and we have indeed a very complex system that someone has to manage. Fear is justified!...
Fortunately for us, I think we’ve also reached a convergence of sorts – the computing power, the massive storage availability at cheap prices, the sophistication of user Interfaces and development tools, etc. This convergence appears to facilitate the entrance to the market of a series of very intelligent tools that approach complexity from a different perspective. They look at it from a non-deterministic way using probabilistic statistics and advanced cycle determination to figure out normal versus abnormal behavior. Then they correlate that behavior among the systems and applications and infer correlations and influences. The current complexity makes it impossible for humans to manually correlate behavior across millions of data points. Rule-based systems only go so far as they are still based on deterministic methods.
That reminds me of Edward Deming and the Total Quality revolution he started in the 60s. His premise was – variation is OK, abnormality is not. And his methodology was introduced to minimize variation but eliminate abnormality in the manufacturing process. And what an impact that made in the manufacturing industry. I think we’re on the verge of seeing something like this in the IT industry. These new tools could sample massive amounts of data from across the entire infrastructure, provide visibility into what’s behaving normally or abnormally and then correlate this behavior to business metrics, providing the Application owner or Data Center Operator with a “fingerprint” of the slowdown or problem encountered and the ability to see the building pattern of symptoms and events that lead to a problem.
You need only take one deep breath knowing that complexity within IT is manageable. You can save the other breath for conquering the next business challenge.