NEWSLETTERS
 

CIO.com updates, insights and advice on technology, management and your career.

 
 
 
SUBSCRIBE TO CIO
 
Are you involved in setting the direction for your company's IT budget or strategy?

Apply today for a FREE subscription to CIO Magazine!

 


Mon, Mar 24, 2008 15:29 EDT

Encounters With Complexity

Topic: Personal Management

Blog: Doing Business in Real Time

Current Rating: 5 Comments: 2

Every profession has at its core an encounter with a central reality. For the sports professional, it’s the encounter with the ball (or maybe the opposing player trying to take that ball away); for the stock trader, it’s the encounter with financial uncertainty; for the airline pilot it’s the encounter with gravity. I think for the IT professional, it’s the encounter with complexity.

Our profession uses highly complex stuff to do what we do. Our reason for existing is to deal with that complexity and shield others from having to do so. Whether it’s moving a data center, installing a new application package or developing a custom designed system, we experience a dizzying rush of details as we contemplate all the things that need to get done and all the things that could go wrong.

Because of that rush of details, that overwhelming flood of complexity, I feel fear every single time I start a project. I even believe that if I’m not afraid, it’s a sign I must be missing something (or worse - that I don’t care).

So it comes down to figuring out how to deal with my fear and manage the encounter with complexity that comes along with every new project. IT projects happen when people need to respond to business challenges (there are only challenges, never problems), and challenges come in two flavors – good and bad.

In the first flavor, people come to you with smiles on their faces and tell you about a great opportunity if only you can do something for them. In the second flavor, people come to you with worried looks on their faces and say they need something done in a hurry or terrible things will happen. I’ve noticed both flavors taste much alike.

In both cases, the talk zooms back and forth from high level big picture stuff to low level minute details. The air is charged with emotion, with people taking either an overly optimistic or an overly pessimistic view of the situation. Either way, I usually wind up hearing more minute details than I can handle and getting only a vague big-picture view of how all these details fit together.

Then the conversation stops. And people always have just two questions on their minds. They turn to me with searching expressions on their faces and ask: “So what’s it going to cost?” and “When can you get it done?”

They are simple questions, but answering them involves all the complexity inherent in the people, process, and technology that would be or could be used to deal with these challenges. This is the point when I really feel afraid. Ernest Hemingway said people carry fear in their knees. He may have been right, for I often feel a tingling sensation there along with butterflies in my stomach. This must be my body preparing for fight or flight.

At this moment, I try to remember three things. First, take a deep breath. Second, take another deep breath. Third, very few problems are really as hard as they at first seem. If I make it to the second deep breath, I know I’m off to a good start. Then I collect myself and say, “That’s a very interesting challenge you have, and I want to help.”

This reassures people and gives me a chance to constructively influence the situation instead of just being a stick in the mud or an obstructionist. Then I continue with, “Let’s start this project by defining the challenge and what we need to do to meet it. Next, we’ll design a system to do that, and then

Keywords:

complexity, fear, simplicity

You do not have flash or javascript support.
Average (2 votes)
5
 
 
Thu, Mar 27, 2008 14:48 EDT
Posted by: Eugene Nizker
Rating:

Great post. I'm going to send it to a few people around.

Thank you, Michael!

 
Fri, Apr 11, 2008 16:07 EDT
Posted by: Adrian Tudor
Rating: 80

Great post, Michael. I remember taking those deep breaths but I wish I knew about the third step then…. Indeed nothing is ever that complicated as it first appears.

The interesting corollary to this complexity is that once the project is deployed, managing it does not get less complicated. Actually with each passing year, things in Application Management and Data Centers get progressively more complex. It appears that the defacto in a data center is never to “remove” any system but rather built upon it. The typical infrastructure started with some monolithic mainframe applications, added some client server application that interfaced to the mainframe applications. Then the Web revolution came. Now a whole new level of complexity was added on top of that. These days we’re piling up SOA and Virtualization on top of that and we have indeed a very complex system that someone has to manage. Fear is justified!...

Fortunately for us, I think we’ve also reached a convergence of sorts – the computing power, the massive storage availability at cheap prices, the sophistication of user Interfaces and development tools, etc. This convergence appears to facilitate the entrance to the market of a series of very intelligent tools that approach complexity from a different perspective. They look at it from a non-deterministic way using probabilistic statistics and advanced cycle determination to figure out normal versus abnormal behavior. Then they correlate that behavior among the systems and applications and infer correlations and influences. The current complexity makes it impossible for humans to manually correlate behavior across millions of data points. Rule-based systems only go so far as they are still based on deterministic methods.

That reminds me of Edward Deming and the Total Quality revolution he started in the 60s. His premise was – variation is OK, abnormality is not. And his methodology was introduced to minimize variation but eliminate abnormality in the manufacturing process. And what an impact that made in the manufacturing industry. I think we’re on the verge of seeing something like this in the IT industry. These new tools could sample massive amounts of data from across the entire infrastructure, provide visibility into what’s behaving normally or abnormally and then correlate this behavior to business metrics, providing the Application owner or Data Center Operator with a “fingerprint” of the slowdown or problem encountered and the ability to see the building pattern of symptoms and events that lead to a problem.

You need only take one deep breath knowing that complexity within IT is manageable. You can save the other breath for conquering the next business challenge.

About this Blog

The global economy has a life of its own, it lives in real-time, and we are all part of it. Hello brave new world.

Start a Conversation
Click to post

Got something to say? We want to hear it! Click the Post button to get started. GO»

EXPERT ADVICE
See our roster of experts.

Advice & Opinion from more than 108 of IT's most insightful thinkers.

  PARTNERS       WEBCASTS    
 

Preparing for the Next Cyber Attack

Ensure you are up-to-speed on the latest security technologies available to keep your network safe in this Executive Guide. Get a thorough assessment of the corporate security threat landscape. Protect your network with data leakage protection, NAC and other technologies explained in this report.

Sponsored by Qwest  Read this Executive Guide »

 

Cloud Building: 8 Ingredients for Internal Clouds

Cloud computing: a fundamentally new way to deploy IT services and functions cost-effectively and quickly. Learn how the VMware vCloud initiative dramatically improves how consumers access their information and experience applications as well as the 8 ingredients to get you going.

Sponsored by VMWare  Read this White Paper »

 

Investing in Business Analytics Technology

You're thinking now is the time to take the plunge into business analytics, but you still have some unanswered questions. This research summary addresses the most common questions and concerns surrounding the successful launch of a business analytics initiative. It also includes real-world examples of organizations already getting return on their investment.

Sponsored by SAS  Read this White Paper »

Resource Alerts

Get instant email notifications by topic when white papers, webcasts, and case studies are added to our library.

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

Improving Transparency and Accuracy in IT Cross Charging

During this Webcast you'll learn how KBC Group implemented SAP BusinessObjects Profitability and Cost Management and realized many benefits.   View Now »

 

Cost Savings and Risk Reduction with Effective Systems Management

Join us and see how Novell can help you respond to today's economic challenges by increasing productivity, reducing costs and aligning IT initiatives with overall business goals.  View Now »

 

Capitalize on Your SAP Content

Learn ways to improve your content management by viewing these Open Text webinars today.  View Now »

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

 
NEWSLETTER

Sign-up for the Blogs & Discussion Newsletter

 
FEATURED SPONSORS
 
 
 
SPONSORED LINKS
 

Introducing the new HP ProLiant G6 server family

Accenture: Outsourcing for Competitive Advantage. More...

Better spam protection with Postini for just $1/user/mo

Introducing the new HP ProLiant G6 server family

infoBOOM! - The Mid-Sized Company CIO's Exclusive Community

Accenture IT Consulting: Logical meets technological. More . . .

The Fraudster Economy Model: Operating a Business in the Underground

Trade in your old laser printer and get up to $1000 back!

Taking the Service Desk to the Next Level

Revolutionizing Enterprise Application Deployment

Why Data Loss is Increasing--and What You Can Do About It

Data Loss Prevention: A Better Way to Approach Security

Learn how to managing client systems in the enterprise.

Build a High-Performance Open Web Platform

Mid-Sized Company CIO Community: infoBOOM!

Enterprise PBX Comparison Guide

Getting Value from Outdated Networking Equipment

Losing Ground: 2009 TMT Global Security Survey

Stop Application Fraud at the Source with Device Reputation

Learn about the VMware vSphere (TM) & Intel (R) Xeon (R) Processor 5500 Series

Learn how a virtualized enterprise can help your company reduce costs

Why Isn't Server Virtualization Saving Us More?

Learn how to save 30% through project & portfolio management.

How Open Source is Changing the Face of Enterprise Software

8 Key Ingredients to Building an Internal Cloud

Accenture IT Consulting: Enabling high performance. More...

Top Five CIO Challenges

Insight makes it easy to spend your Microsoft subsidy check.

Five minute business analytics assessment. Immediate results.

Dangerous Collaboration Practices: 5 Ways IT Can Minimize Risk

Accenture: Outsourcing for uncertain times. Click to learn more.

The Case for Investing in Business Analytics Technology. Read white paper.

Live Webinar: Applying Business Analytics. Click here to learn more

Seven Ways ITIL Can Help You in an Economic Downturn

Developing A Dynamic, Real-Time IT Infrastructure

Maximizing the Business Value of the PC Infrastructure

Communications and Collaboration Needs at Business Organizations

Using Open Source to Deploy Web Applications

Cloud Computing: Read about VMware's compelling vision & set of products

Enterprise PBX Buyer's Guide

Secondary Market Primer: Your Network at Half Price

How Interactive Viewer Reduces the Effort to Meet Visualization Requirements

Top-line Performance that's Bottom-line Efficient

White Paper: 8 Key Ingredients to Building an Internal Cloud

Read about virtualization and consolidation effort best practices

Building the Virtualized Enterprise with VMware Infrastructure

The Global Marketplace Today: Strategies for Tough Times

Top 10 Business and IT Drivers for the Wealth Management Sector

5 Steps to Automating Accounts Payable

Bottom-Line Benefits of Virtualization