NEWSLETTERS
 

CIO.com updates, insights and advice on technology, management and your career.

 CIO BlackBerry News and Tips
 CIO Research and Analysis
 CIO Microsoft
 CIO Insider
 
 
 
SUBSCRIBE TO CIO
 
Are you involved in setting the direction for your company's IT budget or strategy?

Apply today for a FREE subscription to CIO Magazine!

 


Mon, Jan 7, 2008 23:59 EST

Agile IT Development and the Infernal Dynamic of Scope Creep

Topic: Development

Blog: Doing Business in Real Time

Current Rating: 5 Comments: 10

In spite of all the best practices and project management techniques, scope creep (and resulting delays and cost overruns) has always been the biggest problem on most development projects. The only way we are going to solve the scope creep problem is to understand and deal with the underlying dynamic that creates scope creep in the first place.
 
This dynamic has two drivers. The first driver arises from the fact that the more we analyze a situation the more complexity we discover and so the more complexity we add to the design of the system. The second driver arises from the fact that most business people have been through system development projects before and they know there will never be a “phase two” on the project (in spite of what anyone says). They know they’re only going to get one shot, so they try to think of everything they might ever need and they push for all those features to be included in the first phase.
 
These two drivers set up a self-reinforcing cycle that leads to an infernal, downward spiral of mounting problems. Lots of analysis is done, lots of complexity is discovered, people feel they will need lots of features to deal with all that complexity and they insist on getting all those features in the first phase. There is a palpable lack of trust between the business and IT people because of this. Inevitably the design requirements call for a system that is way too big and way too complicated; chances of building it on time and on budget are slim to none, and IT is almost always the party who gets the blame.
 
The answer to this downward spiral is simple yet also counterintuitive. The answer starts by doing less analysis (not more), a LOT less analysis than is usually thought necessary. Restrict analysis to only what the business people need right now; do not spend time speculating on what they may need a year from now. People know what they need right now because they’ve already thought about that and they can usually tell you in 30 minutes or less. It’s when you start asking people to speculate about what they’ll need one and two years from now that things get complex.

Because you focus ONLY on the here and now, you can do less analysis and you can quickly design a system that gives people that handful of useful features they really want right away. And because the design is therefore relatively simple, you can also build the system very quickly and put it into production.

If you deliver the first version of the system in a 30-45 day timeframe, you will totally surprise (and delight) the business people. They will start using the system right away and they will thank you for making their lives easier. Yes, they will thank you. And they will tell you they didn’t think you could get a system delivered so quickly, and they will start to trust you when you say there will be a phase two on the project.

And then, after a few weeks, you start working with the business people on the next round of features they want to add to their system. They will have had time to work with what you just gave them, and they will see what they need next. Again you are only asking them to tell you what they need right away, they are not being asked to speculate about vague and complex possible future needs.

This agile and iterative system development approach is the way to side-step

You do not have flash or javascript support.
Average (4 votes)
5
 
 
Fri, Jan 11, 2008 10:22 EST
Anonymous user
Posted by: Anonymous
Rating: 30

What a novel idea – give the users what they want, not what we think they need!

 
Fri, Jan 11, 2008 12:04 EST
Anonymous user
Posted by: Engineering is different than Manufacturing
Rating: 10

I keep hearing about Agile this and Agile that. Get real! How do you "evolve" from a foot bridge to a bridge that will carry a tank over a river? How does a log cabin "evolve" into a 100 story building? I know that IT is different than all of the physical sciences (it is not!). We have to understand that IT is not different than the industrial age, the nomadic age, the agricultural age, etc. The end product is different, but the physics are the same. If you want a 100 story building (eventually or not - time is not the issue), you have to begin the engineering for that requirement. If you want a Boeing 747, you have to begin the engineering with that understanding. I would love to see REAL examples of how these Agile techniques actually (documented) produced benefits and produced the requirements the business actually wanted.

The problem is that we in IT have not figured out that Engineering an information system is different Manufacturing (implementing) an information system. That was the understanding that led to orders of magnitude increases in productivity in the industrial age, and the ages before it. In the information age we are in now, someone is going to figure this out (perhaps it will be in Japan, as it was in the industrial age). Here, we are always looking for "All you got to do is ...., and you will never have to work again in your life!). Lets get real before we loose the IT business to someone who understands engineering is different from manufacturing.

 
Fri, Jan 11, 2008 12:26 EST
Anonymous user
Posted by: Anonymous
Rating: 30

An interesting perspective that ignores the engineering aspects necessary to take a one story building to ten over time. If the foundation isn’t there you have to go back and put it in. With this strategy you may need to rebuild the foundation multiple times. However, if you start with something built on an SOA foundation this approach might make sense.

 
Fri, Jan 11, 2008 19:10 EST
Posted by: Michael Hugos
Rating: 90

Dear Engineering is Different than Manufacturing:

I feel your pain and I hear your anger. We in the IT profession are going through a painful transition - again. I remember the anger that was evoked 25 years ago when PCs began infiltrating corporate offices. IT professionals reacted with a mix of scorn, disbelief and anger. Everyone knew that only big iron could run big companies and those ridiculous little PC boxes where nothing but toys...

What is happening now is even more disruptive (and threatening) to our conventional notions about how to design and build systems. The development environment itself is changing very fast. Ready or not, the systems we develop from here on out will not be built from scratch, but instead will be built using SOA, SaaS, databases, middleware and little chunks of custom code all bundled together under web portal interfaces. They will indeed seem to evolve from log cabins to 100 story buildings.

I see this realization is already starting to dawn on the person who posted the "IT is Engineering" comment; this person is starting to see the implications of SOA. Hmmm... what would happen if we built iterative versions of a system using SOA to combine small chunks of custom code and predefined components like databases, web interfaces, and parts of existing systems and packages?

Of course we could successively scale up a system like this to handle greater and greater numbers of users and greater amounts of transactions and data. Just add more servers and more database capacity and more communications bandwidth as needed. These tasks are not high adventure any more, they are just standard system maintenance operations. And as you upgrade the carrying capacity of the infrastructure, you keep adding new features to the system as business needs dictate and you use SOA to link them in.

I used these techniques as a CIO over a five year period to design, build and iteratively enhance a suite of e-business and supply chain systems that drove the growth and changed the business model of an $8 billion distribution organization. I won awards for this work from CIO magazine, Computerworld and InformationWeek. I've written several books on the subject among which are Building the Real-Time Enterprise and CIO Best Practices both published by John Wiley & Sons. I will be glad to provide you with REAL examples and details and user testimonials of how agile approaches work extremely well.

Eugene Nizker in his comment below asks some very pointed and very appropriate questions. He says it better than I can. It's time for our profession to get over the anger and fear and get on with making agility happen. It's already 2008 and according to my calculations we'll be into the second decade of the 21st Century in two more years. The world is moving way too fast for old 20th Century industrial approaches to work any more. Time to wake up and smell the coffee.

 
Fri, Jan 11, 2008 12:25 EST
Anonymous user
Posted by: Chad
Rating: 90

Excellent. I think you hit the nail on the head for the leading cause of scope creep. Your approach to correcting it is a very good one, and will work well in many situations. But nothing in life is ever simple, or one size fits all.

The limitation in the suggested approach, is in the architecture of the solution. If future needs and wants aren’t considered, a system may be designed that will either not scale elegantly, or not scale at all, to meet future needs. A complete rewrite may be necessary. When this happens, the initially successful first phase, may be relabeled an abject failure by the organization.

So how much analysis should be done? It comes down to expert judgment of Project Management, Lead IT Resources, and ideally (if there’s trust) Project Stakeholders. It’s part of why Project Management is an art form, as much as a science.

Post new comment

* Subject:
* Username:
* E-mail:
The content of this field is kept private and will not be shown publicly.
Homepage:
* Body:
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <img> <blockquote> <strike> <p> <br>
  • Lines and paragraphs break automatically.
More information about formatting options

* Denotes required field.

About this Blog

The global economy has a life of its own, it lives in real-time, and we are all part of it. Hello brave new world.

Hot Conversations

Take My Windows 7 Please: A Resale Tale

Posted by Shane ONeill in News | 6 comments

Creating a Privacy Policy Part V

Posted by Ariel Silverstone in Best Practices | 1 comments

Start a Conversation
Click to post

Got something to say? We want to hear it! Click the Post button to get started. GO»

EXPERT ADVICE
See our roster of experts.

Advice & Opinion from more than 113 of IT's most insightful thinkers.

  PARTNERS       WEBCASTS    
 

Windows 7 Webcast Series

There's a lot of buzz about Windows 7 out there. Each month in our webcast series, listen to analysts and customers discuss how Windows 7 and the Windows Optimized Desktop is impacting large companies around the world. Learn how they evaluated Windows 7, including the cost of deployment, deployment strategies, and tangible benefits.

Sponsored by Microsoft  Listen to on-demand Recordings »

 

Service Level Management Best Practices Life Cycle Overview - Improve Service Levels

Best practices for Service Level Management (SLM) is a process for consistently meeting customer requirements and delivering on IT's promises. See the steps required to ensure high-quality SLM.

Sponsored by Compuware  Read this White Paper »

 

Keeping Your Members Safe from Online Scams and Predators

In order to keep fraudsters out, romance sites must deploy effective solutions that look at information independent of what is supplied by users. A device fingerprinting solution such as iovation ReputationManager™ provides unique insight into the computers being used to create multiple accounts and exposes hidden device-account relationships that identity-based fraud solutions often miss.

Sponsored by iovation  Read this White Paper »

Resource Alerts

Get instant email notifications by topic when white papers, webcasts, and case studies are added to our library.

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

Defend Against Blended Threats: What You Need to Know

Blended Web and email threats are becoming increasingly complex and represent a huge...  View Now »

 

Prescriptive Actions to Reduce Risk

In this Webcast, learn best practices for effective systems management in a heterogeneous environment and keep client systems cost under control.   View Now »

 

Webcast- Vantage 11: Redefining Application Performance Management

Compuware's latest release, Vantage 11, is a major advance in end-to-end application performance management--bringing together proactive issue identification, quantification of business impact and problem resolution into a single solution. Tune in to learn how Vantage 11's top-down approach helps you make better decisions and dramatically lower operations costs.  View Now »

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

 
NEWSLETTER

Sign-up for the Blogs & Discussion Newsletter

 
FEATURED SPONSORS
 
 
 
SPONSORED LINKS
 

See how AT&T can help protect your network.

Top Five CIO Challenges

Streamline IT Costs. Boost Performance with WAN Optimization.

Want to know how you can maximize employee productivity?

Build your 1st app FREE with Force.com

TDWI checklist helps define data readiness for analytics. Download report.

Increase UPS efficiency without sacrificing protection.

A Clear View Toward Virtualization

Virtualization Technology as a Business Solution

The rules of infrastructure management just changed.

A Clear View Toward Virtualization

Interactive Q&A helps you discover key ways to maximize IT assets.

Ready to virtualize tier one applications? Check your virtualization maturity.

Think you can't afford a Cisco Switch? Cisco Catalyst Switches are now more affordable.

Five minute business analytics assessment. Immediate results.

The Case for Investing in Business Analytics Technology. Read white paper.

White Paper: Right-Sizing Your Power Infrastructure

Webcast: Unleashing the Power of Customer Data

White Paper: Managed Security for a Not-So-Secure World

SharePoint - Unchecked growth of content is unsustainable.

White Paper: Legacy Tools: Not Built for the Helpdesk

Taking a Seat at the Executive Table: The Reality of Virtualization

Five-Step Mobility Management Plan

White Paper: Next Generation Remote Infrastructure Management

Disciplined Autonomy: Resolving the Tension Between Flexibility and Control

Join us at the US-Brazil IT-BPO Summit, on November 10th in New York.

Unified Communications: Thoughts, Strategies and Predictions. Join the discussion

Read the RSA report: Security for Business Innovation

Webcast: Looking to the Cloud for Email and Collaboration Services

64-page prescriptive guide to security, compliance, and IT operations.

Keep your IT expertise up to date. Join the Intel Premier IT Professionals.

A new fleet of PCs with a total ROI in 10 months. Find your ROI.

eZine: A Roadmap to Reducing IT Complexity

Reduce risk, gain agility. See how Progress can help your business.

Virtualization Technology as a Business Solution

eZine: A Roadmap to Reducing IT Complexity

World-class trading technology solutions from NYSE Technologies.

If You're Paying for Telecom, You're Paying Too Much. Contact Asentinel Today.

Trade-In your old printer and save up to $1,000 plus free recycling!

infoBOOM! - The Mid-Sized Company CIO's Exclusive Community

Live Webinar: Applying Business Analytics. Click here to learn more

White Paper: 4 Customer Service Myths

Mobile Security: The Essential Ingredient for Today's Enterprise

White Paper: Improve Agility with Operational Responsiveness

White Paper: 5 Best Practices for Smartphone Support

Global Research: CIOs Weigh In On Virtualization

5 Key Virtualization Management Challenges

Learn How Web Site Performance Impacts Shopper Behavior

IDC White Paper: CCM for IT Compliance and Risk Management

Tolly Group Lab Test Results: Cisco vs. ShoreTel