IT DRILLDOWN
 
NEWSLETTERS
 

CIO.com updates, insights and advice on technology, management and your career.

 
 
 
SUBSCRIBE TO CIO
 
Are you involved in setting the direction for your company's IT budget or strategy?

Apply today for a FREE subscription to CIO Magazine!

 

 


Sun, May 20, 2007 21:28 EDT

The Proof is in the Pudding

Topic: Partner/Vendor Management

Current Rating: 5 Comments: 7

When evaluating software vendors, make sure that a Proof of Concept (POC) is part of your process.  We just completed an intense vendor assessment between three BPMS (Business Process Management Suite) vendors.  All three vendors have great products and plenty of successful customers.  It wasn't until we entered the Proof of Concept phase when one of them separated from the pack.

In our POC we made the vendors start with a blank screen and build a sample process flow that we modeled on paper.  We chose a model that exposed various features and functionalities of the BPMS tools.  We where looking for ease of use, how quickly each vendor could complete the POC, and how the tools integrated with our existing .Net services.

What we found is that only one of the vendors could actually complete the POC in the one day event and that same vendor was the only one who could even figure out how to connect to our services.  In fact, it was so easy for this vendor that we gave them additional services to connect to and they were able to accomplish that also.

The lesson learned here is you need to do more then just submit and analyze RFI's and RFP's.  Vendor demos are not enough either.  If we had not asked them to do a POC we would have selected a different vendor who could not easily integrate with our infrastructure.  This would have raised our Total Cost of Ownership (TCO) and reduced our ability to improve speed to market.

When it is all said and done, the proof is in the pudding!

Keywords:

BPM Vendor

You do not have flash or javascript support.
Average (3 votes)
5
 
 
Mon, May 21, 2007 9:13 EDT
Posted by: tmmackay
Rating: 90

I've used the proof of concept during vendor selection, and I agree that it can be immensely revealing. I use the POC for internal projects we are considering, too.

Another semi-related item is that vendor demos should follow a script that you have written. This allows you to see how well each vendor's solution will perform those particular items you feel are most valuable. Don't let the vendors write their own scripts for the demo, and those that refuse to follow your script should be viewed with suspicion.

Thomas M. MacKay

 
Tue, May 22, 2007 9:38 EDT
Anonymous user
Posted by: Anonymous
Rating:

This is great feedback. Can you tell me which vendor you went with and who was in your short list? Thanks, Jeff

 
Tue, May 22, 2007 18:05 EDT
Posted by: Michael Kavis
Rating:

Shoot me an email and I will share that information with you.

 
Thu, May 24, 2007 21:29 EDT
Posted by: Diversity
Rating:

Do share if you offering it out.

Diversity

 
Sat, May 26, 2007 15:27 EDT
Anonymous user
Posted by: SE Guy
Rating: 70

You are absolutely correct, and when a well organised buyer asks for a POC, most vendors will be happy to give one. Make sure though that when you ask for a POC, you aren't just playing around. Vendors are happy to help you evaluate their products, but will try to make sure you do actually want to buy the best product. A good vendor will try to help you work out what should be tested in a POC. This article explains how many vendors like to run a POC.

Start a Conversation
Click to post

Got something to say? We want to hear it! Click the Post button to get started. GO»

EXPERT ADVICE
See our roster of experts.

Advice & Opinion from more than 94 of IT's most insightful thinkers.

advertisement

TOP USERS
UserPoints
1. laith al jazi12550
2. reCareered8625
3. Akshay Upadhye7650
4. Chris Moore6750
5. abdhiraj6175
UserPoints
6. Al Sacco5875
7. remi5625
8. Mark Cummuta5425
9. Brian Flora5125
10. asengupta3750
  PARTNERS       PODCASTS       WEBCASTS    
 

From Laggard to Leader: Transforming the Data Center

This webcast offers an understanding of how customers are transforming their data centers, the successes and challenges of each approach, and how IT can become the driver to provide real business value and competitive advantage.

Sponsored by HP  Register for this Webcast »

 

Ensuring Business Services Delivery

Join Forrester Research and Fluke Networks for this unique round-table webcast, moderated by Gary Beach, Publisher Emeritus of CIO, that will touch on:

  • * How Application Performance can effect overall delivery of Business Services
  • * Best practices for managing Application Performance in a converged and distributed environment
  • * How to utilize forensics to optimize use of your internal resources


Sponsored by Fluke Networks
  Watch this webcast. »

 

The Universal Wireless Client

Learn how replacing multiple wireless clients with one Universal Wireless Client can cut support and help desk costs, increase end user satisfaction, improve security, and help implement Network Access Control.

Sponsored by Fiberlink  Read this White Paper »

Resource Alerts

Get instant email notifications by topic when white papers, webcasts, and case studies are added to our library.

NAC launch from HP Procurve Podcast with Lippis Report, Part 1

ProCurve Networking by HP joins the Lippis Report to announce major product and organizational additions to their ProActive Defense strategy.  Read More »

 

Accenture's View on Web 2.0 and its impact on business

Publisher at CIO magazine, Bob Melk, talks to Accenture's Blair Jones about the emergence of Web 2.0...  Read More »

 

A Best-Practice Framework for Virtualization

This podcast offers insights and perspective on the various issues that relate to virtualization...  Read More »

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

Forrester builds a case for the next generation information workplace.

As businesses seek new ways to enhance collaboration and improve productivity, the information workplace continues to evolve...  Read More »

 

Find out what Forrester says about mobile endpoint security and its management.

Mobility raises productivity. But IT departments are hard-pressed to protect mobile data and to manage security software, wireless clients and regulatory compliance for mobile workers...   Read More »

 

Get Forrester's take on simplifying mobility with the universal wireless client.

Mobile workers want to use all types of wireless networks: WiFi, 3G cellular networks, corporate WLANs and home wireless networks. But how can IT support...  Read More »

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

 
NEWSLETTER

Sign-up for the Advice & Opinion Newsletter

 
FEATURED SPONSORS
 
 
 
SPONSORED LINKS
 

Build up or Tear down? See how UC makes sense with Nortel. Calculate your UC ROI

Motorola AirDefense can identify and exterminate your rogue APs. Learn more

CA delivers deeper insight into your assets, resources, projects & services so you can make more informed IT decisions

Manage your IT more effectively

Is there a secret to Sharepoint® Security? www.SharePointSecured.com

Request a Novell/Microsoft deployment workshop

Keep your valued customers through tight business integration - it's a lot easier than you think

Simplified business collaboration, we make the connections so you don't have to

Compuware.com - See how we make IT rock around the world

Discover PMI's credentials and career path tools

SOA Educational Library at the TIBCO SOA Resource Center

Secure your virtual and physical environments with the same software

E-LOAN Maintains Reputation as a Privacy Leader with Symantec

Information Security: Data Drains and How to Prevent Loss

Prudential Financial Protects its Brand with Symantec

A Guide to Understanding Hosted and Managed Messaging

Google Apps Premier Edition Helps Indoff Manage E-mail More Effectively

CapGemini Cut Call Center Costs with Google Apps Premier Edition

Comprehensive Review of Security and Vulnerability Protections for Google Apps

Web 2.0 The New Face of the Web

Universal Search in Healthcare Organizations

Google Case Study: Agile Software

Universal Search in High Tech Organizations

Providing Universal Search for Business

Google Case Study: Kimberly-Clark

Industry Analyst Report: Top Hosted Exchange Vendors in 2008

CA's IT Security centralizes your identity management to turn security into a proactive, business-building tool

Efficient - Flexible - Compliant

Log onto Hitachi True Stories, films inspired by the next great achievement

Request a Novell/Microsoft deployment workshop and kit

Request a Novell/Microsoft deployment kit

Let Hubspan's managed service tackle your business integration challenge so you can focus on your core business

Strong Authentication. Secure USB data storage. One Device

Global Crossing is the most viable alternative for voice, video and data

Dell Latitude: Battery life up to 19 hours. Learn more

TDWI Report shows strong validation for investing in predictive analytics

Security and Trust: The Backbone of Doing Business over the Internet

7 Requirements of Data Loss Prevention

Data Loss Prevention: Keeping Sensitive Data Out of the Wrong Hands

Best Practices in Choosing and Consuming Managed Security Services

A Guide to Messaging Archiving

2008 Google Communications Intelligence Report

The Impact of Messaging and Web Threats

Comparing Google and Other Leading Messaging Security Solutions

Deploying a Google Search Appliance is Not your Typical IT Implementation

Google Case Study: Pioneer Investments

The Case for Universal Search

Universal Search in Financial Services Organizations

Google Case Study: Sunnybrook Health Sciences

Learn About the Features of the Google Universal Search Solution.