NEWSLETTERS
 

CIO.com updates, insights and advice on technology, management and your career.

 CIO BlackBerry News and Tips
 CIO Research and Analysis
 CIO Microsoft
 CIO Insider
 
 
 
SUBSCRIBE TO CIO
 
Are you involved in setting the direction for your company's IT budget or strategy?

Apply today for a FREE subscription to CIO Magazine!

 


Sun, May 20, 2007 21:28 EDT

The Proof is in the Pudding

Topic: Partner/Vendor Management

Current Rating: 5 Comments: 7

When evaluating software vendors, make sure that a Proof of Concept (POC) is part of your process.  We just completed an intense vendor assessment between three BPMS (Business Process Management Suite) vendors.  All three vendors have great products and plenty of successful customers.  It wasn't until we entered the Proof of Concept phase when one of them separated from the pack.

In our POC we made the vendors start with a blank screen and build a sample process flow that we modeled on paper.  We chose a model that exposed various features and functionalities of the BPMS tools.  We where looking for ease of use, how quickly each vendor could complete the POC, and how the tools integrated with our existing .Net services.

What we found is that only one of the vendors could actually complete the POC in the one day event and that same vendor was the only one who could even figure out how to connect to our services.  In fact, it was so easy for this vendor that we gave them additional services to connect to and they were able to accomplish that also.

The lesson learned here is you need to do more then just submit and analyze RFI's and RFP's.  Vendor demos are not enough either.  If we had not asked them to do a POC we would have selected a different vendor who could not easily integrate with our infrastructure.  This would have raised our Total Cost of Ownership (TCO) and reduced our ability to improve speed to market.

When it is all said and done, the proof is in the pudding!

You do not have flash or javascript support.
Average (3 votes)
5
 
 
Mon, May 21, 2007 9:13 EDT
Posted by: tmmackay
Rating:

I've used the proof of concept during vendor selection, and I agree that it can be immensely revealing. I use the POC for internal projects we are considering, too.

Another semi-related item is that vendor demos should follow a script that you have written. This allows you to see how well each vendor's solution will perform those particular items you feel are most valuable. Don't let the vendors write their own scripts for the demo, and those that refuse to follow your script should be viewed with suspicion.

Thomas M. MacKay

 
Tue, May 22, 2007 9:38 EDT
Anonymous user
Posted by: Anonymous
Rating:

This is great feedback. Can you tell me which vendor you went with and who was in your short list? Thanks, Jeff

 
Tue, May 22, 2007 18:05 EDT
Posted by: Michael Kavis
Rating:

Shoot me an email and I will share that information with you.

 
Thu, May 24, 2007 21:29 EDT
Posted by: Diversity
Rating:

Do share if you offering it out.

Diversity

 
Sat, May 26, 2007 15:27 EDT
Anonymous user
Posted by: SE Guy
Rating:

You are absolutely correct, and when a well organised buyer asks for a POC, most vendors will be happy to give one. Make sure though that when you ask for a POC, you aren't just playing around. Vendors are happy to help you evaluate their products, but will try to make sure you do actually want to buy the best product. A good vendor will try to help you work out what should be tested in a POC. This article explains how many vendors like to run a POC.

Post new comment

* Subject:
* Username:
* E-mail:
The content of this field is kept private and will not be shown publicly.
Homepage:
* Body:
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <img> <blockquote> <strike> <p> <br>
  • Lines and paragraphs break automatically.
More information about formatting options

* Denotes required field.

Hot Conversations

Take My Windows 7 Please: A Resale Tale

Posted by Shane ONeill in News | 6 comments

Creating a Privacy Policy Part V

Posted by Ariel Silverstone in Best Practices | 1 comments

Start a Conversation
Click to post

Got something to say? We want to hear it! Click the Post button to get started. GO»

EXPERT ADVICE
See our roster of experts.

Advice & Opinion from more than 113 of IT's most insightful thinkers.

  PARTNERS       WEBCASTS    
 

Windows 7 Webcast Series

There's a lot of buzz about Windows 7 out there. Each month in our webcast series, listen to analysts and customers discuss how Windows 7 and the Windows Optimized Desktop is impacting large companies around the world. Learn how they evaluated Windows 7, including the cost of deployment, deployment strategies, and tangible benefits.

Sponsored by Microsoft  Listen to on-demand Recordings »

 

Service Level Management Best Practices Life Cycle Overview - Improve Service Levels

Best practices for Service Level Management (SLM) is a process for consistently meeting customer requirements and delivering on IT's promises. See the steps required to ensure high-quality SLM.

Sponsored by Compuware  Read this White Paper »

 

Keeping Your Members Safe from Online Scams and Predators

In order to keep fraudsters out, romance sites must deploy effective solutions that look at information independent of what is supplied by users. A device fingerprinting solution such as iovation ReputationManager™ provides unique insight into the computers being used to create multiple accounts and exposes hidden device-account relationships that identity-based fraud solutions often miss.

Sponsored by iovation  Read this White Paper »

Resource Alerts

Get instant email notifications by topic when white papers, webcasts, and case studies are added to our library.

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

Defend Against Blended Threats: What You Need to Know

Blended Web and email threats are becoming increasingly complex and represent a huge...  View Now »

 

Prescriptive Actions to Reduce Risk

In this Webcast, learn best practices for effective systems management in a heterogeneous environment and keep client systems cost under control.   View Now »

 

Webcast- Vantage 11: Redefining Application Performance Management

Compuware's latest release, Vantage 11, is a major advance in end-to-end application performance management--bringing together proactive issue identification, quantification of business impact and problem resolution into a single solution. Tune in to learn how Vantage 11's top-down approach helps you make better decisions and dramatically lower operations costs.  View Now »

Resource Alerts

Get instant email notification when white papers, webcasts, and case studies are added to our library. Don't just be up-to-date—be up to the minute with our new Resource Alerts.

 
NEWSLETTER

Sign-up for the Blogs & Discussion Newsletter

 
FEATURED SPONSORS
 
 
 
SPONSORED LINKS
 

See how AT&T can help protect your network.

Top Five CIO Challenges

Streamline IT Costs. Boost Performance with WAN Optimization.

Want to know how you can maximize employee productivity?

Build your 1st app FREE with Force.com

TDWI checklist helps define data readiness for analytics. Download report.

Increase UPS efficiency without sacrificing protection.

A Clear View Toward Virtualization

Virtualization Technology as a Business Solution

The rules of infrastructure management just changed.

A Clear View Toward Virtualization

Interactive Q&A helps you discover key ways to maximize IT assets.

Ready to virtualize tier one applications? Check your virtualization maturity.

Think you can't afford a Cisco Switch? Cisco Catalyst Switches are now more affordable.

Five minute business analytics assessment. Immediate results.

The Case for Investing in Business Analytics Technology. Read white paper.

White Paper: Right-Sizing Your Power Infrastructure

Webcast: Unleashing the Power of Customer Data

White Paper: Managed Security for a Not-So-Secure World

SharePoint - Unchecked growth of content is unsustainable.

White Paper: Legacy Tools: Not Built for the Helpdesk

Taking a Seat at the Executive Table: The Reality of Virtualization

Five-Step Mobility Management Plan

White Paper: Next Generation Remote Infrastructure Management

Disciplined Autonomy: Resolving the Tension Between Flexibility and Control

Join us at the US-Brazil IT-BPO Summit, on November 10th in New York.

Unified Communications: Thoughts, Strategies and Predictions. Join the discussion

Read the RSA report: Security for Business Innovation

Webcast: Looking to the Cloud for Email and Collaboration Services

64-page prescriptive guide to security, compliance, and IT operations.

Keep your IT expertise up to date. Join the Intel Premier IT Professionals.

A new fleet of PCs with a total ROI in 10 months. Find your ROI.

eZine: A Roadmap to Reducing IT Complexity

Reduce risk, gain agility. See how Progress can help your business.

Virtualization Technology as a Business Solution

eZine: A Roadmap to Reducing IT Complexity

World-class trading technology solutions from NYSE Technologies.

If You're Paying for Telecom, You're Paying Too Much. Contact Asentinel Today.

Trade-In your old printer and save up to $1,000 plus free recycling!

infoBOOM! - The Mid-Sized Company CIO's Exclusive Community

Live Webinar: Applying Business Analytics. Click here to learn more

White Paper: 4 Customer Service Myths

Mobile Security: The Essential Ingredient for Today's Enterprise

White Paper: Improve Agility with Operational Responsiveness

White Paper: 5 Best Practices for Smartphone Support

Global Research: CIOs Weigh In On Virtualization

5 Key Virtualization Management Challenges

Learn How Web Site Performance Impacts Shopper Behavior

IDC White Paper: CCM for IT Compliance and Risk Management

Tolly Group Lab Test Results: Cisco vs. ShoreTel