Friday, January 4, 2008

Improving S/W Quality in 2008

A new year and time to plan for your success in 2008. No matter where you fit into the IT/SW world -- CIO, developer, tester, PM, QA manager, Director -- you know one thing: You are going to be asked to do even more in 2008 than in 2007 AND you're going to be asked to do it with even fewer resources. If the mantra used to be 'do more with less' it's become 'do EVEN MORE with EVEN LESS!'
So how do you deal with the escalating load without collapsing under the weight? Well, there's one formula that's worked for decades (or even millennia if you read Dr. Joseph Juran.) That's the simple directive to improve quality and you improve productivity. It's simple really. Spend less time on rework and you free up time to be more productive AND, here's the bonus, more creative.
Think about it. We get paid to do it wrong...we get paid to find the wrong stuff...and we get paid to fix it! Now this may sound like a formula for permanent employment for developers and testers but it's a false hope. Executives look at the escalating costs and broken promises and outsource to those who say they can do better. But then the cycle begins all over again...
Since the real problems lie in our chronic lack of robust processes that can guarantee good results, the outsourcers experience the same problems we do: unrealistic schedules and budgets finalized long before we understand the customers actual requirements and true scope of the work, lousy requirements gathering and planning skills, poor or non-existent robust design, development under these sub-optimal condition and constricted test cycles and inadequate use of test tools and automation. So the results are predictable...
No one is truly happy...In 2004 the Gartner Group reported that the world economy lost $500 Billion in failed software projects and of course it's only gotten worse since then. Oh, and that's the cost for the projects that went down in flames...it does NOT include all those sad projects that limp along, require heavy maintenance and burn trillions of dollars.
Not a happy picture to start the new year...very depressing...we've heard it over and over.
There is a better picture. You can make 2008 the year you start reversing these negative trends. Here are some simple steps that have proven themselves over and over.

STEP 1: Set a concrete quality policy and attendant goals for 2008.
These are not pie-in-the-sky or vague 'quality is good to have' types of goals. First you have to face the facts of what your current quality record actually is and base your policy and goal setting on that. What is your defect rate? What portion of your project budget is going towards actually finding and fixing defects (it's a lot more than just your testing budget and time.) What are your most expensive and frequent types of defects, consistently over the last year?
By the way, you can't just blame the developers. Studies show they produce less than 10% of the defects. Over half of the defects arise in the Requirements phase while the design process kicks in another 25%. Oh, and don't blame the testers for not finding them...Since schedules are usually unrealistic, test phase time is often cut so the testers do the best they can under very unfavorable conditions. Celebrate the fact that they find any defects at all!
As you continue your analysis, get to the root causes of the most pain-producing of your defects. Consistent root causes are found in flawed processes not flawed people who use the flawed processes.
Once you have found the root causes of the defects, you can now state some measurable goals for reducing them with concrete, measurable objectives with timetables to improve the processes and reduce the defects, thus reducing costs and increasing productivity.

STEP 2: Assign people to the analysis and improvement work and provide the time and money they need to do the job.
This is an investment that provides measurable ROI. You have the data from the analysis that shows the current situation. Compare that with the data once the processes are improved and in place. These types of improvement process do not have to be giant projects -- although they should be organized and tracked as projects. A knowledgeable team can often get things figured out quickly. What they need then is 'management support' -- that's a firm commitment to make the process changes that are necessary, authorize training on the new processes and enforce the use of the new processes.

STEP 3: Repeat.
The real secret is to take small chunks of work processes to improve -- don't strain your budget and resources with massive change efforts. Dr. W. Edwards Deming's formula for improved quality works: PLAN - DO - CHECK - ACT. Continuous improvement, one process at a time can fit into the tightest budget...IF THERE IS LEADERSHIP WILL.

That's the secret formula. I know you have seen and heard it before. It works...It has a track record...You can make it work in your organization.
Why not make 2008 the year that you finally break the back of those nasty defects that blow your schedule and budget and infuriate the customers? Secret number two? Once you start improving, don't stop. Keep the momentum going. That's the formula for long term success.

A final note: What if you're one of those folks near the bottom of the food chain and don't have the 'means' to improve your processes? Think again. Look at your individual processes. Write them down and look for ways you can make your own processes more efficient and predictable...things you have control over. Just keep track of your changes and results. Talk to your peers and show them how they can make their jobs easier...build a little momentum and demonstrate your results (in terms of money and time) and then you can get management's interest in doing something more formal. What's the alternative...more misery and frustration? Not the way you want to spend 2008? Continuous Improvement Rocks!