Please wait while the page is being loaded Skip this advertisement >
Saturday | 6 December, 2008
CIO
Testing times for slack software development
Shrinking time-to-market deadlines degrade software quality
Darren Pauli (Computerworld) 02 August, 2007 16:08:07

"Don't crawl over bugs-per-function point or per capture; you need five or 10 basic metrics to make meaningful results, like the ability to development versus quality [output], and they should be taken over six months and balanced against industrial data," he said.

The need for software testing is determined by the context, scale and risk environment of the project, according to the Software QA and Testing Resource Center. The Web site claims testing may not be required for small projects if software programmers are experienced and skilled, and initial testing is employed.

"In some cases [where] an organization is too small or new to have a testing staff, it may be appropriate to use contractors or outsourcing, or to adjust the project management and development approach," the site states.

"Inexperienced managers sometimes gamble on the success of a project by skipping testing or getting programmers to do post-development functional testing of their work, [which is] a high-risk gamble."

Greg Sherwood, unit head of Sydney-based Squiz.net's open source content management tool MySource Matrix, said software testing should be retained in-house because business has a better understanding of its client and product requirements than outsourcing companies.

"We know our product best and we know how our clients use it and what they are most concerned about [and] we tailor our tests and testing frameworks based on that knowledge," Sherwood said, adding that testing the surface functionality of its flagship product is inadequate because it is highly complex.

"You need to measure the effectiveness of your software testing processes and constantly improve them. Each organization needs to find metrics that suit their product, like code coverage or database performance, and measure them constantly because of product changes during the development phase.

However, Sherwood said while automation tools are available for most programming languages and unit testing has grown in popularity, open source products are "notorious for being badly tested". He said automation is the best way to ensure consistent quality of testing.

Sherwood refuted figures that claim 85 percent of defects in software projects originate in the requirements phase, and said software defects creep into the product during the system architecture design, and development phases.

"It's easy to see that fixing bugs in post-implementation is significantly more expensive than bug fixes made before the product is released to users, when you consider the time it takes to upgrade and test a client's system after a bug fix," Sherwood said.

"Is it 100 times more costly? That depends on how many client systems are affected by the bug out in the wild and how those systems are patched."

Featured Whitepaper Sponsors
Market Place
 

Smart SOA World Tour

Discover how SOA can create smarter outcomes for your business.

Attend and learn:

  • How SOA is helping leading companies to become more agile
  • Where you should be applying SOA processes in your company
  • The top SOA implementation mistakes to avoid

Click here for more information.
  • +

    CIO Live Podcast #79: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires Part II 05 October, 2007 06:00:00

    For his new book, The Outsider's Edge: The Making of Self-Made Billionaires, social researcher Brent D Taylor spent four years of intensive research investigating the psychological make-up and backgrounds of some of the world's richest men and women, including IT luminaries Bill Gates, Larry Ellison and Steve Jobs. Taylor discovered that, despite working in different industries and coming from different upbringings, they all have one thing in common -- they are all outsiders.
  • +

    CIO Live Podcast #78: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires 28 September, 2007 17:34:25

    For his new book, The Outsider's Edge: The Making of Self-Made Billionaires, social researcher Brent D Taylor spent four years of intensive research investigating the psychological make-up and backgrounds of some of the world's richest men and women, including IT luminaries Bill Gates, Larry Ellison and Steve Jobs. Taylor discovered that, despite working in different industries and coming from different upbringings, they all have one thing in common -- they are all outsiders.
  • +

    CIO Live Podcast #77: Panasonic Speeds Up Trans-Pacific File Transfers, Part III 21 September, 2007 07:00:00

    Part three in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
  • +

    CIO Live Podcast #76: Panasonic Speeds Up Trans-Pacific File Transfers, Part II 14 September, 2007 07:00:00

    Part two in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
  • +

    CIO Live Podcast #75: Panasonic Speeds Up Trans-Pacific File Transfers, Part I 07 September, 2007 07:00:05

    Part one in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
  • +

    SOA What? Why You Need SOA Governance Framework 04 December, 2008 08:32:00

    Adopting services oriented architecture (SOA) in your enterprise without thinking through IT governance can cause something like the Gold Rush in the 1800s; extreme rates of growth and minimal law and order which produce unexpected outcomes.
  • +

    The Myth of Cloud Computing 04 December, 2008 08:25:00

    Why the rapid spread of virtual technology is becoming a security risk
    Why the rapid spread of virtual technology is becoming a security risk.
  • +

    Who Pushed Vendors Toward Better Security? 04 December, 2008 09:38:00

    Hint: It had something to do with pressure from customers and government agencies, writes Oracle CSO Mary Ann Davidson
    Hint: It had something to do with pressure from customers and government agencies, writes Oracle CSO Mary Ann Davidson.
  • +

    CPO & CISO: A Comprehensive Approach to Information 04 December, 2008 08:42:00

    GE CPO Nuala O'Connor Kelly advocates greater CPO/CISO cooperation to place the right value on information assets.
    GE CPO Nuala O'Connor Kelly advocates greater CPO/CISO cooperation to place the right value on information assets.
  • +

    Virtually every Windows PC at risk, says Secunia 04 December, 2008 08:00:00

    Almost all PCs scanned by patch tool have an unpatched app; 46% have 11-plus.
    More than 98% of Windows computers harbor at least one unpatched application, and nearly half contain 11 or more programs at risk from attack, a Danish security company said Wednesday.
CIO Webcast Innovation #8 - What are the biggest roadblocks to IT's involvement in innovation at your company?
Watch the latest latest edition of CIO Innovation which is now available for download.
Watch the webcast
Sign up to the CIO Innovation update email


CIO Live Podcast #79: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires Part II
Listen to the latest edition of CIO Live which is now available for download.
Listen to the podcast
Sign up to the CIO Live email
Whitepaper

The state of Middleware

Middleware delivers unprecedented visibility and control over your business by making timely information available to decision makers. Organisations are using Middleware to leverage their existing IT investments, while optimizing their IT and business operations, securing their infrastructure and driving compliance. Read on to discover how Middleware can help you increase your businesses profitability.