Critical.
Authoritative.
Strategic.
Subscribe to CIO Magazine »

How IBM started grading its developers' productivity

IBM has plenty of application development tools at its disposal, including those from its own Rational software line. But tooling and process can only go so far to assure code quality.

"At the end of the day, people are in the middle" of application development, says Pat Howard, vice president and cloud leader in IBM's global business services division. "It's really important to have great investments, great energy focused around the talent."

Howard led application development at IBM, where he was responsible for delivering applications across all of Big Blue's brands and overseeing its global development teams. On the talent front, he helped implement a system for analyzing individual application developers based on the volume and quality of their work.

FAVE RAVES: 22 IT pros name their favorite products

The core of the system is a commercial software product from Cast. The French vendor's automated software analysis and measurement platform provides metrics around the structural quality of application code and the performance of development teams.

Using the Cast platform, IBM managers can analyze how a developer pieces code together, for instance, and make a quantitative determination of the developer's abilities. The system can review the code's performance, security and technical depth -- gauging, for instance, whether the code going to have a lower cost of maintenance in the long term.

"If you're writing something in Java, is the code itself structured in a manner that is compliant with what is recognized as an industry best practice? That's the type of science that Cast helps produce," Howard says.

It's a quantitative analysis, rather than a subjective observation. [See also: "5 requirements for measuring application quality"]

In the past, it has been a challenge for IBM to manage application development talent in a way that's reliable and predictable, particularly since teams are scattered around the world, Howard says.

Plus, the demand on development teams is constant. Anytime IBM makes a change to the business -- an update to its supply chain, adding new salesforce capabilities, or preparing a new product release -- invariably there are application changes required.

Taking the time to identify IBM's top software developers wasn't easy. Nor was it easy to figure out if all of its developers were fully utilized. Plus, utilization alone isn't an effective way of measuring the contribution of an individual. Is a developer producing quality work?

The Cast technology answers those questions and more while bringing some science to its measurements, and it also plays into IBM's plans to motivate its developers.

"When you think about a software developer, and you think about that talent, what are they interested in doing? A lot of them want to write software. That's why they went into the profession. But they also want to be known as the best software developer on the planet Earth," Howard says.

By defining sets of outcomes, or measures, that everyone in IBM's software development community (and its HR reps) could agree on, the Cast system makes it possible to quantify performance. "Essentially it permitted our people to walk around with a scorecard. They could begin to earn points, based on the results or the value they were driving for the business," Howard says.

With IBM's new system, reputation becomes something tangible. "Somebody can enhance their reputation within the community based on results that they're delivering."

The program also helps to identify performance shortfalls and skills deficiencies. "We use it to identify where more training is needed," Howard says. Training budgets are tight, so "when you spend it, you've got to spend it really smartly, aim it at the right place."

It also enables developers to get on-the-spot insight into the quality of the work they're producing. With that kind of feedback, developers can make mid-course corrections that are necessary to succeed, Howard says.

So how do IBM's developers feel about the grading system?

Reactions are mixed, Howard says. Some developers embrace it aggressively -- especially those who tend to be data-driven, he says. Some are proactive about using the system to get feedback on their own work. Other times managers bring the data to a team member's attention.

"This is never intended to be a penalty conversation," Howard points out. "We're in a continuous learning environment, and if everybody feels safe around that point, it can be better integrated."

Overall, the system has proven to be very valuable, Howard says. "It has really wrapped our worldwide community together in a way that we didn't anticipate."

Read more about infrastructure management in Network World's Infrastructure Management section.

Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.

More about: Big Blue, IBM, IBM Australia
References show all

Comments

Post new comment

The content of this field is kept private and will not be shown publicly.
Users posting comments agree to the CIO comments policy.
Login or register to link comments to your user profile, or you may also post a comment without being logged in.
Related Coverage
Related Whitepapers
Latest Stories
Community Comments
Tags: application development, IBM, infrastructure management, management, networking, software
Latest Blog Posts
Whitepapers
  • Look both ways - Protecting your data with content inspection
    Today’s threat environment is as dynamic as the business world in which we operate. As the communications channels we use continue to proliferate and evolve, so too have the vulnerabilities. Finding the right balance between ensuring the security of sensitive data, enabling the free flow of information and making full use of the latest web-based technologies can be a challenge. Deep content inspection is a vital layer in any unified information security strategy, helping organisations to take control over their information assets while proactively protecting against malware and data leakage. Read on.
    Learn more »
  • Case Study - TNT Express successfully reduces their paper usage and costs using a new document solution
    in 2009 TNT decided to evaluate the market for new head office multifunction devices (MFD) as their current MFD fleet was almost seven years old. The objective was to reduce the number of devices and improve productivity, meet TNT’s future technical requirements and reduce the total cost of ownership of the equipment. They were also looking for a provider who would provide cost and service reporting as well as help streamline their electronic archiving requirements via the scanning of dockets and documents. Read on.
    Learn more »
  • Maximise Software Cost Savings by License Reharvesting, Recycling & Applying Product Use Rights
    Software asset management (SAM) is a complex process that enables organisations to gain control of their software estate from both a license compliance and financial standpoint. In many organisations, SAM represents one of the few remaining ways that substantial IT savings can be realised. McKinsey and Sand-Hill Group estimate that 30% or more of IT budgets are consumed by software license and maintenance costs. By optimising the SAM process, organisations can maximise software utilisation, reduce the risk of non-compliance (audits, fees, penalties), and reduce overall IT costs by as much as 5 to 10% per year. Read on.
    Learn more »
All whitepapers
rhs_login_lockGet exclusive access to Invitation only events CIO, reports & analysis.