Agile software development is designed to thrive within even the most dynamic business and technical environments. In fact, according to an article on the website of Martin Fowler, a well-known Agile industry leader, the name 'Agile' was chosen because its founders viewed 'adaptiveness and response to change' as the most essential concept of the methodology.
All Agile methodologies include integrated practices and processes that manage evolving requirements to efficiently develop a continuous stream of new software capabilities. However, what Agile does not address are changes related to enterprise support of the Agile process or tasks that fall outside the scope of the project work, including:
- How to effectively manage an organisation's internal personnel so that the appropriate stakeholders are available throughout the course of a project.
- How to gather and prioritise the most important features desired by the organisation throughout the ongoing development cycle.
- How to adjust the notion of needing training in a continuous release environment.
- How to ensure customer team members are informed by the full breadth of stakeholders required for enterprise acceptance.
- How to secure timely approval of new technologies that a team would like to leverage.
- How to address stakeholder discomfort with cultural, business, social or other non-technical changes related to software implementation.
Each of these challenges is compounded when organisations operate multiple Agile projects simultaneously. Such unaddressed issues can cause IT projects to ultimately fail, even if executed perfectly within the scope of the development teams and meeting all project acceptance tests. On his blog, Jim Markowsky, an expert in change management, noted that the vast majority of large-scale IT initiative failures are actually caused by factors other than technology.
Enterprise change management (ECM)
Enterprise Change Management (ECM) provides a framework that addresses many of these missing factors. This article focuses on how organisations can leverage ECM practices in conjunction with their Agile development teams to foster IT delivery adoption.
In their book titled: "The Heart of Change," John P. Kotter, a world-renowned speaker on leadership and the Konosuke Matsushita Professor of Leadership, Emeritus at the Harvard Business School, and co-author and consultant Dan S. Cohen, view the core pattern associated with successful change as "See-Feel-Change." To move stakeholders from the type of negative thoughts and feelings depicted in the image above, an ECM program must communicate a vision of the change that is compelling enough to not simply overcome negative preconceptions but also motivate positive participation.
Project and executive managers tend to treat those who will be impacted by software initiatives as if they were Vulcans, not humans. Of course, stakeholders are more like Kirk than Spock. Humans don't coldly and rationally evaluate information and form impressions based solely upon logic. Instead of withholding judgment on an impending change such as a new software initiative, people tend to make gut-level intuitive leaps that are often negative in nature, and resistant to new evidence to the contrary. This assumes, of course, that those impacted are even cognisant of upcoming changes. In Switch: How To Change Things When Change is Hard, authors Chip and Dan Heath use the metaphor of "Rider, Elephant and Path" to describe three primary areas that must be addressed in change management.
The Rider is our inner Spock. A stakeholder cannot support a change until he or she can understand its purpose and the concrete changes that will likely occur. The type of 50-page technical documents and 100-element flowcharts that developers often create under a "waterfall" approach must be translated into clear, high-level infographics for non-technical stakeholders.
The Elephant represents our subconscious and emotional levels. ECM influences the elephant through communication that creates positive feelings and mitigates negative emotions such as mistrust, anxiety and anger. For instance, messaging may focus on how the change will solve an existing problem that vexes stakeholders.
The Path addresses the environment within which the change occurs, including changes to the physical environment such as the arrangement of office space, and processes or procedures such as kanban.
There are several formalised ECM models that have been developed to standardise change management within organisations, with processes and practices that support the entire lifecycle of a change initiative. The principles and activities described in this article can be adapted to any existing corporate ECM infrastructure. They can also be applied within organisations that do not yet have an established ECM process in place.
The unique enterprise change management demands of Agile software development
Ironically, the more successful an Agile project is in rapidly developing new capabilities, the greater the ECM challenge may be. Although Agile's customer-led iterative approach significantly reduces the magnitude of changes related to each software release, it greatly increases their frequency. Instead of being asked to adapt to a single release that institutes a significant number of changes created within "waterfall's" typical multi-year release cycles, stakeholders must accustom themselves to an ongoing series of small, incremental releases every month or two.
Having an ECM program is especially important for enterprises transitioning to Agile from a phase-based development methodology. Corporate cultures that are accustomed to traditional development release cycles can be strained by a shift to more frequent releases and the ongoing interaction required by participation in the iterative process. There is a higher level of stakeholder involvement required throughout the development process. The impact of a new Agile implementation cuts across technology and functional groups, from top management down to the frontline worker. An ECM effort can help break down the organisational sensation of feeling burdened caused by the insistence of Agile teams for day-to-day customer involvement.
Introducing ECM to the Agile team
Simply introducing basic ECM concepts to an Agile team can actualise the potential of existing Agile practices to foster positive change. For instance, customer-focused user stories and acceptance tests can be informed by ECM considerations. This new perspective can tangibly improve the way IT and business sides of an organisation work together. The resulting synergies build a heightened level of trust and provide a means to measure and track success of not only the technical quality of software, but its acceptance by end-users.
If the customer already has an institutionalised change management practice, bringing ECM personnel into the Agile team's release planning process is a good first step. They will be able to anticipate potential change management issues related to a release and work with the team to synchronise their efforts. For customers who are transitioning to Agile from a traditional waterfall methodology, ECM involvement is a good tool to foster participation by business stakeholders.
When an organisation is ready to integrate ECM tasks into an Agile software development project, securing an ECM subject matter expert for the team is the first challenge usually faced. If the organisation has existing ECM expertise, personnel can be shifted onto an Agile team. If there are no available resources, it may be necessary to hire an ECM subject matter expert or send an existing team member through an ECM training program. Once staffed, a basic approach is to integrate ECM into the Agile development process by simply having ECM requirements progress through the same processes as technical requirements, including user stories, acceptance tests and the iterative development of deliverables. ECM team member and developers participate in the same customer planning meetings and stand-ups.
Take for example the implementation of a portion of a typical change management plan. In conjunction with an upcoming Agile software release, change management requirements might include:
- Create a stakeholder list.
- Create a series of surveys on stakeholder attitudes.
- Contact these stakeholders, and socialise the survey results.
Tasks required for the delivery of iteration can then be broken down into stories, for example:
- Make a list of stakeholders in a certain business group.
- Create a survey covering these specific questions.
- Create an analysis spreadsheet.
Creating ECM stories in the same manner as their development tasks deeply integrates change management into the Agile process. In fact, these stories can be created in a test-driven development manner. For the above story examples, a test could be written proving that:
- A stakeholder from the business group is included in the stakeholder list.
- A survey covers a specific required content item.
- The analysis spreadsheet has a correct column.
At the start of each iteration, these tests would initially fail and would begin to pass as these change management stories are fulfilled. ECM tests and their pass/fail state can be illustrated on the Agile teams' continuous integration dashboards. Making these dashboards available organisation-wide provides all stakeholders maximum insight into teams' overall progress to heighten project awareness across the enterprise.
By integrating ECM into Agile development, the development team can escape the project stovepipe and extend its vision to the greater enterprise. Every veteran Agile manager has watched hopelessly as a project that met every customer requirement failed due to external factors beyond their control. Although ECM does not give the project team absolute control over its destiny, it can substantively expand the domain of its influence.
Dr Myles Bogner is the vice-president of research and development for Asynchrony Solutions. He is an advocate and practitioner of Agile processes and continually guides teams to apply Agile techniques. David Elfanbaum is cofounder of Asynchrony Solutions, the 'Geek Interpreter Guy' (aka vice-president of marketing). For more information, visit asolutions.com and blog.asolutions.com.
Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.