Académique Documents
Professionnel Documents
Culture Documents
org
Empirically managed agile transformation
Version 1.2
Situation Overview
However, this market is ripe for disruption by emerging players, and could also be at risk
from larger institutions with new innovation strategies. This risk is perceived by the S & K
Board to be very significant. Unless it is addressed, they expect the company's competitive
1
advantage will be lost in five years. There have been recent instances of valuable
personnel being lured away to work for start-ups with alternative algorithms and
approaches, and hard-to-replace skills and institutional knowledge are now being lost. This
seems to have cast the scent of blood into the water. There have been attempts at
opportunistic purchase by I.P raiders, and worryingly to the Board, these have been under
increasingly poor terms.
Kelton Warren Associates have been engaged as agile consultants on the S & K account.
Discussions with John Sewell, the CEO, and Jim Kemp, the CIO, highlight three essential
concerns:
➢ Firstly, it is felt that the company is insufficiently innovative for today's market. The
CEO believes that innovation opportunities have been missed, and that the
company has become too focused on the maintenance of existing products and
services and has short-changed the development of new ones.
➢ Secondly, the CIO believes that the company's existing operating model is starting
to fail under the strain of demand, ironically due to the success of the business so
far. In particular, clearance and settlement has become a bottleneck as the
techniques currently employed were not designed to scale. Impediments arise
much faster than the cycle time for completing the underlying transaction. The CIO
also believes that far too much of the IT department's efforts is spent on servicing
the technical debt of existing assets and that the situation is unsustainable.
➢ Thirdly, and largely due to an ongoing reactive need to service technical debt, the
CEO and CIO believe that they have a worsening picture of how the organization
can function strategically. Too much time is spent firefighting. Beyond that, they
receive conflicting information which has poor accuracy, is often out of date, and
which does not meet strategic planning needs.
Kelton Warren explain the process of agile transformation in an organization, and how it is
managed. The transformational effort will be captured as a backlog of changes, each of
which is the useful application of one or more agile "patterns", or good practices. The
backlog will be ordered and managed by a sponsored and qualified team: change agents
2
who can roll out transformational change in S & K until the process is normed, and a self-
adapting and self-sustaining innovation network is in place.
Validated Rollout
Transformation Vision
products and services. He also wants Backlog
However Mr. Sewell is too risk-averse to sponsor an agile transformation across the whole
organization at this stage. He is willing to sponsor a local optimization in regards to the
currently unscalable clearance and settlement process, as this will be a constraint on
further change until it is resolved. He will also sponsor agile change in the value streams of
three early adopter initiatives that have been proposed by the CIO. Both men are also
keen to sponsor higher levels of transparency across the whole of the company.
3
Further discussions with the board have resulted in the following vision being articulated
and agreed:
“Within six months, at least three agile workstreams will be in operation which
will serve as exemplars of agile practice for the rest of the organisation, and for
which any dependencies on the delivery of value will have been exposed or
resolved. Settlements will no longer be a constraint to growth, and transparency
across the organisation will be sufficient for wider transformational plans to be
made.”
The board say they are willing to sponsor this vision and to establish the necessary
priorities and sense of urgency for it to be implemented. They are also willing to sponsor
and empower a transformation team to guide the organization through its journey.
transformational vision.
4
➢ Mr. Joseph Kemp, the CIO, agrees to own the transformation backlog since the IT
function underpins the operating model of the company.
➢ Dr. Samantha Henley (Kelton Warren Associates) is engaged as the agile coach on
this account. She explains that she wishes to coach as far as possible through S &
K's own Scrum Masters, thus helping to develop an in-house coaching competency.
people manages the clearance and settlement process for transactions. Many are
bespoke or involve off-exchange companies which rarely expose their stock to third
parties. These transactions are not handled through CREST or any similar
electronic system. This creates work whenever impediments arise as they require
manual intervention. In the early days of the company there were perhaps three or
four such exceptions in a week. However, due to growth of the business, the
opportunities provided by off-book trades, and changes in the portfolio algorithms
which emphasize concierged investment services, there are now around thirty a
day. Clearing and settling an impeded transaction can be expected to take the team
over 24 hours.
➢ Equities Alpha. This team of eight developers was responsible for developing S &
K's investment platform. This platform consists of bespoke tools which allow
portfolios to be curated via concierged services that use custom business analytics.
This platform is the company's "crown jewels" in terms of intellectual property, and it
underpins their operating model. The analytics platform has a good level of
automated unit testing, but the concierged services are not subject to test
5
automation at all. Alpha would like to introduce BDD coverage for these services at
some point, but currently does not have the resources or time to do so. They also
have problems regarding the priority and scope of work, since the company has
many stakeholders in its operating model and requests for changes can come from
several parts of the organization. Additionally, they find that they repeatedly "lose"
members of their teams to Gamma when the demands of servicing technical debt
become too great.
➢ Equities Gamma. A team of five developers, Equities Gamma is tasked with
servicing low-risk technical debt incurred by the platform. As with Team Alpha, the
priorities for servicing technical debt are confused due to there being multiple
stakeholders in the platform. Furthermore the remits of this team and the DevOps
Customer team have become blurred, and there is some tension between them.
More significant cases of technical debt are however serviced by Equities Beta
which, due to the critical nature of its work, is being excluded from the
transformation initiative for the foreseeable future.
➢ DevOps Customer. A team of 11 people, this team implements small changes to
platform services, principally to do with customer-level optimizations. In theory this
team also handles defect fixes to the codebase, but in practice these tend to be
handed over to Gamma or Beta as matters of technical debt. Perhaps due to the
variation in the type of work handled, the throughput of this team is unpredictable
and the ability to forecast delivery times is poor.
➢ PMO. The PMO consists of a senior project manager and a recently hired assistant.
The manager has extensive experience of corporate governance in stage-gated
environments, mainly in the public sector. The assistant comes from a small
company quality assurance background, and seems to be rather more familiar with
agile ways of working. Both are keen to develop their prospective roles within a new
agile governance function.
The agile coach, Samantha Henley, explains to Jim Kemp, the Transformation Backlog
Owner, that the Transformation Backlog will be worked through iteratively at a
transformation cadence. Enough of a backlog must be in place to fuel at least one
transformation cycle, so that progress can be assessed on-cadence and the validated
6
learning loop closed. The progress of the agile transformation initiative can be inspected
and adapted accordingly.
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
Since Jim also wants a better understanding of the issues affecting settlements, Samantha
recommends adding a specific item for establishing transparency over this with a
mitigation plan, so exceptions can be raised to the PMO. Samantha expects that she will
have to coach new and better teamwork practices for these changes to take effect.
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
7
Of course the sponsor wishes to improve transparency across the organization, and not
just in Settlements. This is another item for the Transformation Backlog: to improve
oversight of team risks and issues through an emergent Agile PMO, who will be able to act
on tolerances by exception should they be exceeded. Since this would be a significant
undertaking if all teams were to be targeted at once, Samantha recommends that the initial
focus be constrained to Settlements - where enhanced transparency is most urgently
needed - and on testing the remit of the new Agile PMO with this one team. The form this
transparency takes is left open, but some sort of dashboard, possibly with RAG status
levels, is suggested. Satisfactory progress would be evidenced if at least one agile health
check was conducted by the PMO. Jim agrees to this and prioritizes this work above the
last backlog entry, since it would help to establish the PMO's function in regard to this item.
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
The desired outcome is to have oversight of team risks and issues. The form this takes is
left open. However, it is expected that at least one health check will be conducted with the
Settlements Team. In other words, it is hypothesized that if just one health check can be
conduced for this team, then it will be enough to prove that satisfactory oversight can be
attained. This is therefore the only acceptance criterion for this item.
Due to the confusion in Alpha and Gamma teams regarding scope and priority, and
increasing tension between Gamma and DevOps Customer in terms of their remits,
Samantha recommends that platform product ownership be clarified and brought under
control, and team boundaries stabilized. An ability to account clearly for expenditure and
team utilization will therefore be key. A single Product Owner should be evident to both
Alpha and Gamma. The PO should have control over the budget, and the scope and
priority of work being asked of teams. This is the next item added to the Transformation
Backlog.
8
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
For this change item, clear accountability for value delivered and resources consumed is
what is wanted. It is hypothesized that this can be achieved by improving product
ownership for each team, such that it encompasses budget and scope. These are
therefore framed as the acceptance criteria.
As the Transformation Backlog Owner, Jim believes that the DevOps Customer team is the
next most important priority. The team's throughput is unpredictable, with some work being
delegated to Equities Gamma or Alpha. Samantha, the agile coach, suggests that weak
backlog management could be at the root of the problem, and that work which the team
are not prepared to do should be kept off the backlog altogether. With a well-maintained
backlog that is curated and owned by the DevOps Customer team, throughput can be
expected to stabilize and forecasting is likely to improve. She recommends coaching the
team to exercise this control on a daily basis through 15 minute team huddles.
Improved backlog management and forecasting is what is wanted for this change item.
The hypothesis is that a full week of daily huddles will facilitate this, and so this is set as
the criterion for acceptance.
Note that each item in the Transformation Backlog is estimated by Samantha to indicate its
relative coaching effort. This will help her gauge how much coaching work she can take on
during a Transformation Heartbeat. Only a coach is in a position to make such estimates.
9
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
Information Radiator,
Backlog of work for service delivery Team has conducted a full week
Inspect and Adapt,
is up-to-date, forecasts become DevOps Customer Team of daily huddles and metrics are 1
Backlog,
reliable stable from Customer perspective
Metrics
The need to improve the level of automated test coverage has been highlighted by Alpha,
and Jim believes that this is a general weakness across the platform estate. Samantha
recommends that BDD training be included on the transformation backlog so that the
sponsorship for it is made clear, and so that it can be prioritized appropriately. Settlements,
Alpha, and Gamma would all benefit and so an "epic" level transformation item is added to
the backlog, which targets all three teams. Samantha explains that as this item moves up
the transformation backlog it will be subject to further refinement, and may be potentially
broken down into BDD implementation items for each team which can be progressed
independently.
In essence then, improved traceability from business requirements to code is desired. That
is the real value of BDD test coverage. The Transformation Team hypothesize that BDD
training will be enough to kick-start this process, and so a training course is set as one of
two acceptance criteria. The second is that actual coverage must demonstrably improve
with each code check-in.
This is a particularly large coaching task and Samantha estimates it accordingly. She
explains to the Transformation Team that it will need breaking down into smaller, more
focused coaching tasks before the desired change can happen and traceability is
obtained.
10
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
Information Radiator,
Backlog of work for service delivery Team has conducted a full week
Inspect and Adapt,
is up-to-date, forecasts become DevOps Customer Team of daily huddles and metrics are 1
Backlog,
reliable stable from Customer perspective
Metrics
Samantha recommends that two other items be included on the transformation backlog at
this early stage. Firstly an organizational Definition of Done should be established which
asserts minimum quality levels. This will allow the organization, through the PMO, to have
oversight of team quality so risks to brand and business are controlled. Each team should
then improve on the standard by establishing and maintaining its own Definition of Done.
The second item that Samantha recommends be included is the production of a timebox
review record by each team. This may take the form of burndown or burnup charts which
show the progress of work done and work remaining. An information radiator may be used
for this purpose, or summary documents can be produced for stakeholders. The objective
is to ensure that transparency and control can be evidenced by each agile team.
11
The early adopter teams are therefore expected to provide better visibility of work
remaining to stakeholders. That is the desired change. If teams can provide that visibility in
the form or a burndown or burnup chart, such as in a timebox review record or similar
presentation, then that would be satisfactory as an acceptance criterion.
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
Information Radiator,
Backlog of work for service delivery Team has conducted a full week
Inspect and Adapt,
is up-to-date, forecasts become DevOps Customer Team of daily huddles and metrics are 1
Backlog,
reliable stable from Customer perspective
Metrics
Settlements Team,
Organization has oversight of team Equities Alpha Team, Organizational Definition of Done
quality so risk to brand and Done Equities Gamma Team, is articulated, owned by PMO, 5
business is controlled DevOps Customer Team, and referenced by all teams
PMO
Samantha explains to Jim and John that, as the Transformation Team, the three of them
are responsible for shaping and guiding organizational change. They will need to to meet
at regular intervals to inspect and adapt the progress being made, until such time as self-
managing agile teams are in place. They will need to exert a greater level of control to
begin with, but as the teams mature and become accountable for their own agile ways of
12
working, the Transformation Team will be able to entrust them to a greater degree. This
implies that the transformation cadence should initially be quite short...with more
opportunities for the Transformation Team to inspect and adapt progress...and that it
should be expected to gradually lengthen. Samantha recommends that the Transformation
Cadence be set initially to one week, as this would allow enough time for reasonable
attempts at coaching Transformation Backlog items to be made. During this time, she
believes she can start to coach items 1, 2, 4, and 5 on the Transformation Backlog. Item 3
is dependent upon item 2 and ought to be deferred until after the first transformation cycle.
The transformation team has agreed to meet, once a week, to inspect and adapt the
progress of organizational change. However, this does not mean that a weekly cadence is
appropriate for delivery teams themselves. Their cadence is influenced by other factors,
such as the optimum release frequency inherent to the product environment, and their own
ability to inspect and adapt their engineering process.
After meeting with the delivery teams, and the business representatives of the platform
product, Samantha recommends a 2-week Sprint cadence for Equities Alpha and Gamma.
This will allow the teams to frame reasonable Sprint Goals for the product, to co-ordinate
with each other on the same cadence, and to delivery significant increments of business
value. A twice-weekly cadence will also allow the Transformation Team a mid-sprint
13
opportunity to assess progress and to remove any impediments, until such time as the
PMO is in a position to provide oversight and governance.
As the agile coach on the Transformation Team, Samantha now begins to coach the
changes on the backlog. Four items are identified by her as achievable in the first
heartbeat and brought into progress. One issue (for an issue mitigation plan) is deferred
for consideration in the next heartbeat because of its dependency on establishing
organizational oversight of team issues.
Item Selected Patterns Target Beneficiaries Acceptance Criteria Coaching Estimate
Teamwork,
Throughput increase of 50% in end-
Limited WIP, Settlements Team WIP limited to 5 items 3
of-day settlements
Value Stream
Information Radiator,
Backlog of work for service delivery Team has conducted a full week
Inspect and Adapt,
is up-to-date, forecasts become DevOps Customer Team of daily huddles and metrics are 1
Backlog,
reliable stable from Customer perspective
Metrics
14
➢ Item: “Throughput increase of 50% in end-of-day settlements”. Samantha
coaches the Settlements Team to limit their WIP to 5 items. She teaches them to
understand their value stream and to collaborate, as a team, so that throughput can
be increased. Daily huddles
are introduced as key inspect- Change Actioning
and-adapt opportunities in this Transformation
Rollout Team
Backlog
regard.
➢ Item: “Organization has
Transformation
Heartbeat Daily
oversight of team risks and Team
Cadence
Cadence
issues”. Samantha coaches The current highest
priority item is taken
from the backlog by
the PMO to conduct an agile the Rollout Team and
applied to the Delivery Teams
identified Suitable targets
15
Step 8: Keep a finger on the pulse, every day
Cadence
Changes are
daily sessions provide an opportunity for actioned as soon
as the Rollout
Team's WIP limit
Samantha, and the teams, to assess and the targeted
Delivery Team's
Delivery Teams
cadence allows 10
16
owners, outside of the daily scrum forum. Product Owners are no longer allowed to
participate in daily scrums...a change which is resisted by the affected Business
managers, and which Samantha has to quietly escalate to the sponsor so he can
handle the politics his own way. Also, no progress is being made on revising
budgetary controls. The CEO, as sponsor, then has to make his sponsorship for
deep change across the organization evident.
➢ Item: “Backlog of work for service delivery is up-to-date, forecasts become
reliable”. In each daily huddle, the DevOps Customer team are taught to keep their
metrics up-to-date with regard to cycle times, throughput, and latency. Opportunities
to limit WIP further are exposed, such as by combining certain stations in the value
stream. By the fourth day, throughput metrics are obtained which suggest a
steadying rate and a probability of being able to assert a standard deviation metric
in the near future.
being met? Have the changes been Rollout Team brought into progress from the backlog.
Transformation
17
➢ Item: “Organization has oversight of team risks and issues”. The PMO has
conducted a health check with the Settlements Team, and it is available for
inspection. The acceptance criteria for this change are therefore met.
➢ Item: “Resources of Equities Project are stabilized, brought under control”.
The Equities Alpha and Gamma teams now have clear product ownership and
agreed Sprint Goals. Following mid-week intervention by the Sponsor, Product
Ownership and development team responsibilities are more clearly delineated, and
business interference in team decision making has been reduced. Team boundaries
have begun to stabilize. Budgetary authority has now been devolved onto Product
Owners, albeit only in the narrowest official terms. The acceptance criteria are met.
➢ Item: “Backlog of work for service delivery is up-to-date, forecasts become
reliable”. The DevOps Customer Team is able to offer throughput and cycle time
metrics and some projections for latency. The acceptance criteria have been met.
18
➢ Item: "Organization has oversight of team risks and issues". A satisfactory
health check has been conducted for Settlements and so the acceptance criteria
have been met. Empirical evidence of improved organizational oversight is available
in the form of a dashboard. The Transformation Team have clear visibility of RAG
status levels: 20 Red, 11 Amber, 12 Green.
➢ Item: "Resources of Equities Project are stabilized, brought under control".
Ownership of the Product Backlog has been clarified to teams Alpha and Gamma,
with budgetary authority having been vested in a clear Product Owner. The
acceptance criteria have thus been met. There is empirical evidence of the desired
stabilization and control of resources. A budget of £20,100 per Alpha Sprint has
been allocated along with £14,800 for Gamma; these budgets are all under control
of the respective PO.
➢ Item: "Backlog of work for service delivery is up-to-date, forecasts become
reliable". The DevOps customer team can offer stable throughput metrics of the
quality hoped for, and team huddles have been conducted each day to the
satisfaction of the Transformation Team. The acceptance criteria are met. Empirical
evidence of an improved forecasting ability is available: throughput averages 3
items per day, with an average wait 5 days. However, there is evidence that the
team backlog is still not being kept up-to-date.
19
improvement is found, then a change and its acceptance criteria may not have been fit for
the intended purpose, and lessons must be learned.
20
conducting daily huddles for DevOps Customer did improve the quality of the
available metrics, the team did not keep their backlog current. Nevertheless, the
acceptance criteria were met and so this change item must be closed. Since
additional work needs to be done to achieve the change desired, a new change
item must be added to the Transformation Backlog with improved acceptance
criteria. A specific item for controlling the service delivery backlog is therefore
added, with the expectation that the DevOps Customer Team find their own solution
to the problem. Options, such as coaching backlog refinement sessions with the
team, will be available. The acceptance criterion is that the DevOps Customer team
must provide clear evidence to the Transformation Team that their backlog is being
managed.
One full heartbeat of the transformation cycle has now taken place. At the start of the
heartbeat a small number of changes from the Transformation Backlog were brought into
progress and coached. By the end of the heartbeat, we are able to see that 3 of those 4
items have been completed to the satisfaction of the acceptance criteria, and may
therefore be closed. One item still remains in progress, since its acceptance criteria have
not yet been met and the proposed change remains viable. Lessons have been learned
which will facilitate its implementation over the course of the next transformation heartbeat.
One new item has been added to the Transformation Backlog in order to bring about a
change for which new acceptance criteria are clearly needed.
21
A transformational strategy is determined by two components. These are:
➢ the Strategic Vision, which frames the hopes and ambitions of the Sponsor for
organizational change, and
➢ the Transformation Backlog, the content and ordering of which is the Transformation
Team's plan for implementing the Strategic Vision.
John Sewell (the CEO and Sponsor), Jim Kemp (the CIO and Transformation Owner), and
Samantha Henley (the Agile Coach) comprise the Transformation Team. This small group
have started the transformation and taken the company through one initial cycle of
change. They have started in a small way, but the initiative has gained traction and the
team may soon be in a position to extend it further. So now, at the end of the first
transformation heartbeat, the vision for change can be reviewed and challenged:
“Within six months, at least three agile workstreams will be in operation which
will serve as exemplars of agile practice for the rest of the organisation, and for
which any dependencies on the delivery of value will have been exposed or
resolved. Settlements will no longer be a constraint to growth, and transparency
across the organisation will be sufficient for wider transformational plans to be
made.”
This vision still appears to be useful and achievable to the team. The team see no need to
revise it at this stage...but they expect they will do so as the transformation progresses,
and almost certainly as the six-month window nears. Their view of organizational strategy
will very likely have changed by then, and will continue to change as the strategic planning
horizon rolls forward. For example, if progress is good, the vision may be extended to
encompass further teams. Samantha has suggested that innovation and improved quality
might also form part of the evolving vision, an idea which John and Jim find interesting and
agree to consider further.
Now the team turn their attention to the Transformation Backlog. Three of the eight original
items have been actioned and closed in this iteration. One new item has been added, and
one is currently in progress. The Transformation Team now ask themselves: How well
does this backlog reflect the organization's strategy for change? Can we improve it?
22
Samantha, the agile coach, recommends that one further change should be considered at
this stage. If the three agile workstreams are to be exemplars of agile practice as per the
strategic goal, they will need to become less reliant on an agile coach. Scrum Masters,
and others in a similar position, ought to be able to provide the necessary help and
guidance to their teams, and to potentially represent them in the future at a Transformation
Team level. This will require one-on-one coaching with each Scrum Master or equivalent
leader so they can fulfil such a role. An item for Scrum Master coaching is therefore added
to the Transformation Backlog. An objective assessment of basic Scrum Master knowledge
would be a useful measure at this stage, and so the passing of a elementary online test is
set as the acceptance criterion. This item is prioritized by the Transformation Owner to the
top of the Transformation Backlog.
Now that the first transformation cycle is over and the validated learning loop has been
closed, the next cycle can begin. The Transformation Team are in a position to choose
further changes from the backlog, to bring them into effect over the next heartbeat, and to
continue guiding the organization on its agile transformation journey.
23