unlocking excellence with agile metrics
TRANSCRIPT
1
2
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 4 -
Metrics Support Desired Outcomes
Outcomes require- Decisions require
• Insights requireoMeasurements
Measurements inspire- Insights inform
• Decisions driveoOutcomes
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 5 -
Agility Throughout the Business System
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 6 -
Enterprise Scale AgileTeams working together deliver value faster
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Cadence and Synchronization
- 7 -
RELEASEPLANNING
DEMO & RETROSPECTIVE
RELEASES / MILESTONES
ITERATIONS (Synchronized)
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Communities Of Practice
AgileTeam
AgileTeam
AgileTeam
AgileTeam
Product ManagerRelease Train Engineer
SM
SM
PO
PO
PO
DeliveryManager
DeliveryManager PO
Organized for the Work
- 8 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
• Measure and improve performance
• Guide team execution and value delivery
• Correlate value delivered with strategic priorities
- 9 -
How Metrics Can Help You Succeed
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
• Build an effective measurement plan
• Identify traps and actively manage them
• Inspect and adapt!
- 10 -
How Do You Get There?
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Agile Metrics to Guide DeliveryWill we meet our delivery commitments?
- 11 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Agile Teams
• Will we complete our work in an iteration (stories, tasks, defects, etc.)?
Agile Delivery Groups
• Will we meet our plan objectives (features, milestones, quality, etc.)?
- 12 -
Agile Steering
13
Oh my!
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 14 -
Maturity and Metrics
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 15 -
Maturity and Metrics
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 16 -
Teams: Healthy Cumulative Flow
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 17 -
Cumulative Flow: WTWF
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 18 -
Teams: Consistent Iteration Health Message
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 19 -
Delivery: Release Tracking
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 20 -
Delivery: Plan and Milestone Progress
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 21 -
Delivery: Initiative Progress
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 22 -
Delivery: Feature Responsiveness
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 23 -
Delivery: Performance Consistency
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Data-driven Continuous ImprovementHow do we achieve our goals over time?
- 24 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Performance KPIs
• Are our teams healthy?
• How much can we predictably deliver?
• What improvements would we value most?
• What improvement action will we try next?
- 25 -
Performance Metrics Support Outcomes
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 26 -
Software Development
Performance Index
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 27 -
Findings
160,00050,000 13,000
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 28 -
SDPI DimensionsProductivity = ThroughputPredictability = Consistency of throughputResponsiveness = Time in process (TiP)Quality = Released defect density
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
The Impact of Agile Quantified
- 29 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Work Interacts (Through Workers) …
- 30 -
… and Impacts Throughput
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 31 -
Work in Process
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 32 -
Limit WiPKey FindingsTeams that aggressively control WiP:
● Cut time in process in half● Have ¼ as many defects● But have 34% lower Productivity
Recommendations● If your WiP is high, reduce it● If your WiP is already low, consider
your economic drivers○ If Productivity drives your
bottom line, don’t push WiP too low
○ If Time To Market drives your bottom line, push WiP as low as it will go
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 33 -
“We can see that there is almost a 2:1 difference in throughput between teams that are 95% or more dedicated compared with teams that are 50% or less dedicated.”
Stable Teams
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Boost Efficiency and Innovation
“We uncovered the performance costs of unstable teams … and are seeing 30 - 50% improvements in both cost and delivery duration compared to similar waterfall projects.”
– Michael Santoro, Director, GVS Global Business Partnership Team
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Recommendations
• Limit WiP• If practicing Scrum, use two-week iterations; task
out stories• Size teams appropriately: 7 +/- 2 for balanced
performance (larger teams are okay)• Have dedicated and stable teams• Encourage small stories
- 35 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
TrapsWhat will impede our outcomes?
- 36 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Common Metrics Traps
1. Manipulation
2. Unbalanced metrics
3. Costly KPIs
4. Availability bias
5. Mechanical decision-making
6. False negatives
- 37 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 38 -
False Negatives
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
Data Integrity Checks for Insights
• Quality stories(avoid stories that are really tasks and/or fake stories)
• Mapping kanban states to schedule state values(especially in-progress and accepted)
• Quantity of in-progress split stories (splitting stories at the end of the iteration)
• Defect state value accuracy
• Consistent use of defect environment field value
• Consistent use of defect priority field
- 39 -
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 40 -
Use Case: Annual Company Disruptions
www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.
The Seven Deadly Sins of Agile Measurement Whitepaper
The Impact of Agile Quantified: SDPI Whitepaper
Agile Reports and Metrics Rally Help
Rally Success Program
- 41 -
To Learn More...
42