Do not underestimate the danger technical Lem Orhan ERGN Principal Software Engineer @ Sony @lemiorhanagilistanbul.com debt @lemiorhan

Lem Orhan Ergn Principal Software Engineer at Sony has worked in Tsside, BYM, GittiGidiyor/eBay and Sony as lead developer, team leader, technical coordinator and scrum master got CSM certicate from Jim Coplien year as Scrum Master sprints in 4 years as team member and scrum master experienced in agile transformation and building agile culture in teams & organizations 2001 2013 2009 1 56 agile CSM, PSM1 financial debt and the metaphor expensive DEBTsin every second of our lifeWe incur Living is taxes gas fuel water phone electricity rent credit cards cabletv tuition TOLLS mortgageschool payments transportation Holidays INTERNET 3g/4G municipal services shopping communication food health entombment Parking Financial debtis not always a bad thing. It lets us buy what we want or what we need and keep us live at some level. Financial debtis dangerous if the incurred interest and the debt itself are not payed Financial debt is a silent killer Financial debt hides problemsand leads to other problems technical debtis a metaphor developed by Ward Cunningham in 1992 to communicate problems due todeveloping not in the right way with non-technical stakeholders. metaphor noun me-t-for also -fr a word or phrase for one thing that is used to refer to another thing in order to show or suggest that they are similar deficit Enron financing paying the principal debt Interest on the debt bankruptcy borrowing money Intertest on the loan Inflation financial burden very similar technical debt is to financial debt the cost technical debt costs money, time and effort to stakeholders, developers, companies, even to economies most companies have to spend 80% of their software development budget maintaining code Aaron Erickson, Informit.com U.S. Air Force pulls plug on ERP project after blowing through $1 billion chris kanaracus, CIO.com we dont know how much technical debt is really costing us Jim bird, Agile.dzone.com Technical debt is like smoking addiction. Once you start hacking your code, the code asks for more. you never know what that will cost in the future. Lem Orhan ERGN, Agilistanbul.com High amount of Technical Debt is #1 impediment to teams being agile Dan Rawsthorne Sufficient amount of messy code may bring whole Engineering department to a stand-still Sven Johann & Eberhard Wolff, Infoq the description 2 ways of doing things clean and smart way takes longer to implement but make changes easier in the future quick and dirty way get your features sooner, but make the future changes very hard why should the sponsors of a project accept higher costs ? Question: why should the sponsors spend money on features that dont deliver business value ? Question: Living with technical debt might work perfectly for customers if it delivers the desired business value Answer: but this will lead an uncontrollable codebase, extremely specialized developers and to an inflexible product Shipping firsttime code is like going into debt a little debt speeds development as it is paid back with a rewrite Its a question of Pay me now or Pay me later good or bad ... if you have strategic design decisions. It allow rapid delivery to elicit quick feedback and correct design. However, clean code is required to pay back debt therefore the code sould be refactored ncurring technical debt is a good idea ... if principal amount and interest is smaller than the yield of investment. Sometimes, you don't have to pay back the debt, it is pointless if the code won't be touched again ncurring technical debt is a good idea ... because having messy code and cutting quality slows you down in reality. And you must generate more mess to keep up. Do you ask permission to do your job correctly???? ncurring technical debt is a bad idea extend the metaphor similarities with financial debt Every minute spent on not-quite-write code counts as interest on the debt Interest Image by Martin Schoeller from Identical: Portraits of Twins book similarities with financial debt Refactoring is like paying off the principal debt paying the principal debt Image by Martin Schoeller from Identical: Portraits of Twins book similarities with financial debt Neglecting the design is like borrowing money borrowing money Image by Martin Schoeller from Identical: Portraits of Twins book similarities with financial debt Bankruptcy refers to a situation of overwhelming debt interest, whereby progress is halted and a complete rewrite is necessary bankruptcy Image by Martin Schoeller from Identical: Portraits of Twins book similarities with financial debt It occurs when the current level of technology is old enough to lose compatibility with the industry technical Inflation Image by Martin Schoeller from Identical: Portraits of Twins book similarities with financial debt It represents technical frauds undermine ROIs Enron Financing Image by Martin Schoeller from Identical: Portraits of Twins book similarities with financial debt Throw away prototypes, retired products and complete failures on will-not-be-used components does not have to be repaid amnesty Image by Martin Schoeller from Identical: Portraits of Twins book the Symptoms the loss of productivity We cannot measure productivity, that's why we can't really see real the true effect of technical debt and losing motivation and morale Increase in testing If the team does the same tests again and again on every release or testing takes too much time, the debt seems to be in critical level. the death by manual testing Postponed stories in releases Postponed releases It becomes harder to catch the deadlines. An increase on the postponed releases rate is an indicator. being not ready to go Code duplication Code duplication leads to update anomalies, purpose masking and issues on understanding code copy & Paste programming Low code coverage 100% coverage is the asymptotic target. Below 75% indicates serious problems. not knowing how sW behaves Increase in bugs The increase in number of bugs directly shows the decrease of quality and too much support cases heavy stress on appoaching deadlineS The team is under heavy stree at the end of releases or when the deadlines are approaching being scared of changing anything Software is so brittle that developers are scared of changing anything in the code not to break. Adding new features starts to cost more and more. Evil hacks wrong design Its hard to detect the debt in advance, but any hacks and workarounds could cause issues in the future wrong choice of technology Not the most mature, not the newest, not the simplest... Choosing the cheapest-to-adapt is the key to pay the debt. unreadable code Developers spend 80% of development time for reading code. You cannot build if you cannot understand. hard to understand what happens decreased velocity Decreased team velocity is a good indicator for possible impediments that slows the team down even if nothing has changed Using old libraries Softwares age and cause technical debt by time. Maintenance costs are the main expenditure item. and technologies Reports of Sonar Sonar Reports Softwares age and cause technical debt by time. Maintenance costs are the main expenditure item. with technical debt plugin bad smells The indicator of weaknesses in design that may be slowing down development or increasing the risk of bugs or failures in the future Only he knows can change this part Lets copy & paste this code If I touch, everything will break Too many TODOs or FIXMEs in the code 36 classic mistakes Making mistakes is inevitable. Only experienced software developers realize when they're making mistakes. outlined in McConnell's Rapid Development http://www.construx.com/10x_Software_Development/Classic_Mistakes_Updated the types by scope unavoidable debt Usually unpredictable and unpreventable and the team has no fault on that Due to legal issues, we have to rewrite some of the components Strategic debt Long term debt, usually incurred proactively I want to be the rst in the market tactical debt Its different that strategic by the reactive manner for the short term We don't have time to implement in the right way, just a hack. We'll x later. Incremental debt Hundreds or thousands of small shortcuts, like credit card debt We have to do quick hacks and dirty solutions to catch the deadline INADVERTENT (naive) debt It occurs due to irresponsible behavior or immature practices on the part of the people involved We have to build the software product with inexperienced newbies the types by content Design & architectural Debt Shortcuts and shortcommings Long and detailed upfront designs Sub-optimal solutions code quality Debt Short time between failures Severe defect count Every hack, work around, bad piece of code builds Unnecessary code duplication and complexity testing Debt Missing automated tests Too much time spending for regression testing Knowledge distribution and documentation debt Only few people knows the system When all key people left the organization, the debt becomes extremely high Environmental Debt Problems in development related processes Issues in hardware, infrastructure, supporting apps Having too many manual operational tasks Monetary cost Developers time is expensive No developer enjoys to work on brittle and complicated code That leads turnovers and it is one of the real economic costs of technical debt the stakeholders customers Annoyed by bugs, missing features, slow lead times and expensive costs helpdesk Additional costs operations team Frequent patches and xes management Annoyed due to bugs, delays, costs and security issues developers No one wants to develop bad code No one wants to take over bad work of others the strategic design A system can't have the same high level of quality throughout the system strategic design The team can choose which parts will have high quality or kept as low quality Consumer understands quick & dirty solutions lead to debt Understanding Strategic Design leads to better decisions from stakeholders fixing the debt Merciless refactoring fast automation share knowledge knowledge decays fast slow down to go fast clean code principles clean, readable and simple code clear definition of done showing us how to avoid incurring debt key engineering practices Pair Programming Test Driven Development Continuous Integration 10 min Builds Refactoring Automated unit tests etc. these should always directly associated with a requirement test driven development Pre-release defect density decreased 40-90% relative to similar products that do not use TDD Initial development time increased 15-35% after TDD fail fast Peer Review Code Review Don't leave all testing to the last phase Limit work-in-progress fix constantly Monitor your debt Code coverage: Monitor trends, not points Cyclomatic complexity: Number of branches in code Coupling: Interconnectedness of systems clean constantly fix root causes Follow the Boy Scout Rule quality is your responsibility never make intentional mess Never ask permission to do your job correctly The Payment strategies From Frank Buschmann debt repayment Refactor or replace code debt conversion Replace the current solution with a "good but not perfect" solution just pay the interest Live with the code Refactoring is more expensive than the work with bad code End-of-life software or will-be-retired software The Payment Approaches Minimal Iteration Debt Payment Half a day in a week Technical Backlog Debt is made visible and clear for everbody Cost per task is trackable No mixture between technical and feature tasks adv.disadv. 2 backlogs and hard to prioritize Customers may not understand the real benets of a tech task Very expensive changes must always a business reason buffer tasks for refactoring 10% of the team's time clean-up releases The measurment time investment is actually worth it it is important to decide that even impossible to predict The effect of bad code quality for future requirements is difficult The delta from ideal Errors & warnings Code duplication Code coverage Gut feeling in large apps, the measure is basically useless Story Probing The assumption is that technical debt increases the estimate formulas to guess the debt There are many formulas proposed and used Estimate the cost of a failure and then multiply by the probability it will occur Technical debt is the cost of implementing the required redundancy the conclusion you got the red pill Understanding technical debt will let you, your team, the business and the stakeholders make better decisions Technical Debt http://www.infoq.com/articles/managing-technical-debt http://theagileexecutive.com/category/technical-debt/ http://martinfowler.com/bliki/TechnicalDebt.html http://www.slideshare.net/garyshort/technical-debt-2985889 http://www.slideshare.net/woodyp/technical-debt-7436402 http://www.slideshare.net/jhlittle/technical-debt-6896714 http://www.slideshare.net/RobMyers64/technical-debt-10124606 http://www.slideshare.net/RedgateSoftware/measuring-technical-debt 1 Billion Dolar Fail http://www.cio.com/article/721628/Air_Force_scraps_massive_ERP_project_after_racking_up_1_billion_in_costs Evluation with Sonar http://www.sonarqube.org/evaluate-your-technical-debt-with-sonar/ 36 Classic Mistakes http://www.stevemcconnell.com/rdenum.htm http://www.codinghorror.com/blog/2007/06/escaping-from-gilligans-island.html Calculating the ocost http://www.ontechnicaldebt.com/blog/time-to-start-estimating-technical-debt/ http://www.infoq.com/news/2010/03/monetizing-technical-debt http://blog.acrowire.com/cloud-computing/failing-to-plan-is-planning-to-fail/ http://www.ickr.com/photos/guilleavalos/2139208615 http://www.ickr.com/photos/maclufus/5571639487 http://www.ickr.com/photos/grantmac/2282389818 http://www.ickr.com/photos/freefoto/2539768604 http://farm5.staticickr.com/4043/5129934527_552d08a0e4_o.jpg http://www.ickr.com/photos/ethermoon/4045176015 http://upload.wikimedia.org/wikipedia/commons/2/2a/Dirty_dishes.jpg http://fc07.deviantart.net/fs41/f/2009/030/9/6/The_Good__The_Bad_and_The_Ugly_by_ROMAragorn.jpg http://ngm.nationalgeographic.com/2012/01/twins/portraits/img/01-johanna-eva-gill.jpg http://www.ickr.com/photos/epsos/6749663099 http://darkroom.baltimoresun.com/wp-content/uploads/2012/12/REU-POY-243.jpg http://www.ickr.com/photos/defenceimages/7021362271 http://www.ickr.com/photos/widget8/4121151605 http://www.ickr.com/photos/cafemama/206657382 http://www.ickr.com/photos/stao/6015670061 http://www.ickr.com/photos/crashmaster/3192341451 http://www.propcboost.com/wp-content/uploads/2013/05/Blue-screen-error.jpg http://www.ickr.com/photos/stuant63/2240432052 http://www.ickr.com/photos/didmyself/7685629372 http://www.ickr.com/photos/untickalock/41536377 http://www.ickr.com/photos/fxtc/8105411995 http://tocea.com/wp-content/uploads/Tocea-Scertify-TechDebt-Overview.jpg http://www.ickr.com/photos/cristiano_betta/2757049946 http://www.ickr.com/photos/mhusiak/3216291202 http://www.ickr.com/photos/eneas/9541686914 http://www.ickr.com/photos/amalthya/84364820 http://www.ickr.com/photos/erik-n/1550380661 http://www.algoafm.co.za/img/uploads/Website/cat%20scared.jpg Lem orhan ergn lemiorhan@agilistanbul.com @lemiorhan @lemiorhan agilistanbul.com @lemiorhan LINKEDINTWITTERSLIDESHAREBLOG Principal Software Engineer @ Sony Founder & Author @ agilistanbul.com yingtomoon.com