software analytics - and how to draw conclusions out of data€¦ · commercial in confidence | ©...

18
Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw conclusions out of data Presenting the sw-analytics toolkit!

Upload: others

Post on 22-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 )

Software analytics - and how to draw conclusions out of data

Presenting the sw-analytics toolkit!

Page 2: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 2 ( 18 )

context What are software metrics?

LOC, #defects, #contributors, cyclomatic complexity, ...

Which metric is the best?

None?

Can SW metrics be used to draw conclusions about software?

Page 3: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 3 ( 18 )

sw-analytics toolkit

Scrapes VCS & issue tracker Analyzes everything on function granularity

Stores in RDBMS

Web-based “Exploratory visualization” Subsystem – file - function

Page 4: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 4 ( 18 )

Treemap - Overview

Page 5: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 5 ( 18 )

Treemap - Overview

Page 6: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 6 ( 18 )

Treemap - subsystems

Page 7: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 7 ( 18 )

Treemap - files

Page 8: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 8 ( 18 )

Treemap - functions

Page 9: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 9 ( 18 )

Chart – file & function

Page 10: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 10 ( 18 )

Chart – file & function

Page 11: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 11 ( 18 )

Chart – file & function

Page 12: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 12 ( 18 )

Coming attractions

Defect predictions Subsystem – file – function

Automatic redesign/refactoring identification Effort distribution

….

Page 13: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 13 ( 18 )

Defect predictionSum of all defects

30000

Defects

20000

2009 20152012

Page 14: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 14 ( 18 )

Defect predictionR2 over time

0.3

0.55

2009 20122009 2015

Page 15: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 15 ( 18 )

Defect predictionper file for 2014

RandomForestRegressor

Ground truth Predicted predicted/truth

Page 16: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 16 ( 18 )

conclusions

No single metric exists that will tell you what your problem is!

SW-analytics toolkit helps you analyze your code in a robust way

SW-analytics toolkit have some really cool features coming up! =)

Page 17: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 17 ( 18 )

SW-Analytics toolkit:http://www.github.com/jderehag/swat

Page 18: Software analytics - and how to draw conclusions out of data€¦ · Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 1 ( 18 ) Software analytics - and how to draw

Commercial in Confidence | © Ericsson AB 2015 | 2015-10-14 | Page 18 ( 18 )