![Page 1: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/1.jpg)
What Do Code Reviewsat Microsoft and in Open Source Projects Have in Common?
Alberto Bacchelli Delft University of Technology
The Netherlands
![Page 2: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/2.jpg)
![Page 3: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/3.jpg)
![Page 4: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/4.jpg)
![Page 5: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/5.jpg)
Modern code review
informal tool-based asynchronous
My code is better,after the review!!
Nice! He implemented all my suggestions..
![Page 6: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/6.jpg)
Modern code review
informal tool-based asynchronous
My code is better,after the review!!
Nice! He implemented all my suggestions..
![Page 10: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/10.jpg)
Code review tools: Microsoft CodeFlow
1
2
3
4
5
6
![Page 11: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/11.jpg)
Code review, an interactive online survey!
http://goo.gl/forms/hknZvi1YUo
http://sback.it/fosdem.html
![Page 12: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/12.jpg)
Why research on modern code review?
![Page 13: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/13.jpg)
Advances in Software Inspections M. E. Fagan
[IEEE TSE 1986]
Code “inspection is a method of static testing to verify that software meets its requirements.”
“It engages developers and others in a formal process [...] that usually detects more defects in the product than does machine testing.”
Code inspections
![Page 14: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/14.jpg)
“It engages developers and others in a formal process [...] that usually detects more defects in the product than does machine testing.”
Code inspectionsCan you trust these results apply to
modern code review?
![Page 15: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/15.jpg)
Dr. Christian Bird
Modern Code Review @ Microsoft
![Page 16: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/16.jpg)
MICROSOFT AS SUBJECT
Modern Code Review @ Microsoft
![Page 17: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/17.jpg)
Excel
XBox
SQL Server...
WindowsPhone
Modern Code Review @ Microsoft
![Page 18: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/18.jpg)
1
2
3
4
5
The CodeFlow review tool
Used across all Microsoft product teamsExcel
SQL Server
XBox
by more than 70,000 developers, so far.
![Page 19: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/19.jpg)
observations interviews
18 interviews with observations ~40 minutes long developers, testers different roles signed off at least 50 reviews
![Page 20: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/20.jpg)
![Page 21: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/21.jpg)
observations interviews
survey to 165 managers
![Page 22: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/22.jpg)
Improve Dev. Process
Alternative Solutions
Code Improvement
Knowledge Transfer
Team Awareness
Avoid Build Breaks
Share Code Ownership
Track Rationale
Finding Defects
Team Assessment
List of motivations for doing code review
![Page 23: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/23.jpg)
observations interviews
survey to 165 managers survey to 873 developers
![Page 24: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/24.jpg)
0 200 400 600
1st reason 2nd reason 3rd reason
Why do Microsoft developers do code reviews?
finding defects
code improvements
alternative solutions
knowledge transfer
team awareness
improving dev process
share code ownership
![Page 25: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/25.jpg)
0 200 400 600
1st reason 2nd reason 3rd reason
Why do Microsoft developers do code reviews?
finding defects
code improvements
alternative solutions
knowledge transfer
team awareness
improving dev process
share code ownership
“Finding defects is the main reason for doing code review.” 72 managers and 384 developers @ Microsoft
![Page 26: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/26.jpg)
Let’s look at the survey’s answers!
![Page 27: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/27.jpg)
What is the outcome of code review at Microsoft?
![Page 28: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/28.jpg)
What is the outcome of code review at Microsoft?
![Page 29: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/29.jpg)
Recorded code review comments
![Page 30: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/30.jpg)
observations interviews
survey to 165 managers survey to 873 developers classification of570 review comments
![Page 31: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/31.jpg)
Example stack of cards
![Page 32: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/32.jpg)
Card sort almost completed
![Page 33: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/33.jpg)
code improvementunderstanding
social communication defects
external impacttesting
review tool
0% 10% 20% 30%
% of comments
knowledge transfermisc
Card sort results
![Page 34: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/34.jpg)
code improvementunderstanding
social communication defects
external impacttesting
review tool
0% 10% 20% 30%
% of comments
knowledge transfermisc
Card sort results
![Page 35: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/35.jpg)
code improvementunderstanding
social communication defects
external impacttesting
review tool
0% 10% 20% 30%
% of comments
knowledge transfermisc
Card sort results
![Page 36: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/36.jpg)
“what if they are all used?”
“any doubt about the precedence
here?”
“is it possible that this statement never match?”
“does it work if you put 0 here?”
“should this end date be current
date?”
“should be &&?”
defectsCard sort results
![Page 37: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/37.jpg)
code improvementunderstanding
social communication defects
external impacttesting
review tool
0% 10% 20% 30%
% of comments
knowledge transfermisc
Card sort results
![Page 38: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/38.jpg)
hot chocolate
Code review at Microsoft: Expectations vs. Reality
![Page 39: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/39.jpg)
What is the outcome of code review in OSS?
![Page 40: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/40.jpg)
Moritz Beller
![Page 41: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/41.jpg)
What is the outcome of code review in OSS?
We manually analyzed 1,400 review-induced changes
![Page 42: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/42.jpg)
What is the outcome of code review in OSS?
![Page 43: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/43.jpg)
What is the outcome of code review in OSS?
![Page 44: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/44.jpg)
What is the outcome of code review in OSS?
ConQAT
GROMACS 31%
22%
69%
78%
evolvability changes functional changes
![Page 45: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/45.jpg)
What is the outcome of code review?
ConQAT
GROMACS
Microsoft 19%
31%
22%
81%
69%
78%
evolvability changes functional changes
![Page 46: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/46.jpg)
What is the outcome of code review?
ConQAT
GROMACS
Microsoft
Industrial case
Students review 15%
23%
19%
31%
22%
85%
77%
81%
69%
78%
evolvability changes functional changes
![Page 47: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/47.jpg)
What Do Code Reviewsat Microsoft and in Open Source Projects Have in Common?
![Page 48: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/48.jpg)
What Do Code Reviewsat Microsoft and in Open Source Projects Have in Common?
The outcome
![Page 49: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/49.jpg)
![Page 50: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/50.jpg)
WHY?
Why do expectations not match reality?
![Page 51: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/51.jpg)
… “[if] executed properly, [they] find bugs faster and more effectively than testing or other known debugging techniques”—but when done inefficiently they can quickly become unproductive.
— Jason Cohen, 2011
Code reviews
![Page 52: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/52.jpg)
… “[if] executed properly, [they] find bugs faster and more effectively than testing or other known debugging techniques—but when done inefficiently they can quickly become unproductive. ”
— Jason Cohen, 2011
Code reviews
![Page 53: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/53.jpg)
Code review is (still) a fully manual task
![Page 54: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/54.jpg)
1
2
3
4
5
Tools only supports logistics of code review
![Page 55: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/55.jpg)
Let’s look at the survey’s answers!
![Page 56: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/56.jpg)
What are the challenges of code review at MSFT?
![Page 57: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/57.jpg)
“understanding the code takes most of the reviewing time.”
What are the challenges of code review at MSFT?
![Page 58: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/58.jpg)
Understanding needs, by outcome
Level of Understanding Needed
Responses
Avoid Build Breaks
Track Rationale
Team Awareness
Improve Dev Process
Code Improvement
Team Assessment
Knowledge Transfer
Share Code Ownership
Alternative Solutions
Finding Defects
500 0 500
None Low High Complete
finding defectsalternative solutions
code improvements
team awarenessimproving dev process
share code ownershipknowledge transfer
team assessment
track rationaleavoid build breaks
![Page 59: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/59.jpg)
Understanding needs, by outcome
Level of Understanding Needed
Responses
Avoid Build Breaks
Track Rationale
Team Awareness
Improve Dev Process
Code Improvement
Team Assessment
Knowledge Transfer
Share Code Ownership
Alternative Solutions
Finding Defects
500 0 500
None Low High Complete
finding defectsalternative solutions
code improvements
team awarenessimproving dev process
share code ownershipknowledge transfer
team assessment
track rationaleavoid build breaks
![Page 60: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/60.jpg)
Understanding needs, by outcome
Level of Understanding Needed
Responses
Avoid Build Breaks
Track Rationale
Team Awareness
Improve Dev Process
Code Improvement
Team Assessment
Knowledge Transfer
Share Code Ownership
Alternative Solutions
Finding Defects
500 0 500
None Low High Complete
finding defectsalternative solutions
code improvements
team awarenessimproving dev process
share code ownershipknowledge transfer
team assessment
track rationaleavoid build breaks
![Page 61: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/61.jpg)
Effect of code ownership on reviews
Does it take longer to review files that you are not familiar with (or files that are new)?
“YES” 798 developers (91%)
Is there a difference in comments/feedback you receive when a reviewer is very familiar with or the owner of the files you changed in a code review?
“YES” 716 developers (82%)
![Page 62: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/62.jpg)
Effect of code ownership on reviews
Is there a difference in comments/feedback you receive when a reviewer is very familiar with or the owner of the files you changed in a code review?
“Comments reflect their deeper understanding – more likely to find subtle defects, feedback is more conceptual (better ideas, approaches) instead of superficial (naming, mechanical style, etc.)”
“YES” 716 developers (82%)
![Page 63: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/63.jpg)
Code review needs the right data and the right tools
codereview
![Page 64: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/64.jpg)
FOCUS: GUEST EDITORS’ INTRODUCTIONFOCUS: GUEST EDITORS’ INTRODUCTION
IN THIS SPECIAL issue of IEEE Soft-ware, we invited submissions that re-flected the benefits (and drawbacks) of software analytics. The response was overwhelming. Software analytics is an area of explosive growth, and we had so many excellent submissions that we had to split this special issue into two volumes—you’ll see even more content in the September/Octo-ber issue. We divided the articles on conceptual grounds, so both volumes will feature equally excellent work.
To better frame these articles, we of-fer some definitions and historical per-spectives on software analytics. Specifi-cally, we describe where the field was, where it is, and where it might be going.
What Is Software Analytics?Thanks to the Internet and open source, there’s now so much data about software projects that it’s impossible to manually browse through it all:
• As of late 2012, our Web searches show that Mozilla Firefox had 800,000 bug reports, and platforms such as Sourceforge.net and GitHub hosted 324,000 and 11.2 mil-lion projects, respectively.
Software Analytics: So What?Tim Menzies, West Virginia University
Thomas Zimmermann, Microsoft Research
074 0 -74 5 9 /13 / $ 31. 0 0 © 2 013 I E E E JULY/AUGUST 2013 | IEEE SOFTWARE 31
… “is analytics on software data for managers and software engineers with the aim of empowering software development individuals and teams to gain and share insight from their data to make better decisions.”
— Menzies and Zimmermann, 2013
Software analytics
![Page 65: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/65.jpg)
FOCUS: GUEST EDITORS’ INTRODUCTIONFOCUS: GUEST EDITORS’ INTRODUCTION
IN THIS SPECIAL issue of IEEE Soft-ware, we invited submissions that re-flected the benefits (and drawbacks) of software analytics. The response was overwhelming. Software analytics is an area of explosive growth, and we had so many excellent submissions that we had to split this special issue into two volumes—you’ll see even more content in the September/Octo-ber issue. We divided the articles on conceptual grounds, so both volumes will feature equally excellent work.
To better frame these articles, we of-fer some definitions and historical per-spectives on software analytics. Specifi-cally, we describe where the field was, where it is, and where it might be going.
What Is Software Analytics?Thanks to the Internet and open source, there’s now so much data about software projects that it’s impossible to manually browse through it all:
• As of late 2012, our Web searches show that Mozilla Firefox had 800,000 bug reports, and platforms such as Sourceforge.net and GitHub hosted 324,000 and 11.2 mil-lion projects, respectively.
Software Analytics: So What?Tim Menzies, West Virginia University
Thomas Zimmermann, Microsoft Research
074 0 -74 5 9 /13 / $ 31. 0 0 © 2 013 I E E E JULY/AUGUST 2013 | IEEE SOFTWARE 31
… “is analytics on software data for managers and software engineers with the aim of empowering software development individuals and teams to gain and share insight from their data to make better decisions.”
— Menzies and Zimmermann, 2013
Software analytics
![Page 66: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/66.jpg)
![Page 67: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/67.jpg)
Debugger
Versioning system
Issue tracking system
IDE Execution
Mailing system
![Page 68: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/68.jpg)
software datasource code
issue tracking system
data mining and software analysis techniques
software engineering tasks helped
versioning system
…
clusteringpatternsclassification
…
neo
programming debugging maintenance testing…
Software analytics’ workflow
![Page 69: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/69.jpg)
software datasource code
issue tracking system
data mining and software analysis techniques
software engineering tasks helped
versioning system
…
clusteringpatternsclassification
…
neo
code review
Software analytics for code reviews
review data
![Page 70: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/70.jpg)
My research: Data-supported code reviewrecommenderfor reviewers
changeuntangler
automaticrisk detection
![Page 71: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/71.jpg)
My research: Data-supported code reviewrecommenderfor reviewers
changeuntangler
automaticrisk detection
![Page 72: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/72.jpg)
Who should review my code changes?recommenderfor reviewers
versioning system
changes toreview
code review data
neo
most appropriatereviewer #1
neo
most appropriatereviewer #2
neo
most appropriatereviewer #3
![Page 73: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/73.jpg)
My research: Data-supported code reviewrecommenderfor reviewers
automaticrisk detection
changeuntangler
![Page 74: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/74.jpg)
How should I split my code for easier review?change
untangler
versioning system
changes to review
self-containedchange
self-containedchange
![Page 75: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/75.jpg)
My research: Data-supported code reviewrecommenderfor reviewers
changeuntangler
automaticrisk detection
![Page 76: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/76.jpg)
Which changes should I review more carefully?
issue tracking system
versioning system
Octopull
automaticrisk detection
changes toreview
![Page 77: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/77.jpg)
My research: Data-supported code reviewrecommenderfor reviewers
changeuntangler
automaticrisk detection
![Page 78: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/78.jpg)
Add code review analytics support to GitHub
![Page 79: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/79.jpg)
software datasource code
issue tracking system
data mining and software analysis techniques
software engineering tasks helped
versioning system
…
clusteringpatternsclassification
…
neo
code review
Software analytics for code reviews
review data
![Page 80: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/80.jpg)
![Page 81: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/81.jpg)
Would you like to work on these topics (with me)?
We have 3 fully funded 4-yearPhD (or postdoc) positions!
And we are always looking forgreat students to work
on fantastic Master theses!
Find me at the end of the talk, at [email protected] ,
or at @sback_
![Page 82: What Do Code Reviews at Microsoft and in Open Source Projects](https://reader034.vdocument.in/reader034/viewer/2022042800/58a303621a28ab90398c1299/html5/thumbnails/82.jpg)