cern it department ch-1211 genève 23 switzerland t towards agile software development marwan...

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Towards agile software development

Marwan Khelif

IT-CS-CT

IT Technical Forum – 31th May 2013

CERN IT Department

CH-1211 Genève 23


it

2

Introduction


• CS group– Large infrastructure (network, telephony, Wi-Fi)

• 3250 network equipment (switches, routers, PABX, …)• 950 Wi-Fi station• 12000 fixed phones / 5700 mobile phones

– Limited staffing

Automation+

Simplified management+

Robustness

CERN IT Department

CH-1211 Genève 23


it

3

Introduction


• CT section (7 people)– Software for automation– Critical applications

• CERN network and telephony depend on these

High turnover+

Flexible to new user demands

CERN IT Department

CH-1211 Genève 23


it

4

Introduction


CERN IT Department

CH-1211 Genève 23


it

5

Introduction


Application Languages LOC

WebReq (users) Perl + Web 75 000

CSDBWeb (admins) Java + Web 315 000

CFMGR Perl 150 000

Magic Java 17 000

Syslog Perl 6 000

WIND Java 77 000

MIKE Perl + Web 27 000

NetLive Perl + Web 17 000

LANDB PL/SQL 180 000

• Main applications

CERN IT Department

CH-1211 Genève 23


it

6

Introduction


More than 200 tables

CERN IT Department

CH-1211 Genève 23


it

7

Continuous consolidation strategy


• Programming languages– Java, Perl, PL/SQL, Web (JS, HTML, …)

• Technologies– Web, Rich Client, command line

• Architectures• Software development life cycle (SDLC)

Knowledge consolidation

CERN IT Department

CH-1211 Genève 23


it

8

SDLC


CERN IT Department

CH-1211 Genève 23


it

9

• Full process setup since November 2011

• Adapted to our needs

• Main goals:– Simplify software development management– Improve code quality / applications reliability– Ease knowledge transfer to new members

SDLC


CERN IT Department

CH-1211 Genève 23


it

10

SDLC


CERN IT Department

CH-1211 Genève 23


it

11

• Atlassian JIRA used as repository (Backlog)

• Users requests coming from ServiceNow

• Long term planning– Program of work– Management decisions

SDLC


CERN IT Department

CH-1211 Genève 23


it

12

SDLC


CERN IT Department

CH-1211 Genève 23


it

13

Agile Scrum


Dailymeeting

Weeklymeeting

<15min ≈30min

CERN IT Department

CH-1211 Genève 23


it

14

Agile Scrum


• Time-boxing– Retrospective (feedback) planning refinement

• Self empowered and organized– Requires team commitment

• Shippable code– Incremental releases

CERN IT Department

CH-1211 Genève 23


it

15

• Agile Scrum: pragmatic approach– 4 weeks meeting: prioritization + estimation– GreenHopper plugin for JIRA

Short term planning


CERN IT Department

CH-1211 Genève 23


it

16

• Sprint follow-up

Short term planning


Dailymeeting

Weeklymeeting<15min ≈30min

CERN IT Department

CH-1211 Genève 23


it

17

SDLC


CERN IT Department

CH-1211 Genève 23


it

18

Architectural Meetings


• For new critical/complex features

• Decide on functional implementations– Involve end-users for validation

• Homogenize technical architecture

CERN IT Department

CH-1211 Genève 23


it

19

Short term development process


CERN IT Department

CH-1211 Genève 23


it

20



CERN IT Department

CH-1211 Genève 23


it

21

Feature Branch Development


• Static code analysis using Sonar– Only Java code checked– Multiple plugins used

CERN IT Department

CH-1211 Genève 23


it

22



CERN IT Department

CH-1211 Genève 23


it

23



• Commit validation (RepoGuard)– SVN hook applied before each commit– Code checked against Checkstyle rules– Commit aborted if check fails

CERN IT Department

CH-1211 Genève 23


it

24



CERN IT Department

CH-1211 Genève 23


it

25

Automated tests


• Selenium based GUI testing (Web)– End-user experience validation– Detect integration problems

• Grid distribution of tests– Virtual Machines execute tests– Each test is executed against Firefox/Chrome/IE

CERN IT Department

CH-1211 Genève 23


it

26

Automated tests


Virtual Machines

CERN IT Department

CH-1211 Genève 23


it

27



CERN IT Department

CH-1211 Genève 23


it

28

Peer review


• At least 2 developers need to validate

• Detect issues and improve architecture

• Homogenize code style

• Transfer of knowledge

CERN IT Department

CH-1211 Genève 23


it

29

Peer review


CERN IT Department

CH-1211 Genève 23


it

30



CERN IT Department

CH-1211 Genève 23


it

31

Build


• Atlassian Bamboo software used

• Automated and centralized build process– Backed by SVN repository

CERN IT Department

CH-1211 Genève 23


it

32

Builds


CERN IT Department

CH-1211 Genève 23


it

33



CERN IT Department

CH-1211 Genève 23


it

34

Summary


• Continuous process improvement– From developers feedback

• Knowledge sharing is part of the process

• Empowers the team Team commitment

• Improves software quality

CERN IT Department

CH-1211 Genève 23


it

35

Integrated toolset


JIRA

Tracking System

Bamboo

Build System

GreenHopper

Planning

Fisheye+

Crucible

Review

Selenium

Testing

Sonar

Analysis

SVN+

Repoguard

Repository

ServiceNow

Support

CERN IT Department

CH-1211 Genève 23


it

36

Integrated toolset


• Documentation: Twiki + Doxygen

• Statistics: Ohcount (non-Java projects)

• Monitoring: Spectrum + CS Synapse

• Evaluating Central Atlassian services

CERN IT Department

CH-1211 Genève 23


it

37

Questions ?


Questions?

cern it department ch-1211 genève 23 switzerland t towards agile software development marwan...

Documents

main applicationscern

new user demandscern

needs main goals

mikeperl web27

rich client

thesehigh turnover flexible

chit10atlassian jira

web js