EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

SA2.4 – EMI Tools1 Year Later

Lorenzo DiniTask Leader

EMI All Hands Meeting30/05/2011, Lund

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

Languages ReleaseIntegration

DependencyManagement

Packaging Testing BugTracker

Initial Situation

2EMI All Hands Meeting - Lund30/05/2011

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

30/05/2011

Current Situation

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

• Single tool-chain discussed, selected, deployed, integrated and maintained

• Single packaging strategy defined and implemented

• EMI repository deployed and maintained• Quality Assurance tools implemented• Configuration and Integration

documentation and policy

30/05/2011 EMI All Hands Meeting - Lund 4

Status and Achievements - 1

DoW: Tools and Repositories Selection, Maintenance and Integration

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

• QA plugins released/fixed as planned• QA report generator started and completed• 13 ETICS service and client releases with

many improvements for EMI• Build infrastructure working 24/7– 28 EPEL WNs and 6 nightly builds a day

• EMI Repository: Dwnlds 169,026/83.42 GB • Integration and configuration support to

EMT, SA1 and PTs with no major issues30/05/2011 EMI All Hands Meeting - Lund 5

Status and Achievements - 2

DoW: Tools and Repositories Selection, Maintenance and Integration

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

SA2.4 in Numbers - I

• Support– >140 GGUS tickets– >200 emails to EMT

• EMI in ETICS– Project SLOC:– Project build size:– Project build time:– EMI Modules:– EMI Configurations:

2.6M>15GB (w/o deps)~7h (8GB,2.3Ghz,4co)4692297

6EMI All Hands Meeting - Lund30/05/2011

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

SA2.4 in Numbers - II

• Builds– Project: 808 (Nightlies: 557)– Component: 6367 (Nightlies: 832 SAKET)

• Platforms– Project: 606 SL5_64 101 SL5_32– Component: 5938 SL5_64 124

SL5_32

• Tests– Project: 0– Component: 53

7EMI All Hands Meeting - Lund30/05/2011

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

Top 20 Subsystems• Size in components

1. emi.lcgdm 572. emi.sac 333. emi.fts 304. emi.lcgutil 225. emi.voms 216. emi.lrms-utils 207. emi.dcache 198. emi.storm 199. emi.misc 1710. emi.unicore 1711. emi.lb 1712. emi.wms 1713. emi.argus 1614. emi.bdii 1615. emi.cream-ce 1416. emi.arc 1117. emi.gridsite 1118. emi.lbjp-common 919. emi.dgas 9 20. emi.apel 9

• Builds1. emi.fts 5692. emi.unicore 5653. emi.arc 5374. emi.lcgdm 4835. emi.sac 4386. emi.lcgutil 4097. emi.voms 3018. emi.argus 2959. emi.dcache 26410. emi.apel 23611. emi.lb 22912. emi.px 16813. emi.hydra 14614. emi.bdii 13915. emi.amga 11216. emi.cream-ce 11117. emi.misc 10918. emi.java-security 10219. emi.mpi 10120. emi.lbjp-common 91

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

SLOC

9EMI All Hands Meeting - Lund30/05/2011

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

SLOC (no dCache)

10EMI All Hands Meeting - Lund30/05/2011

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

EMI Repository

11

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

• Year-2 Debian tool support and knowhow• Worker Nodes resources -> Triplicate• Builds tend to cluster in the same periods• Lacking of automated testing activities• QA Plugins need component

configuration to produce proper metrics (src.location)

30/05/2011 EMI All Hands Meeting - Lund 12

Issues and Concerns

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

• Single tool-chain and packaging• All services running reliably• Continuous software improvement• QA tools in place• Good support to all EMI

• Debian expertise• Resources optimization• QA and Testing activities

Conclusions

13EMI All Hands Meeting - Lund30/05/2011

EMI I

NFS

O-R

I-261

611

EMI I

NFS

O-R

I-261

611

Thank you

14EMI All Hands Meeting - Lund

EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611

30/05/2011