Download - Acccounting Portal
![Page 1: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/1.jpg)
EGEE-II INFSO-RI-031688
Enabling Grids for E-sciencE
www.eu-egee.org
EGEE and gLite are registered trademarks
Acccounting Portal
Javier Lopez Cacheiro/ CESGA
ARM-8 Athens
![Page 2: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/2.jpg)
ARM-8 Athens 2
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Outline
• Requirements
• EGEE View– Global View
– ROC View
– Site View
– VO Metrics View
• OSG View
• Unregistered View
• Future Work
• SWE RAP
![Page 3: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/3.jpg)
ARM-8 Athens 3
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Requirements
• The site must fulfill the following requirements in GOCDB:– Site must appear as a Certified site in the Production or PPS
infrastructure Currently suspended sites are also shown
– Site must have at least one CE registered
• Site must publish data
![Page 4: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/4.jpg)
ARM-8 Athens 4
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
APEL
LcgRecords table:
• Fixed schema
Data are stored centrally:
• Production: – Flexible Archiver @ RAL
• Pre-Production– Flexible Archiver @ CESGA
![Page 5: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/5.jpg)
ARM-8 Athens 5
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
LcgRecords
• ExecutingSite
• ExecutingCE
• LocalJobID
• LCGJobID
• LocalUserID
• LCGUserID
• LCGUserVO
• StartTime
• StopTime
• ElapsedTime
• BaseCpuTime
• SpecInt2000
• SpecFloat2000
• MemoryReal
• MemoryVirtual
![Page 6: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/6.jpg)
ARM-8 Athens 6
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
SumCPU
• ExecutingSite
• LCGUserVO
• Njobs
• SumCPU
• NormSumCPU
• SumWCT
• NormSumWCT
• Month
• Year
• RecordStart
• RecordEnd
![Page 7: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/7.jpg)
ARM-8 Athens 7
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
MetricVO
• LCGUserVO
• Njobs
• SumCPU
• NormSumCPU
• SumWCT
• NormSumWCT
• Week
• Month
• Year
• RecordStart
• RecordEnd
![Page 8: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/8.jpg)
ARM-8 Athens 8
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
EGEE VIEW
![Page 9: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/9.jpg)
ARM-8 Athens 9
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Accounting Portal
@GOC
![Page 10: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/10.jpg)
ARM-8 Athens 10
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
EGEE View
![Page 11: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/11.jpg)
ARM-8 Athens 11
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
EGEE Hierarchical Tree
![Page 12: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/12.jpg)
ARM-8 Athens 12
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Selection Frame
![Page 13: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/13.jpg)
ARM-8 Athens 13
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
EGEE View
Data showed:
• Number of jobs
• Norm. Sum CPU
• Sum CPU
• Sum Elapsed
• Norm. Sum Elapsed
• CPU Efficiency (NEW)
• Cumulative Charts (NEW)
![Page 14: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/14.jpg)
ARM-8 Athens 14
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Global View
• Lisf of CERTIFIED sites NOT publishing accounting data to GOC in the last 3 months
• List of sites publishing accounting data but NOT defined in the GOCDB
• List of certified sites (including also currently suspended sites) that have published accounting data with SpecInt = 0 during the selected period
• Number of CERTIFIED sites publishing accounting records to GOC
• Summary usage statistics corresponding to the selected options
![Page 15: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/15.jpg)
ARM-8 Athens 15
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Current Status
![Page 16: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/16.jpg)
ARM-8 Athens 16
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Accounting Enforcement
• Sites that are not publishing accounting data (>7 days)
• Sites using a non-registered GOCDB sitename
• Normalization
– SpecInt < 150
– SpecInt > 2500
– More than 3 different SpecInt values during the last month
![Page 17: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/17.jpg)
ARM-8 Athens 17
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Accounting Enforcement
![Page 18: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/18.jpg)
ARM-8 Athens 18
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
CPU Normalization with PBS
• How to compare CPU values from different nodes?
• Each site publishes one GlueHostBenchmarkSI00
• Homogeneous sites:– No problem
– Unfortunately the least common case
• Heterogeneous sites:– Set PBS $cputmult factor in each node
– CPU Normalization Standalone Test to obtain SPECint
![Page 19: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/19.jpg)
ARM-8 Athens 19
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Normalized CPU
![Page 20: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/20.jpg)
ARM-8 Athens 20
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Normalized CPU
![Page 21: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/21.jpg)
ARM-8 Athens 21
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
ROC View
• Lisf of CERTIFIED sites NOT publishing accounting data to GOC in the last 3 months
• Summary usage statistics corresponding to the selected options
• A Gantt chart showing a summary of the accounting records for all sites in the ROC
![Page 22: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/22.jpg)
ARM-8 Athens 22
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Site View
• Summary usage statistics corresponding to the selected options
• Summary usage statistics corresponding to the selected options
![Page 23: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/23.jpg)
ARM-8 Athens 23
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
VO Metrics
• Active VO
• Integrated NJobs
• Integrated Norm. CPU
• Integrated CPU
• Integrated Norm. Elapsed
• Integrated Elapsed
![Page 24: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/24.jpg)
ARM-8 Athens 24
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Integrated CPU
![Page 25: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/25.jpg)
ARM-8 Athens 25
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
![Page 26: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/26.jpg)
ARM-8 Athens 26
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
OSG View
• Lisf of OSG sites NOT publishing accounting data to GOC in the last 3 months
• Summary usage statistics corresponding to the selected options
• A Gantt chart showing a summary of the accounting records for all sites in the ROC
![Page 27: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/27.jpg)
ARM-8 Athens 27
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
UNREGISTERED View
• Summary usage statistics corresponding to the selected options
• A Gantt chart showing a summary of the accounting records for all sites in the ROC
![Page 28: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/28.jpg)
ARM-8 Athens 28
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Future Work
• Include DC information (now only Biomed)
• User level information (DN/VOMS)
• Possible Security Levels
– layer 1 = “anonymous” information: open/certificate?
– layer 2 = “own” user accounting: certificate based
– layer 3 = VO accounting: VO admins
– layer 4 = Site accounting: Site admins
– layer 5 = ROC accounting: ROC admins
• New metrics
• SAM accounting enforcement test
• Requests?
– Links to useful views of the data (A. Mills)
![Page 29: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/29.jpg)
ARM-8 Athens 29
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
SWE
![Page 30: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/30.jpg)
ARM-8 Athens 30
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
![Page 31: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/31.jpg)
ARM-8 Athens 31
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
![Page 32: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/32.jpg)
ARM-8 Athens 32
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
![Page 33: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/33.jpg)
ARM-8 Athens 33
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
RAP
![Page 34: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/34.jpg)
ARM-8 Athens 34
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
![Page 35: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/35.jpg)
ARM-8 Athens 35
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
![Page 36: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/36.jpg)
ARM-8 Athens 36
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
References
• EGEE View Wiki Page– http://goc.grid.sinica.edu.tw/gocwiki/EGEE_View
• EGEE View– http://www3.egee.cesga.es/gridsite/accounting/CESGA/egee.php
• Regional Accounting Portal (RAP)– http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/acctROC/
• SWE Accounting Portal– http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/
• Accounting Enforcement– https://edms.cern.ch/document/753895
– http://www3.egee.cesga.es/acctenfor/
![Page 37: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/37.jpg)
ARM-8 Athens 37
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Acknowledgements
• EGEE View Main Developer:– Pablo Rey (CESGA)
• GOC– Dave Kant (RAL)
![Page 38: Acccounting Portal](https://reader035.vdocument.in/reader035/viewer/2022070416/5681502d550346895dbe20f4/html5/thumbnails/38.jpg)
Enabling Grids for E-sciencE
EGEE-II INFSO-RI-031688
Thanks
We want your feedback!