1 osg accounting service requirements matteo melani...
TRANSCRIPT
1
OSG Accounting ServiceRequirements
Matteo Melani ([email protected])
SLACfor the OSG Accounting Activity
2
Who are we?
The team Matteo Melani – SLAC Philippe Canal – Fermilab Sudhir Borra –Fermilab
3
And we are talking to
Ian Foster, Frank Siebenlist – Globus Sebastien Goasguen –TeraGrid David Kant – LCG Andrea Guarise - EGEE
4
What are the Activity Goals?
To provide the OSG stakeholders with a reliable and accurate set of views of the Grid resources usage.
The Grid Accounting Project will: design (or choose) the accounting data model ensure the necessary meters and collectors are in place at the
resource provider sites, define and deploy repositories and access tools for the reporting
and analysis of the grid wide accounting information ensure interoperability with other Grids (LCG, TeraGrid,...)
5
Project Charter
OSG Document 131:
http://osg-docdb.opensciencegrid.org/0001/000131/004/AccountingProjectDefinition1.pdf
6
What are we doing?
Just finish the Requirements document OSG Accounting Service Requirements v1.0 - Just released!
Working at the Design Architecture Overview Document (DRAFT in preparation)
Talking to the stakeholders OSG stakeholders Other Grids stakeholders: LCG, TeraGrid, EGEE, Globus…
Reviewing other Accounting Systems DGAS, APEL, SGAS GGF groups RUS/UR/GESA/OGSA-WGs, IETF’s AAA, Telecommunications Network
7
Why a Requirements doc?
Verba volant, scripta manent Define the Accounting System scope Establish a common accounting model and terminology
so that we can understand each other and we can communicate with OSG stakeholders and other Grids stakeholders
Understand OSG needs so that: do not build what we do not need and want reuse what is out there
Accounting is a fairly new topic in distributed systems and in IT
8
VO Management System
Grid Service
Grid wideAccounting System
Grid User
VO Manger
Accounting Sys. Admin,
Resource Manager
Admins.
manages
uses
Subscribe to VO
Gets VO info
Grid Wide Monitoring System
GridAccess Service
Grid ServiceOSG Grid Services
Site Accounting system
Site Monitoring System
StorageResources
NetworkResources
SoftwareResources
Resources
OSG Monitoring Service
OSG Accounting Service
OSG Auth. & Auth. Infrastructure
Grid Manager
uses
uses
Site administration domain & Computing Environment
uses
uses uses
AccountingSystem Scope
9
Main Functionalities (1)
• The ability to collect resources and services usage data at each resources and services provider site.
• The ability to combine authentication, authorization and resource usage data related to a Grid user request to produce detailed accounting records.
• The ability to store and manage accounting records and accounting data.
• The ability to present accounting records in tabular format at the Grid wide and site level
10
Main Functionalities (2)
• The ability to apply various (statistical) functions to analysis accounting records and data to facilitate the spotting of trends and patterns in the usage of resources and services.
• The ability to present the results of this analysis with graphical views.
• The ability to support auditing processes by storing the raw usage data and maintaining links between the accounting records and the raw usage data used to generate them.
11
Main Functionalities (3)
No user charging system, No resources or services pricing No support for an economic model for resource
allocation
But we have to keep them in mind!
12
System Properties(1)
Interoperability The Accounting System should leverage existing standards to
maximize interoperability with other Grids and Accounting Services.
Fault Tolerance The Accounting System must reduce as much as possible
usage data and accounting records loss. The Accounting System must be resilient to temporary
communication failures over LAN and WAN. The Accounting System must be resilient to the failure of one
of its component.
13
System Properties(2) Security
The Accounting System will guarantee integrity and non–repudiation of the accounting records at the site level.
The Accounting System must protect accounting information using secure communication channels (mutual authentication, message integrity, confidentiality) and access control lists.
Scalability and Performance Not really an issue
Other The Accounting System should leverage existing tools and
infrastructures to solve related problems.
14
Open Questions
How do we measure resource usage? Specific metrics
What are the specific graphs and tabular views the stakeholders want?
What (and how) Authentication & Authorization information the OSG infrastructure can supply?
DN-UID mapping issue Template account
16
Accounting &Monitoring
MonitoringAccounting
Logg
ing
Aud
iting