1 osg accounting service requirements matteo melani...

1

OSG Accounting ServiceRequirements

Matteo Melani (matteom@slac.stanford.edu)

SLACfor the OSG Accounting Activity

2

Who are we?

The team Matteo Melani – SLAC Philippe Canal – Fermilab Sudhir Borra –Fermilab

3

And we are talking to

Ian Foster, Frank Siebenlist – Globus Sebastien Goasguen –TeraGrid David Kant – LCG Andrea Guarise - EGEE

4

What are the Activity Goals?

To provide the OSG stakeholders with a reliable and accurate set of views of the Grid resources usage.

The Grid Accounting Project will: design (or choose) the accounting data model ensure the necessary meters and collectors are in place at the

resource provider sites, define and deploy repositories and access tools for the reporting

and analysis of the grid wide accounting information ensure interoperability with other Grids (LCG, TeraGrid,...)

5

Project Charter

OSG Document 131:

http://osg-docdb.opensciencegrid.org/0001/000131/004/AccountingProjectDefinition1.pdf

6

What are we doing?

Just finish the Requirements document OSG Accounting Service Requirements v1.0 - Just released!

Working at the Design Architecture Overview Document (DRAFT in preparation)

Talking to the stakeholders OSG stakeholders Other Grids stakeholders: LCG, TeraGrid, EGEE, Globus…

Reviewing other Accounting Systems DGAS, APEL, SGAS GGF groups RUS/UR/GESA/OGSA-WGs, IETF’s AAA, Telecommunications Network

7

Why a Requirements doc?

Verba volant, scripta manent Define the Accounting System scope Establish a common accounting model and terminology

so that we can understand each other and we can communicate with OSG stakeholders and other Grids stakeholders

Understand OSG needs so that: do not build what we do not need and want reuse what is out there

Accounting is a fairly new topic in distributed systems and in IT

8

VO Management System

Grid Service

Grid wideAccounting System

Grid User

VO Manger

Accounting Sys. Admin,

Resource Manager

Admins.

manages

uses

Subscribe to VO

Gets VO info

Grid Wide Monitoring System

GridAccess Service

Grid ServiceOSG Grid Services

Site Accounting system

Site Monitoring System

StorageResources

NetworkResources

SoftwareResources

Resources

OSG Monitoring Service

OSG Accounting Service

OSG Auth. & Auth. Infrastructure

Grid Manager

uses

uses

Site administration domain & Computing Environment

uses

uses uses

AccountingSystem Scope

9

Main Functionalities (1)

• The ability to collect resources and services usage data at each resources and services provider site.

• The ability to combine authentication, authorization and resource usage data related to a Grid user request to produce detailed accounting records.

• The ability to store and manage accounting records and accounting data.

• The ability to present accounting records in tabular format at the Grid wide and site level

10

Main Functionalities (2)

• The ability to apply various (statistical) functions to analysis accounting records and data to facilitate the spotting of trends and patterns in the usage of resources and services.

• The ability to present the results of this analysis with graphical views.

• The ability to support auditing processes by storing the raw usage data and maintaining links between the accounting records and the raw usage data used to generate them.

11

Main Functionalities (3)

No user charging system, No resources or services pricing No support for an economic model for resource

allocation

But we have to keep them in mind!

12

System Properties(1)

Interoperability The Accounting System should leverage existing standards to

maximize interoperability with other Grids and Accounting Services.

Fault Tolerance The Accounting System must reduce as much as possible

usage data and accounting records loss. The Accounting System must be resilient to temporary

communication failures over LAN and WAN. The Accounting System must be resilient to the failure of one

of its component.

13

System Properties(2) Security

The Accounting System will guarantee integrity and non–repudiation of the accounting records at the site level.

The Accounting System must protect accounting information using secure communication channels (mutual authentication, message integrity, confidentiality) and access control lists.

Scalability and Performance Not really an issue

Other The Accounting System should leverage existing tools and

infrastructures to solve related problems.

14

Open Questions

How do we measure resource usage? Specific metrics

What are the specific graphs and tabular views the stakeholders want?

What (and how) Authentication & Authorization information the OSG infrastructure can supply?

DN-UID mapping issue Template account

15

OSG-ACCOUNTING@OPENSCIENCEGRID.ORG

What are your accounting needs?

16

Accounting &Monitoring

MonitoringAccounting

Logg

ing

Aud

iting