![Page 1: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/1.jpg)
National Grid ServiceEnabling Collaboration
Edinburgh 09 March 2010
![Page 2: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/2.jpg)
UK e- Infrastructure
LHC
ISIS TS2
HPCx+ HECtoR
Users get common access, tools, information, nationally supported services, through NGS
Integratedinternationally
VRE, VLE, IE
Regional and Campus grids
Community Grids
HEIs
![Page 3: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/3.jpg)
Key areas
• Adoption of open standards
• Provide access to wide range of resources
• Integrating HEI resources and researchers
• Community-led support programmes
• Promote and facilitate training
![Page 4: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/4.jpg)
Focus
• We Don’t do everything– Focus on
• Access to computational resources• Access to data storage• Data movement and management
– Emphasis on• Open standards• International standards• Collaboration
![Page 5: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/5.jpg)
NGS Member Institutions, March 2010
![Page 6: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/6.jpg)
25 member institutes 33 heterogeneous resources15,000 processing cores
In the last 12 months• 4,629,127 CPU hrs used • 888,862 jobs ran
2nd largest e-Science CA• 22,121 certificates issued• 4,911 active currently
www.ngs.ac.uk
> 75 applications
Diverse User Community
![Page 7: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/7.jpg)
Collaborations
SAGA
![Page 8: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/8.jpg)
Grid: EGI
EGI.eu Office in Amsterdam (March)Information catalogs, AAA, Metadata/data catalogs,File replication, file transferJob brokeringInterfaces and portals ...
![Page 9: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/9.jpg)
Supporting Institutes
![Page 10: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/10.jpg)
Membership• Campus Champion
– Liaison between HEI/research organisation and NGS
• Infrastructure Members (representation on Collaboration Board)
– NGS Interfaces – monitored, certified, accountable
– Affiliate• Maintains control over permitted users
– Partner• Supporting access by a significant body of NGS users• Publish a service level description (SLD) detailing the services offered• Eligible for brokering of resources
![Page 11: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/11.jpg)
Membership Programme
Goals:
1. Increase the range and depth of services and resources that NGS can offer to its users
2. Provide leadership and sources of best practice to sites needing to put their resources “on the Grid”
3. Create communities able to exploit the connected resources for interdisciplinary research
4. Common point of contact for trusted brokering of services. Remove NxN agreements for sharing/brokering resources
![Page 12: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/12.jpg)
Why join?• Institutions have a mission to support their own users
• Increasing dependence on computation & data, and growing need to collaborate beyond the institution
• Access to NGS ‘honest’ brokering service
• Access to NGI. – Common voice on European e-infrastructure
• Growing need to illustrate ‘green’ credentials which are easily demonstrated by commitment to efficient usage of currently owned resources through ‘grid’
![Page 13: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/13.jpg)
Best Practice• NGS well placed for this role
– Supported role to enable National Engagement– Collaborative activity not tied to 1 institution
• Coordination connected to National Facilities
– Push an integration agenda, not specific field– Track record (RCUK international review)
• Opportunities– Growing recognition of role
• NGI, BBSRC + The Genome Analysis Centre, GridPP, BADC ...
– Even better with your experience/expertise/services• Application expertise
![Page 14: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/14.jpg)
Supporting Collaboration
• “Grid” accounting– Support a person, group, project, institution ...
• A “Virtual Organisation”
– Share or exchange resources• NGS acts as “honest broker” • Standard interfaces give some future-proofing
• Opportunities– Support research collaborations (proven tools)– Load balancing– Value added tools with broad application– see next page ...
![Page 15: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/15.jpg)
Outsourcing
• Standard interfaces – Simplify and reduce barrier to moving work – Avoid lock in and reduce barriers to moving– Allow 3rd part providers to offer services
• NGS “honest broker” role• Opportunities
– Sharing resources through common interfaces– Trading/buying/selling via NGS mediation– “commercial” services through standard interfaces
• E.g. cloud , data storage, training...
![Page 16: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/16.jpg)
Impact
• Improve accessibility to local resources
• Widen accessibility to local resources
• Use once Use anywhere
• Share/Trade/Buy/Sell resources– Brokering, monitoring, accounting of services
• Facilitate collaboration nationally and internationally
![Page 17: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/17.jpg)
What does the NGS offer?
• Access to central support services for e-infrastructure– Helpdesk– Training– Application support– Central services e.g. CA, MyProxy, WMS, Information provider,
resource discovery, etc
• Certification process to ensure resource providers deliver service against SLD/standard interfaces
• Common interfaces enable brokering of resources– Ease of access for end users– Ability to trade: buy/sell compute time across institute resource– Ability to link to international resources: International project participation– Ability to share data/migrate data/buy data services at other institutes for
resilience/backup/
![Page 18: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/18.jpg)
Services
• SARoNGS• WMS• HERMES Data Client• Application Hosting Environment (AHE)• Monitoring• Accounting
Direct access GSI-SSH terminal
MEG
NGS Portal/ApplicationsRepository
![Page 19: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/19.jpg)
Support and Training
Local & national training events
NGS Road ShowsNational helpdeskCampus Champion
Online tutorials and practicals
![Page 20: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/20.jpg)
Case Studies and Documentation
• Specific + “Generic”– Site neutral, topical, expert– Freely available, professionally produced– Exploit NGS interfaces and services (it works)
• Opportunities– Support local outreach– Exploit NGS documentation– Publicise your/our achievements
![Page 21: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/21.jpg)
Events
• Community Conferences– CCPb, Bioinformatics,
NGS UF/IF, road shows
![Page 22: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/22.jpg)
Research to Service
![Page 24: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/24.jpg)
Case Studies
Note (to delete): CD suggests case studies highlighting different benefits of NGS, e.g. increased speed (burglary), more complex calculations/simulations (dinosaurs), novel technologies and interoperability (GENIUS), variety of services and interoperability with other resources (GENIE)… They all have applied benefits and impact on people/UK
![Page 25: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/25.jpg)
Predicting CrimeNick Malleston, Leeds University
• burglary rates
• agent-based predictive models
• vary environmental factors, predicts
burglar’s behaviour
adapted Java program to run across Grid
NGS speeds things up - 2.5 years of results in under a week
![Page 26: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/26.jpg)
Dinosaur locomotion
Karl Bates, University of Manchester
• muscle activation patterns in dinosaurs
• NGS allows increased model sophistication
![Page 27: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/27.jpg)
Oceans and ClimateAndrew Price, GENIE project, Southampton
• thermohaline circulation in oceans
• integrates component earth models
• future climate prediction
• 5 yrs computations in 3 months
• integrates NGS and other resources
• NGS hosts database
• users share simulations, metadata
![Page 28: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/28.jpg)
Cerebral blood flow
http://wiki.realitygrid.org/wiki/GENIUS
• processes 2D MRI images, recreates 3D vasculature map
• visualise and steer the model in real time
• advanced resource reservation
• utilize international federated grid of supercomputers
GENIUS project
![Page 29: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/29.jpg)
ESFRI Projects
• European Strategic Forum for Research Infrastructure – “bottom up” list of (~30) pan-European RI– Strong support from EC
• Opportunities– Signposts for the future– Ensure UK access to key RI
• ELIXIR, BBMRI, ICOS, HiPER, XFEL, CLARIN, DARIAH ...
– EC support – in connection with EC e-Infrastructure
![Page 30: National Grid Service Enabling Collaboration Edinburgh 09 March 2010](https://reader035.vdocument.in/reader035/viewer/2022070417/5681551b550346895dc2fc0b/html5/thumbnails/30.jpg)