c3 tasp meeting/hpcs 2006 memorial university, st john’s newfoundland, 2006.05.14 copyright ©...

26
C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline About SHARCNET Resources and Usage Accessibility HPC Research Highlights Staffing HPC Activities Future Development Open Questions SHARCNET TASP Report 2005-2006 TASP Meeting 20 th Int’l Symposium on gh Performance Computer and Systems St John’s, Newfoundland May 14, 2006 Ge Baolai David McCaughan Doug Roberts Jemmy Hu Sergey Mashchenko Thomas Hu

Upload: aileen-perkins

Post on 30-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Outline

About SHARCNET Resources and Usage Accessibility HPC Research Highlights Staffing HPC Activities Future Development Open Questions

SHARCNET TASP Report 2005-2006TASP Meeting

20th Int’l Symposium onHigh Performance Computer and Systems

St John’s, NewfoundlandMay 14, 2006

Ge BaolaiDavid McCaughanDoug RobertsJemmy HuSergey MashchenkoThomas Hu

Page 2: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

SHARCNET

University of Western OntarioFanshawe College

University of Windsor

Wilrid Laurier University

University of WaterlooMcMaster University

Sheridan CollegeUniversity of Guelph

Brock University

York UniversityUniversity of Ontario Institute of Technology

Trent University

Laurentian University

Lakehead University

Ontario College of Art and Design

Perimeter Institute

Page 3: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Resources Resources at A Glance

GridLab

UoW

UWOFC

UW

UoG

MAC

BU

York

SC

UOITThroughput Cluster ~3000c Utility Cluster ~1000c

Capability Cluster ~1500cSMP ~128c

SMP Cluster ~500c

Storage ~200TB

WLU

Page 4: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Resource… Resource Information Online

Name Type Make CPU Type CPUs Interconect OSbull cluster hp Opteron 384 Quadrics XC 3.0cat cluster generic Xeon, Opteron 162 GigE Red Hat 8.0coral cluster hp Itanium2 64 Quadrics XC 3.0goblin cluster Sun Opteron 56 GigE Fedora Core 4greatwhite cluster Compaq Alpha 388 Quadrics Red Hat 7.2idra cluster Compaq Alpha 128 Quadrics Tru64narwhal cluster hp Opteron 1068 Myrinet XC 3.0requin cluster hp Opteron 1536 Quadrics XC 3.0silky SMP SGI Itanium2 128 NUMA Linux 2.4tiger1 cluster Compaq Alpha 8 GigE Red Hat 7.2typhon SMP Compaq Alpha 16 Compaq Tru64whale cluster Compaq Opteron 3076 GigE XC 3.0wobbe cluster hp Opteron 208 Myrinet Fedora Core 3Total 7218

Page 5: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics User base

Page 6: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics… Users by Institutions

Page 7: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics… Cumulative CPU usage

Page 8: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics… Cumulative jobs

Page 9: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Accessibility Same home accounts accessible from anywhere across all systems. Unified software environment across all systems. User info in sophisticated database: accounts, contact, projects,

publications, problem tracking, etc. Web – a source for resources, usage, help info and events. Web portal – a gateway to internal information: user profile, system

usage, job status, statistics and online problem tracking system.

Page 10: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

HPC Highlights Computational Chemistry Material Science Financial Modelling Social Science Catastrophic Event Prevention Simulation … …

Page 11: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Staffing Now 11 + ½ people. 4 + ½ HPTC analysts, 5 + ½ system administrators. 1 technical manager. Everyone is truly multitasking:

– user research computing support.– system tool development, database, web programming.– giving lectures, workshops.– organizing conferences and workshops, event, budget planning, inviting external

speakers, seeking financial support from sponsors, handling online registration with e-commerce, etc.

– public communication– … …

Page 12: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

HPC Activities Renovations, deployment and testing of new systems. Training courses and workshops. Organizational and inter-organizational symposiums.

– HPCS ’05 in Guelph.– SHARCNET-HPCVL joint symposium in Toronto.– SHARCNET annual fall workshop/symposium at York University.– Various workshops, lectures…

Consultations, long term research projects.

Page 13: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 14: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 15: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 16: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 17: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 18: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 19: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 20: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 21: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 22: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 23: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 24: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Page 25: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Future Development AccessGrid. Multicluster scheduling. HPC support software development. Training and education: Certification Program

Page 26: C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai Outline  About SHARCNET  Resources and Usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Issues, Open Questions People money. Queuing policies, user job priority, frustrations.