c3 tasp meeting/hpcs 2006 memorial university, st john’s newfoundland, 2006.05.14 copyright ©...

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Outline

About SHARCNET Resources and Usage Accessibility HPC Research Highlights Staffing HPC Activities Future Development Open Questions

SHARCNET TASP Report 2005-2006TASP Meeting

20th Int’l Symposium onHigh Performance Computer and Systems

St John’s, NewfoundlandMay 14, 2006

Ge BaolaiDavid McCaughanDoug RobertsJemmy HuSergey MashchenkoThomas Hu

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

SHARCNET

University of Western OntarioFanshawe College

University of Windsor

Wilrid Laurier University

University of WaterlooMcMaster University

Sheridan CollegeUniversity of Guelph

Brock University

York UniversityUniversity of Ontario Institute of Technology

Trent University

Laurentian University

Lakehead University

Ontario College of Art and Design

Perimeter Institute

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Resources Resources at A Glance

GridLab

UoW

UWOFC

UW

UoG

MAC

BU

York

SC

UOITThroughput Cluster ~3000c Utility Cluster ~1000c

Capability Cluster ~1500cSMP ~128c

SMP Cluster ~500c

Storage ~200TB

WLU

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Resource… Resource Information Online

Name Type Make CPU Type CPUs Interconect OSbull cluster hp Opteron 384 Quadrics XC 3.0cat cluster generic Xeon, Opteron 162 GigE Red Hat 8.0coral cluster hp Itanium2 64 Quadrics XC 3.0goblin cluster Sun Opteron 56 GigE Fedora Core 4greatwhite cluster Compaq Alpha 388 Quadrics Red Hat 7.2idra cluster Compaq Alpha 128 Quadrics Tru64narwhal cluster hp Opteron 1068 Myrinet XC 3.0requin cluster hp Opteron 1536 Quadrics XC 3.0silky SMP SGI Itanium2 128 NUMA Linux 2.4tiger1 cluster Compaq Alpha 8 GigE Red Hat 7.2typhon SMP Compaq Alpha 16 Compaq Tru64whale cluster Compaq Opteron 3076 GigE XC 3.0wobbe cluster hp Opteron 208 Myrinet Fedora Core 3Total 7218

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics User base

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics… Users by Institutions

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics… Cumulative CPU usage

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Statistics… Cumulative jobs

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Accessibility Same home accounts accessible from anywhere across all systems. Unified software environment across all systems. User info in sophisticated database: accounts, contact, projects,

publications, problem tracking, etc. Web – a source for resources, usage, help info and events. Web portal – a gateway to internal information: user profile, system

usage, job status, statistics and online problem tracking system.

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

HPC Highlights Computational Chemistry Material Science Financial Modelling Social Science Catastrophic Event Prevention Simulation … …

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Staffing Now 11 + ½ people. 4 + ½ HPTC analysts, 5 + ½ system administrators. 1 technical manager. Everyone is truly multitasking:

– user research computing support.– system tool development, database, web programming.– giving lectures, workshops.– organizing conferences and workshops, event, budget planning, inviting external

speakers, seeking financial support from sponsors, handling online registration with e-commerce, etc.

– public communication– … …

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

HPC Activities Renovations, deployment and testing of new systems. Training courses and workshops. Organizational and inter-organizational symposiums.

– HPCS ’05 in Guelph.– SHARCNET-HPCVL joint symposium in Toronto.– SHARCNET annual fall workshop/symposium at York University.– Various workshops, lectures…

Consultations, long term research projects.

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Future Development AccessGrid. Multicluster scheduling. HPC support software development. Training and education: Certification Program

C3 TASP Meeting/HPCS 2006Memorial University, St John’s Newfoundland, 2006.05.14

Copyright © 2006 Ge Baolai

Issues, Open Questions People money. Queuing policies, user job priority, frustrations.