mark l. green, ph.d. head of cyberinfrastructure center for computational research and new york...
TRANSCRIPT
Mark L. Green, Ph.D.Head of Cyberinfrastructure
Center for Computational Research and New York State Grid-Cyberinstitute
University at Buffalo
The State University of New York
22 University at Buffalo
The State University of New YorkCenter for Computational Research
Outline
Primary CentersEnabling TechnologiesModern Data Center TrendsEnabling Services and ApplicationsEnabling the next generation of discovery
33 University at Buffalo
The State University of New YorkCenter for Computational Research
Outline
Primary CentersEnabling TechnologiesModern Data Center TrendsEnabling Services and ApplicationsEnabling the next generation of discovery
44 University at Buffalo
The State University of New YorkCenter for Computational Research
State University of New York (SUNY)
New York State includes a variety of private and public institutions, including the State University of New York (SUNY), which is comprised of 64 campuses, has an enrollment of nearly 414,000
students, is served by more than 30,000 faculty, and has annual sponsored research
expenditures of approximately $850 million.
55 University at Buffalo
The State University of New YorkCenter for Computational Research
Center for Computational Research
Leading Academic Supercomputing Site Enable Research at UB and in WNY
90 Research Groups/25 Departments Industrial Outreach/Technology Transfer
to WNY Funding
NSF, NIH, NIMA, EPA, Keck, Sloan, NYS, UB, SUNY
IBM, SGI, Sun, HP, Dell, Nortel, Myricom Total Aggregate Computing Capacity
Current - 22 Teraflops 220 Terabytes of On-line Storage 250 Terabytes of tape storage
66 University at Buffalo
The State University of New YorkCenter for Computational Research
SGI Altix3700 (0.4TF) 64 Processors (1.3GHz ITF2) 256 GB RAM 2.5 TB Disk
BioACE (bioinformatics) Sun V880 (3), Sun 6800 Sun 280R (2) Intel P4 Servers Sun 3960: 7 TB Disk Storage
HP/Compaq SAN 75 TB Disk; 190 TB Tape 64 Alpha Processors 32 GB RAM; 400 GB Disk
CCR Compute/Storage Resources (22 Tflops)
Dell Linux Cluster (10TF) 1600 P4 Processors (3.2 GHz) Myrinet Interconnect 2000 GB RAM 30 TB SAN; 60 TB Local Disk
Dell Linux Cluster (2.9TF) 600 P4 Processors (2.4 GHz) Myrinet Interconnect 600 GB RAM; 40 TB Disk
Dell Linux Cluster (6TF) 4036 Processors (PIII 1.2 GHz) 2TB RAM 16 TB SAN; 160TB Local Disk
IBM BladeCenter (3TF) 532 P4 Processors (2.8 GHz) 5TB SAN
77 University at Buffalo
The State University of New YorkCenter for Computational Research
New York State Center of Excellence in Bioinformatics & Life Sciences
The $1B New York State Centers of Excellence program includes the Center of Excellence in Bioinformatics &
Life Sciences at SUNY-Buffalo, Syracuse’s Center for Excellence in
Environmental and Energy Systems, Rochester’s Center for Excellence in
Photonics and Microsystems, Albany’s Center for Excellence in
Nanoelectronics, and Stony Brook’s Center for Excellence in
Wireless & Information Technology.
88 University at Buffalo
The State University of New YorkCenter for Computational Research
Buffalo Niagara Medical Campus (BNMC)
The BNMC has developed a unique partnership in which the University at Buffalo, Roswell Park Cancer Institute, Olmsted Center for the Visually Impaired, Kaleida Health, Hauptman-Woodward Medical Research Institute, Buffalo Medical Group Foundation and Buffalo Hearing & Speech Center
are working in collaboration with the surrounding neighborhoods and local government to cultivate a world-class medical campus in downtown Buffalo.
99 University at Buffalo
The State University of New YorkCenter for Computational Research
1010 University at Buffalo
The State University of New YorkCenter for Computational Research
New York State Grid-Cyberinstitute
NYS Grass-roots Effort Hauptman-Woodward
Institute SUNY Binghamton SUNY Albany Columbia University
WNY Grid NSF Funded SUNY Buffalo Hauptman-Woodward
Institute Niagara University SUNY Geneseo
Expand Virtual Facility
1111 University at Buffalo
The State University of New YorkCenter for Computational Research
Center Infrastructure and Partners
TeraGrid Science Gateway using ACDC Grid Portal
UltraLight Configuring a small test cluster for Buffalo - UltraLight -
CERN testing, 1GbE to 10 GbE connections
NYSTAR Working with NYS support for research,
education, and economic development, the New York State Office of Science, Technology and Academic Research
Gen*NY*sis Centers SUNY Albany and Geneseo University
1212 University at Buffalo
The State University of New YorkCenter for Computational Research
Outline
Primary CentersEnabling TechnologiesModern Data Center TrendsEnabling Services and ApplicationsEnabling the next generation of discovery
1313 University at Buffalo
The State University of New YorkCenter for Computational Research
ACDC Grid Portal Gateway
1414 University at Buffalo
The State University of New YorkCenter for Computational Research
Grid-enabling Application Template (GAT)
1515 University at Buffalo
The State University of New YorkCenter for Computational Research
Grid-enabling Application Template (GAT)
1616 University at Buffalo
The State University of New YorkCenter for Computational Research
ACDC Data Grid Database Schema
ACDC GridData Grid
ACDC GridData Grid
1717 University at Buffalo
The State University of New YorkCenter for Computational Research
Data Grid API
1818 University at Buffalo
The State University of New YorkCenter for Computational Research
ACDC Grid Dashboardhttp://osg.ccr.buffalo.edu
1919 University at Buffalo
The State University of New YorkCenter for Computational Research
ACDC Operations Dashboardhttp://osg.ccr.buffalo.edu
2020 University at Buffalo
The State University of New YorkCenter for Computational Research
Grid Monitoring and Administration Collaborative Environment (Grid MACE)
2121 University at Buffalo
The State University of New YorkCenter for Computational Research
2222 University at Buffalo
The State University of New YorkCenter for Computational Research
2323 University at Buffalo
The State University of New YorkCenter for Computational Research
Outline
Primary CentersEnabling TechnologiesModern Data Center TrendsEnabling Services and ApplicationsEnabling the next generation of discovery
2424 University at Buffalo
The State University of New YorkCenter for Computational Research
Modern Data Center
Space 48U Server Racks Blade Centers, Multi-core Technology Virtual Machines
Power AC vs DC Power
• 20-40% less thermal load and 30% less power consumption with DC power
Cooling Data Center Thermal Management Infrastructure
• Floor mounted air handlers Server Rack Mounted Fans and Heat Exchangers Water Cooled Server Racks
2525 University at Buffalo
The State University of New YorkCenter for Computational Research
Storage Trends & Solutions
Storage Area Network (SAN) Convenient, Failover Protection, Mid-level
PerformanceNetwork Attached Storage (NAS)
Dedicated, Failover Protection, High-level Performance
Data Rates and File Usage Databases growing from 1 TB to 10s TB
• 3 year trending toward 64% growth rate per year 20% of filesystem files account for 80% of storage
• 3 year trending toward 75% growth rate per year• 70% of files not touched 3 months after creation• 40-50% of files not touched 6-12 months after creation
2626 University at Buffalo
The State University of New YorkCenter for Computational Research
Storage Trends & Solutions
Move away from Direct Attached Storage (DAS) Use NAS or SAN solutions
File System Archiving Email Archiving
• Eliminate multiple user email databases Single Instance Storage
• Eliminate multiple user document copies Smaller Backup Windows
• Less media• Less infrastructure
Reduce Primary Storage Using Tiered Approach• Use filesystem guidelines for usage patterns• Designate volatile storage areas• Quota and scrub filesystems
2727 University at Buffalo
The State University of New YorkCenter for Computational Research
Computational Trends & Solutions
xU Based Servers Required by science and engineering drivers x-core technology ready
Blade Centers High density x-core technology ready
Virtual Machines User can choose entire environment Operate multiple environments simultaneously
Coprocessors and Field Programmable Gate Arrays (FPGAs) 3-10x more flops using less power
2828 University at Buffalo
The State University of New YorkCenter for Computational Research
Outline
Primary CentersEnabling TechnologiesModern Data Center TrendsEnabling Services and ApplicationsEnabling the next generation of discovery
2929 University at Buffalo
The State University of New YorkCenter for Computational Research
Domain Science and Engineering
Shake-and-Bake (SnB) Molecular Structure Determination Application
Buffalo-and-Pittsburgh (BnP) SnB and PHASES Complete Protein Phasing
Q-Chem Commercial Quantum Chemistry Software Package
SledgeHMMER Sequence analysis using profile hidden Markov models
QMolDyn Quantum Molecular Dynamics
ARACNE Algorithm for the Reconstruction of Accurate Cellular
Networks
3030 University at Buffalo
The State University of New YorkCenter for Computational Research
Domain Science and Engineering
NWChem High Performance Computational Chemistry Software
Ostrich Optimization and Parameter Estimation Tool for
Groundwater ModelingEvolutionary Aseismic Design & Retrofit (EADR)
Passive Energy Dissipation System for Designing Earthquake Resilient Structures
Princeton Ocean Model Great Lakes (POMGL) Great Lakes Hydrodynamic Circulation Model
Titan Computational Modeling of Hazardous Geophysical Mass
Flows
3131 University at Buffalo
The State University of New YorkCenter for Computational Research
Outline
Primary CentersEnabling TechnologiesModern Data Center TrendsEnabling Services and ApplicationsEnabling the next generation of discovery
3232 University at Buffalo
The State University of New YorkCenter for Computational Research
Enabling the Next Generation of Discovery
Train the Next Generation Work ForceProvide Ubiquitous CyberinfrastructureEnsure Interoperability Through
Standards Based InfrastructureGenerate Virtual Facilities and InstitutesEnable Collaborative EnvironmentsObtain Efficient Utilization of
Computational and Data Resources
3333 University at Buffalo
The State University of New YorkCenter for Computational Research
Contact Information
ACDC Grid and Operations Dashboards URL: http://osg.ccr.buffalo.edu
ACDC Grid Portal URL: https://grid.ccr.buffalo.edu
For GRASE VO Membership, email: [email protected]
Center for Computational Research URL: http://www.ccr.buffalo.edu URL: http://www.ccr.buffalo.edu/grid
General contact info Mark L. Green: [email protected]