© the trustees of indiana university centralize research computing to drive innovation…really...

26
© The Trustees of Indiana University Centralize Research Centralize Research Computing to Drive Computing to Drive Innovation…Really Innovation…Really Thomas J. Hacker Research & Academic Computing University Information Technology Services [email protected] Bradley C. Wheeler Assoc. VP & Dean Office of the VP for IT CIO [email protected]

Upload: bernard-dorsey

Post on 23-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Centralize Research Centralize Research Computing to Drive Computing to Drive Innovation…ReallyInnovation…Really

Thomas J. HackerResearch & Academic

ComputingUniversity Information Technology Services

[email protected]

Bradley C. WheelerAssoc. VP & Dean

Office of the VP for IT CIO

[email protected]

Page 2: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Provisioning Research ComputingProvisioning Research Computing

Does the rapid commoditization of computation and storage favor centralized or decentralized approaches to research computing?

Page 3: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Commoditization of IT is a motivating factor to do it alone

Balkanization of IT is a threat to research productivity and finance

Need for leveraged Cyber-infrastructure …a leveraged strategy

Page 4: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

A Teraflop cluster in every lab… or 10 Teraflops shared?

A 10 Teraflop cluster in every lab… or 100 Teraflops shared?

Page 5: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

How to Support Scholars?How to Support Scholars?“The business of e-science & humanities”

Leverage and economies scale/scope happen near the center

Innovation, autonomy, and discovery

happen near the edge

Page 6: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Page 7: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

http://www.storage.ibm.com/hdd/technolo/grochows/g05.htm

Page 8: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

IBM SPa

SGI

SGI

SGI

SGI

IBM SPb

Sun

IBM SPc

IBM SPc

IBM SPc

IBM SPd

IBM SPd

IBM SPd

IBM SPd

IBM SPd

IBM SPd

AVIDD

AVIDD

AVIDD

AVIDD

1996 1997 1997 1998 1998 1999 1999 2000 2000 2001 2001 2002 2002 2003 2003 2004 2004

Nov June Nov June Nov June Nov June Nov June Nov June Nov June Nov June Nov

Year

To

p50

0 R

ank

50

250

450

Data from http://top500.org

IU HPC Investments & Top500 List

Page 9: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

1 Total TeraFlop1 Total TeraFlop

HardwareStaff

Air Conditio

ning

Power

Downtime Penalty

Underuse Penalty

Centralized

Best Case Distributed

Worst Case Distributed

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

Co

st

pe

r C

PU

-ho

ur

Centralized Total $0.91Best Distribued Total $1.09Worst Distributed Total $1.35

Page 10: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Scaling up to 10 TeraFlopsScaling up to 10 TeraFlops

HardwareStaff

Air Conditio

ning

Power

Downtime Penalty

Underuse Penalty

Centralized

Best Case Distributed

Worst Case Distributed

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

Co

st

pe

r C

PU

-ho

ur

Centralized Total $0.83Best Distribued Total $1.17Worst Distributed Total $1.37

Page 11: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Page 12: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Domain SpecificDiscovery & Innovation,

Teaching & Learning

Necessary Infrastructure

Leveraged Discipline Research Stacks

Innovation

Metadata

Computation, Storage

Models

Networks

Chemistry

Visualization

Curation

Anthropology

Searching & Retrieving

Networks

Metadata

Curation

Innovation,Publication

Storage

Visualization

Business

Networks

Curation

Storage

Metadata

Retrieval &Analysis

Innovation

Primary Storage

Particle Physics

Distributed Storage

Networks

Metadata

Models

Computation

Visualization

Innovation

Scholarly InfrastructureScholarly Infrastructure

Shared Cyberinfrastructure Line Here?

Shared Cyberinfrastructure Line Here?

Page 13: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Source: P. Weill & M. Broadbent Leveraging the New Infrastructure: How Market Leaders Capitalize on IT, HarvardBusiness School Press, June 1998.

IT Infrastructure

LocalApplications

Fast changing local applications

Shared and StandardIT Applications

Shared and standard applications that change less rapidlyServices that are stable over time

Human infrastructure of knowledge, skills, policies,

Information Technology Components

Human Information Technology Infrastructure

Shared information technology services

Commodities – Computers, printers, networks, databases…

IT Infrastructure -- Shared IT Infrastructure -- Shared ServicesServices

Page 14: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Page 15: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Page 16: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

IU Approach to Research IU Approach to Research ComputingComputing Strategic Planning

Identify critical support areasInvolve research communityDevelop action itemsGain support of leadershipBasis for planning and funding

AccountabilityTrack progress against action items

Page 17: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

A mission to support researchers and artists in co-creating the future

All computing/research images from Indiana University sites

A foundation of reliable services

Page 18: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Researcher Consulting & Education

EngineeringComputing

Frontiers

Grant Initiation, Collaboration,Fulfillment

SystemsAdministration

Front Office Back Office

Our Work

ReliableServices

Co-Creatingthe Future

Ou

r O

bje

ctiv

eResearch & Academic Research & Academic ComputingComputing

Dr. Kate Pilachoski, Professor of Astronomy

Page 19: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

National CyberinfrastructureNational Cyberinfrastructure

Atkins reportIdentified dangers of duplicate efforts

across disciplines New NSF Cyberinfrastructure

Directorate Cross-institutional CI Efforts

Open Science Grid, U.S. AtlasBIRN, LEADACLS Cyberinfrastructure and the

HumanitiesTeragrid

Page 20: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

CI StrategiesCI Strategies

Empower scholarly communitiesReduce redundant effortsInitiate local CI initiativesEngage with national CI efforts

Build common cyberinfrastructureBreak down discipline IT silosInvest savings into improving

infrastructure Realign research computing as

institutional CIImprove competitive advantage in

research

Page 21: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

IU Approach to Research IU Approach to Research ComputingComputing Accountability

Award winning campus surveyComprehensive survey (n=2000)Results used in planning and budgeting

Page 22: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

IU Approach to Research IU Approach to Research ComputingComputing

Close partnerships with university communityAVIDDExtended Terascale Facility (ETF)Sakai and KualiTeragridData Capacitor

Win Grant $$

Acquire IT & Staff

DevelopCompetencies

DeliverResults ∞

Page 23: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Page 24: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Page 25: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Commoditization of IT is a motivating factor to do it alone

Balkanization of IT is a threat to research productivity and finance

Need for leveraged Cyber-infrastructure …a leveraged strategy

Page 26: © The Trustees of Indiana University Centralize Research Computing to Drive Innovation…Really Thomas J. Hacker Research & Academic Computing University

© The Trustees of Indiana University

Centralize Research Centralize Research Computing to Drive Computing to Drive Innovation…ReallyInnovation…Really

Thomas J. HackerResearch & Academic

ComputingUniversity Information Technology Services

[email protected]

Bradley C. WheelerAssoc. VP & Dean

Office of the VP for IT CIO

[email protected]