ecocloud - alliance · in-memory analytics recommendation system media streaming nginx, http server...

Babak Falsafiecocloud.ch

EcoCloudEnabling Eco-friendly Smart Data

Information Technology (IT): Five Decades of Exponential Growth

IT is at the core everything we do & has become an indispensable pillar for a modern day society!

Intel 4004, 1971

Intel Xeon, 2014

92,000 ops/sec

266,000,000,000 ops/sec

A Brief History of IT

§ From computing-centric to data-centric§ Consumer Era: Internet-of-Things in the Cloud

1970s-

PC Era

Mobile Era

Mainframes1980s 1990s Today+

Consumer Era

Two Inflection Points for IT

1. Big Data§ Data grows faster than 10x/year§ Platforms improve at 1.5x/year§ Huge demand on scaling platform capacity

2. Platforms§ Silicon slowly getting denser§ But, Silicon efficiency has halted§ IT energy not sustainable

Data is Shaping Future of IT

§ Data growth (by 2015) = 100x in ten years [IDC 2012]§ Population growth = 10% in ten years

§ Monetizing data for commerce, health, science, services, ….§ Big Data is shaping IT & pretty much whatever we do!

Data Shaping All Science & Technology

Science entering 4th paradigm§Analytics using IT on

§ Instrument data§ Simulation data§ Sensor data§ Human data § …

Complements theory, empirical science & simulation

Data-centric science key for innovation-based economies!

Datacenters Growing Fast

BC 332.

Source:  James  Hamilton,  2012

Daily IT growth in 2012 = IT first five years of business!

Warning! Datacenters are not Supercomputers

• Run heterogeneous data services at massive scale• Driven for commercial use• Fundamentally different design, operation, reliability, TCO• Density 10-25KW/rack as compared to 25-90KW/rack• Tier 3 (~2 hrs/downtime) vs. Tier 1 (upto 1 day/downtime)• ……and lots more

Datacenters are the IT utility plants of the future

Supercomputing Cloud Computing

≠

Internet-of-Things (IoT) Growing Fast Too

9

Source: IDC Worldwide and Regional IoT forecast, EMC Digital Universe with Research and Analysis by IDC

28 Billion Connected Devices

4 zettabyttes of Data, 10% of Digital Universe$7 Trillion Market Revenue

Good News: Chips are Getting Denser

0.01

0.1

1

130 nm

90 nm

65 nm

45 nm

32 nm

22 nm

14 nm

10 nm

$/Transistor

Moore’s Law continuesIntel [ISSCC’15]

Improved packaging2.5D/3D Chips

3D XPoint by Intel & MicronNon-volatile memory [IntelPR’15]

Bad News:Chips are out of power!

0

1

10

100

1,000

10,000

100,000

1,000,000

10,000,000

1985 1990 1995 2000 2005 2010Year of Introduction

Num Transistors (in Thousands)Relative PerformanceClock Speed (MHz)Power Typ (W)NumCores/Chip

Higher Demand + Lower Efficiency: Datacenter Energy Not Sustainable!

§Modern datacenters è 20 MW!§ In modern world, 6% of all electricity and growing fast!

Billio

n Ki

low

att h

our/y

ear

2001 2005 2009 2013 2017 0

4080

120160200240280 Datacenter

Electricity DemandsIn the US(source: Energy Star)

65 million Swiss homes

A Modern Datacenter

17x football stadium, $3 billion

? IT’s Future

BridgingTechnologies

Big Data Big Energy

The first & only academic research center of its kind

A Center for multi-disciplinary energy-efficient data-centric technologies research

(founded in 2011)

Center to bring efficiency to data§ 16 faculty, 50 researchers§ 6M CHF/year external funds

Mission:§ Energy-efficient data-centric IT§ From algorithms to machine infrastructure§ Technologies to maximizing value for data

ecocloud.ch

Our Vision:Holistic Optimization of Datacenters

Holistic optimization• Algorithms to

infrastructure• Cross-layer• Paradigms to monitor,

manage & reduce energy

Open technologies!

Algorithm

Infr

astr

uctu

re

Integrated Cooling: CMOSAIC

3D server chipTwo-phase liquid cooling

§ Enables higher thermals§ Dramatically better heat removal

Prototyped by IBM

PCB

Micro-HeaterLiquid

Micro-Channels

Integrated Thermal Management @ Credit Suisse

• Designed fine-grain power/thermal sensors

• Deployed in Credit Suisse site• Synergistic server load/thermal

provisioning• Real-time monitoring of 5K

servers

50% better energy efficiency!

In-Memory AnalyticsRecommendation System

Media StreamingNginx, HTTP Server

Web Search Apache Solr & Nutch

Web ServingNginx, PHP server

Data ServingCassandra NoSQL

Graph AnalyticsGraphX

Data CachingMemcached

Data AnalyticsMachine learning

Cloud Benchmarking with CloudSuite 3.0 (parsa.epfl.ch/cloudsuite)

Building  block  for  Google  PerfKit,  EEMBC  Big  Data!

Cavium ThunderXScale-Out Processor

48-core 64-bit ARM SoC[based on “Clearing the Clouds”, ASPLOS’12]:• Designed to serve data• Specialized chip design for servers• 10x better efficiency than Xeon

dbtoaster.org

Compilation of offline analytics into online/incremental engines Aggressive code specialization

Data Stream

Low-latency stream processing Up to 6 OOM faster than commercial systems

110

1001000

10000100000

100000010000000

Q3 Q9 Q10 Q11 Q14 Q15 Q21

DBToaster:Breaking Up Data Jams

Bringing it All Together

EcoCloud founded in 2011§A center for eco-friendly smart data§Bridging the data & platform efficiency gap§Strong industrial partnership program§Real impact (industry, Switzerland/EU and beyond)

For more information please visit us at ecocloud.ch

Thank You!