Use Cases and Best Practices Primer for SUSE® and ARMCAS91763

Andrew Wafaa

Principal Engineer

ARM Ltd

Alexander Graf Dirk Mueller

The Data Center is Evolving

2

Today Next 3 Years 5 Years +

ThroughputWorkload

optimized

Total cost

of

ownership

Data center workload characteristics are scaling out

Modern Workloads Driven by IO Performance

4

Performance

per

Watt

Heterogeneous

compute

Balanced

solutions

0% 25% 50% 75% 100%

Web NoSQL/Big Data

Hosting – Static content

Hosting – Dynamic content

Caching

Front-end Load Balancing, Proxy

Social Media Content

Email

Web: Light SQL

Distributed Block Storage

Cold Storage

IO MEM CPU

TODO: current / legacy state of things

5

Applicability of ARM for Server Workloads

6

2016-2017 2017-2018 2018-2019 2020

Applicability of ARM for Server Workloads

7

2016-2017 2017-2018 2018-2019 2020

Storage

Innovation Delivering Value

8

Enhanced

end to end

security

S3

compatible

APIs

Nine

9’s data

reliability

Self

managing

scalability

3-7x

lower end

user cost

3x

power

savings

9

AppliedMicro Announces the Availability of its Mudan Storage Platform

10

Ceph extends tentacles to embrace ARM in Jewel release

Applicability of ARM for Server Workloads

11

2016-2017 2017-2018 2018-2019 2020

Storage

Web-serving / Java based workloads

ARM initial

focus

Delivering Value in the Traditional Data Center

12

7x lower

power

consumption

per year

10x compute

density per

rack

1.8x Lower

system cost

Applicability of ARM for Server Workloads

13

2016-2017 2017-2018 2018-2019 2020

Storage

Web-serving / Java based workloads

Content delivery networks

Data analytics (big data)

ARM initial

focus

Applicability of ARM for Server Workloads

14

2016-2017 2017-2018 2018-2019 2020

Storage

Web-serving / Java based workloads

Content delivery networks

Data analytics (big data)

Networking

Collaborative platforms (email, file sharing, conferencing)

HPC (engineering)Initial HPC programs underway

ARM initial

focus

Delivering Value From End to End

15

2x Higher

Network

Connectivity

5x compute

density per

rack

1.2x Lower

system cost

>5 9’s

Data Reliability

SymKloud 2910 with X-Gene

ARM-based Hardware Designed for a Software-Defined World

A SYMKLOUD converged infrastructure platform is designed explicitly to support operator services delivered on

commercial-off-the-shelf (COTS) high availability infrastructure deployed using software defined networking

(SDN) and network functions virtualization (NFV) technologies. Its modular and short-depth footprint packs in high

density compute, storage and a 20GbE switch fabric that supports bare metal SDN switching for legacy and

OpenFlow traffic.

Applicability of ARM for Server Workloads

16

2016-2017 2017-2018 2018-2019 2020

Storage

Web-serving / Java based workloads

Content delivery networks

Data analytics (big data)

Networking

Collaborative platforms (email, file sharing, conferencing)

HPC (engineering)

Structured data management

Initial HPC programs underway

ARM initial

focus

© ARM 2016 ARM Confidential

OVHCloud compute

BarcelonaSupercomputing

CentreScientific research

US DOEFastForward

HPC

PayPalData analytics

Multiple Cloud

Operators Storage & Services

Sandia LabsHPC

Active Real World Engagements

Applicability of ARM for Server Workloads

18

2016-2017 2017-2018 2018-2019 2020

Storage

Web-serving / Java based workloads

Content delivery networks

Data analytics (big data)

Networking

Collaborative platforms (email, file sharing, conferencing)

HPC (engineering)

App dev/test

Systems management

Business

Structured data management

Initial HPC programs underway

ARM initial

focus

19

TSMC, ARM Aim 7nm at Data Centers

20

Marvell Releases New ARMADA Hyperscale Virtual SoC Featuring ARM Cortex-A72

CCIX – Cache Coherent Interconnect for Accelerators

21

Allows multiple processor architectures and

accelerators to seamlessly share data

Open Acceleration Framework for Data Centers and Other Markets

Accelerating applications in the data center has become a

requirement due to power and space constraints. Applications such as big

data analytics, search, machine learning, NFV, wireless 4G/5G, in-

memory database processing, video analytics, and network

processing, benefit from acceleration engines that need to move data

seamlessly among the various system components.

http://www.ccixconsortium.com/

22

Broadcom Announces Volume Production of Quad-core 64-bit 2GHz ARMv8 SoCs

23

GIGABYTE Announces Official Release of Production-Ready Cavium ThunderX®-based Servers

Fujitsu

24

Fujitsu picks 64-bit ARM for Japan's monster 1,000-PFLOPS super

25

Cavium Unveils ThunderX2 Plans, Reports ARM Traction is Growing

100 X

capacity

50 X

capability

15X

efficiency

ARMv8-A

with SVE

RIKEN

Advanced Institute for

Computational Science

New: Scalable Vector Extension (SVE) for ARMv8-A

27

Efficiency

Scalability

Implementations can scale vectors from 128 to 2048 bits without

requiring code to be rewritten or recompiled

Co-design with HPC partners delivers increased compute density

with enhanced vectorization and optimized software design

Better target for HPC vendors’ vectorizing compilers and open

source compilersPortability

Fujitsu’s statement

28

“Fujitsu chose to adopt ARMv8-A with SVE in order to best position the

Post-K computer to contribute to a wider user base and utilize the assets.

This decision was also a natural result of collaboration with ARM on the

development of the HPC extensions”

Server Strategy - Key Points

• ARM Servers are in production now

• End Users are finding compelling TCO Benefits with

ARM servers

• The ARM server Ecosystem continues to expand

• We are at the right point in our journey

29

Traditional networking

equipment

Traditional 2P Server

Revolutionizing Infrastructure – Integrated Silicon PlatformsSystem-on-chips incorporating common, scalable elements

30

Traditional Servers are

General Purpose SystemsTraditional Network

Equipment is Largely Fixed

Function

Traditional networking

equipment

Traditional 2P Server

Revolutionizing Infrastructure – Integrated Silicon PlatformsSystem-on-chips incorporating common, scalable elements

31

High

Performance

CPU

Storage

I/OPower

management

NetworkWorkload

Acceleration

ARM SoC Interconnect

Increased Server Specialization

Integrating more functional

specific logic

High

Performance

CPUI/O

Network Processing and

Acceleration

Power

management

ARM SoC Interconnect

Increased Network Flexibility

Integration of more general

purpose compute

Revolutionizing Infrastructure – Integrated Silicon PlatformsSystem-on-chips incorporating common, scalable elements

32

Traditional

networking equipmentTraditional 2P

Server

High

Performanc

e

CPU

Storag

e

I/

O

Power

managemen

t

Netwo

rk

Workload

Acceleratio

n

ARM SoC

Interconnect

Software Defined

<X>

Accelerated

innovation

Flexibility

Manageability

Scalability

Efficiency

Choice

Increased Server

Specialization

Integrating more functional

specific logic

High

Performanc

e

CPUI/

O

Network Processing

and

Acceleration

Power

managemen

t

ARM SoC

Interconnect

Increased Network Flexibility

Integration of more general

purpose compute

High

Performanc

e

CPU

Storag

e

I/

O

Network Processing

and

Acceleration

Power

managemen

t

ARM SoC

Interconnect

ARM & Partner IP

Example: Phytium Unveils Speedy 64-Core ARM Processor

33

At 512 gigaflops though, the FT-2000/64 is certainly suitable for HPC gear. Assuming

those FLOPS numbers are valid, the Phytium silicon would match up well with the

current-generation Broadwell Xeon chips from Intel, at least from a raw

performance standpoint. Also, with more than 200 GB/sec of memory bandwidth,

the FT-2000/64 is well into Power8/Power9 territory. For just 100 watts, those are

some impressive processor specs. And if those numbers hold up, that would mean

Phytium’s newest offering is the most powerful ARM server chip on the planet.

Source: https://www.top500.org/news/chinese-chipmaker-unveils-speedy-64-core-arm-processor/

From the FT-2000/64 product page:

Process：Manufacturing with 28nm process

Core：Integrating sixty-four FTC661 cores

Frequency：Running at 1.5GHz~2.0GHz

Cache：Integrating 32MB L2 cache and extending 128MB LLC

Extension Interface：8 proprietary extension interfaces, 19.2GB/s ea

Memory：16 x DDR3-1600 memory controllers, which can deliver 204.8GB/s

memory access bandwidth.

I/O Interface：2 x16 or 4 x8 PCIE Gen3 interface

Power：Max. power 100W

Package：FCBGA package with 2892 pins

Today’s Scalable ARM-based Platforms

34

Shippingtoday

4-64core

solutions

Up to

7xdemonstrated

efficiencygains

HiSilicon D02 Server

ARM-based Chips Powering Efficient Servers

35

Shipping in 2015 ….More 64-bit solutions on the horizon

Example: ARM Servers Available from Multiple Manufacturers

36

ProLiant Cartridges

for HP Moonshot (Applied Micro, TI)

Wiwynn LN1148-10SL (Marvell)

Gigabyte D120-S3G(Annapurna)

Gigabyte R120-P30(Applied Micro)

Gigabyte MT70-HD0(Cavium)

Cirrascale RM1905D(Applied Micro)

Softiron Overdrive 3000(AMD)

E4 ARKA(Applied Micro, Cavium)

Avantek UK(Cavium, Annapurna)

Penguin Valkre(Cavium)

HPE StoreVirtual 3200

SymKloud 2910(Applied Micro)

Software Ecosystem Enablement Efforts

37

Expanded Engagement with Open Source Community

• Drive industry projects w/ partners

• E.g. ODP for NFV (SW Virtualization)

• Common Baseline DPDK cont.

Driving towards Deployment Readiness/Optimized Performance

• Drive Leading ISVs to GA on ARM

• Benchmarking/Optimization

• Virtualization etc. Optimizations

• Develop TCO proof points

Expanding Application Developer Ecosystem

• Invest in OpenFastPath., ODPi

• Invest in low-cost boards

• PoC/Engagements with ISVs

• Tools/Middleware enablement

Participate in and Drive Linaro Ecosystem Enablement

• ARM & partners => 200+ engineers

• Develop common, core technology

• Develop & drive standards adoption

Infrastructure Ecosystem Gaining Momentum

38

ARM Ecosystem driving Optimized Solutions for Range of Use Cases:- via Community

Engagement

OSes /

HAL

Network

Virtualization

Firmware &

Network Boot

VNFs

Middleware

Virtual Infrastructure

Manager

ACPI

Linux Foundation: Linux Kernel Development 2016

39

Source: go.linuxfoundation.org/linux-kernel-development-report-2016

Linaro + ARM = Third largest

commercial contributor to the

Linux Kernel(removing ‘none’/‘unknown’)

+TI + NXP + Broadcom + Huawei

+ Qualcomm = Ecosystem

approach

ARM and NFV

40

Brahmaputra Reference Stack

Empowering Server Software Developers

• Multiple options for software developers on ARM

• Physical platforms and cloud based services

41

Developer

Platforms

Cloud

Resources

Summary

• ARM 64-bit servers in production now!• End users finding compelling TCO Benefits with ARM servers

• ARM partners understand SoC integration and are uniquely positioned to deliver the best performance/watt/$/Cu ft

• Collaborative business model supports “one size does not fit all approach,” rapid pace of innovation, choice and diversity

• ARM server ecosystem continues to expand with new entrants Alibaba, Asus, Broadcom, Cray, GigaByte, Kontron, Pegatron, Lenovo and Qualcomm

42

Real world deployments

43

Growing the Ecosystem

44

Choice of CPU vendor

45

Choice of OEM/ODM vendor

46

SUSE ARM Partners

https://www.suse.com/partners/arm 47

Success starts with the community

48

Matching British Design withGerman Engineering

49

SUSE History of Innovation

50

SUSE History of Innovation

51

SUSE History of Innovation

52

SUSE® Runs on ...

53

… your laptop

… your desktop

… your server

x86

x86

x86

ARM-based Machines

54

Smartphones

Tablets Tiny laptops

Cloud nodes and Low-Energy Servers

Netbooks

ARM-based Machines

55

Smartphones

Tablets Tiny laptops

Cloud nodes and Low-Energy Servers

Netbooks

openSUSE on ARM Timeline

56

201720162015

openSUSE 13.2

ARMv7 and ARMv8

Nov 12th, 2014

Leap 42.1 ARM

release

Nov 8th, 2015

Leap 42.2

ARMv7 and ARMv8

Nov 16th, 2016

OpenQA for AArch64

57

58

SUSE® on ARM Team

Virtual team of technical experts from SUSE and SUSE partners

59

Strong collaboration with technology providers

Started in Q1/2014

ARM Partner Program

• On July 13th2015, SUSE announced supported Partner Program for SLE on 64-bit ARM (AArch64)

60

‒ Partner-centric for initial offering

‒ Engagement with multiple silicon vendors

‒ Engaged with multiple system vendors

SUSE Linux Enterprise Server 12 for ARM

SLES for ARM provides an

enterprise-grade Linux distribution

optimized for 64-bit ARM AArch64

systems that deliver outstanding

performance, reliability and

scalability for mission critical

workloads.

61

SUSE Linux Enterprise SP2 Overview

• What?

- Upstream kernel version: 4.4 (kernel chosen specifically for ARM support)

- Over 3000 packages (additional features, bug fixes, security updates)

• Supported architectures:

- POWER (little endian only)

- Intel/AMD64-bit (x86_64)

- IBM System z and Linux One (zSystem)

- ARM 64 bit (AArch64)

• When?

- First Customer Shipment: November SUSECON 2016

62

SUSE Linux Enterprise for ARM overview

• Included

- Upstream kernel version: 4.4 (kernel chosen specifically for ARM support)

- Over 3000 packages (additional features, bug fixes, security updates)

- KVM with libvirt

- GCC

- Toolchain, HPC modules

• Supported SoC vendors and chips:

- Advanced Micro Devices (AMD) – Opteron A1100

- Applied Micro – X-Gene 1, X-Gene 2

- Cavium - ThunderX

- NXP/Freescale - LS208xA

- NXP QorlQ LS2085A / LS2045A, LS2080A,/ LS 2040A

- Xilinx - UltraScale+ MPSoc

63

One more thing..

64

Introducing

SUSE Linux Enterprise 12 for the Raspberry Pi

What?

• SLES 12 distribution for the Raspberry Pi 3 Model B

• Packaged as an image ready to copy to an SD Card

• Includes compilers, development tools and source

• Comes with a free one year self service subscription

• Enabled for Wi-Fi, Bluetooth, HDMI, Ethernet, and GPIO

• Download from https://www.suse.com/download-linux

• Q&A support on https://forums.suse.com/forum.php

Why

• To have a lot of fun!

• Leverages the work done on SLES for ARM

• Provides an easy to consume way to introduce SLES to potential new clients

65

$35 computer with 64 bit ARM processor

Evolve your data center today,

ARM it with SUSE.

www.suse.com/arm