power8 hardware technical deep dive workshop
TRANSCRIPT
POWER8 Hardware Enhancements and Update
July 9, 2014
Student Guide & Workshop & Internal Training & Confidential Update Dailyhttps://goo.gl/VVmVZ0
© 2014 International Business Machines Corporation 2
Competitive Positioning Power vs. Oracle Systems 2 http://ouo.io/DH476
Competitive Positioning Power vs. Oracle Systems 1 http://ouo.io/HpEK0
KVM on Power -- Open Virtualization Choice for Linux http://ouo.io/sSB89
Power Hardware and System Software Announcement Overview http://ouo.io/8rqfXm
Power Systems Management - PowerVC http://ouo.io/A0clE
POWER8 Hardware Announcements and Enhancements 1 http://ouo.io/Lvy0At
POWER8 Hardware Announcements and Enhancements 2 http://ouo.io/m6Zoj9
POWER8 Hardware Deep Dive Technical Presentation http://ouo.io/hyAP3P
POWER8 Hardware Enhancements and Update http://ouo.io/M41Xh
POWER8 Proof-of-Technology http://ouo.io/mF5Kh
Virtualization differences of Power VM, Power KVM and VMware http://ouo.io/KfLNVM
Win the Battle Against x86! Arm Yourself with the IBM POWER8 Playbook http://ouo.io/hRoW6
Agenda
Power S814 July Announcement Edward Liu
POWER8 Processor and I/O Enhancements Mark Olson
Corsa and FPGA Overview Robert Sherwood
IBM Rackswitches – MTM Transitions Pramodh Mallipatna
3© 2014 International Business Machines Corporation
POWER S814 July AnnouncementRevolutionizing how IT is created and consumed
Edward LiuOffering Manager
5
Power Systems S822LPower Systems
S812L•1-socket, 2U•Up to 12 cores POWER 8•512 GB memory•6 PCI Gen3 siot•Linux only•Up to One CAPI support •PowerVM or PowerKVM
•2-socket, 2U•Up to 24 cores POWER8•1 TB memory•9 PCI Gen3 slot•Linux only•Up to 2 CAPI support •PowerVM or PowerKVM
•2-socket, 2U•Up to 20 cores POWER8•1 TB memory•9 PCIe Gen 3•AIX & Linux•Up to 2 CAPI support •PowerVM
Power Systems S822
1 & 2 Sockets
Power Systems S814
•1-socket, 4U•Up to 8 cores POWER8•512 GB memory•7 PCIe Gen 3•AIX, IBM i, Linux•Up to 1 CAPI support•PowerVM
Power Systems S824
Power Systems: Innovation to put data to work
•2-socket, 4U•Up to 24 cores POWER8•1 TB memory•11 PCIe Gen 3•AIX, IBM i, Linux•Up to 1 CAPI support•PowerVM
POWER Scale-out Systems - Created for New Workloads & Enhanced Core Values
Provide efficient consolidation of business workloads Designed for demanding environments where uptime is
critical and downtime is costly Deliver a higher value, more secure, and more reliable
platform than competitors
• Processor and Memory– Up to 12-core POWER8 processor card– Up to 8 Simultaneous Multi Thread per core– Transactional Memory– Java Code Optimization w/HW Assist
• I/O innovation– PCIe Gen3– Coherent Accelerator Processor Interface
• RAS– RAID 0, 5, 6, 10 in the base– Concurrent maintenance PCIe Gen3 slots– Standard redundant power/cooling
New4-core
5
© 2014 International Business Machines Corporation
6
The New 4-core Power S814
• 1 socket, 4 EIA units with 4, 6 or 8 core processor card, 16- 512GB memory• Standard, split, and high perf RAID backplanes•PowerVM virtualization•AIX, IBM i, RHEL, SUSE OS
Highlights• Highly secure and scalable architecture providing a stable database and middleware platform for efficient deployment of business processing and mission critical applications• Ideal for mid-sized business customers consolidating UNIX, IBM i and Linux workloads•The new Power S814 4-core POWER8 processor offering with IBM i P05 pricing tier ( while S814 6-core and 8-core with IBM i P10 pricing tier ), small tier AIX and Linux pricing as roadmap to 4-core Power 720 and address market low cost pricing requirement.
Include IBM i Solution Edition and CBU support Limited I/O support
no feature code I/O drawers like #5887 and no future PCIe expansion drawer. (Fibre Channel attached drawers/SANs supported.)
Max of 8 (June) or 10 (July) storage bays Support only HHD 139G & 283G and SSD 387G
drives (#ELDT and #ELDU available at July 25th)
Open Technology Server for mid-sized business solutions
© 2014 International Business Machines Corporation
7
POWER 720 and Power S814
Power 720 Power S814
Processor Offerings
POWER 74-core 3.6 GHz6-core 3.6 GHz 8 core 3.6 GHz
POWER84-core and 6-core 3.02 GHz 8-core 3.72 GHz ( Rack only)
Memory Features8 / 16 / 32 / 64GB DDR2
8 to 512GB
4-core (16GB DDR3 max 64GB )6-or 8-core (16 / 32 / 64GB DDR3)
16 to 512GB
OS Support
AIX V7.1, V6.1IBM i 6.1. 7.1, 7.2Linux RHEL 6.4,
SLES 11 SP2
AIX V7.1, V6.1IBM i 7.1, 7.2
Linux RHEL 6.5, 7SLES 11
HDD/SSD Bays in system unit HDD/SSD Bays in system unit Standard 6SFF or 8 SFF
4-core: 8SFF 6 -or 8-core :Standard: 12 SFF or
18 SFF
PCIe Slots(low profile)
Ten Gen2 slots: Five x8, One x4 and 4 LP x8*
Np Hot swapNo CAPI capable
Seven Gen3 slots: Two x16 and Five x8 (one x8 PCIe slot must
contain a 4-port 1Gb Ethernet LAN) Hot swap
CAPI capable – max 1
Integrated SAS Controller
Standard: JBOD, RAID 0,1,10 Optional: 175MB cache & RAID 5 & 6
Standard JBOD, RAID 0,5,6,10Optional: 7200MB# cache
& Easy Tier function Ethernet AdapterIn one PCIe Slot
Quad 10/100/1000 Quad 10/100/1000
PCIe I/O Drawers Max 2 PCIe Gen1 Drawers n/a (SOD Gen3)
Storage Drawer Max 14 EXP24S 6-or 8-core only: Max 24 EXP24S
Electrical PowerTower : 100 to 127AV or
200V to 240V ACRack 200V to 240V AC
Tower : 100 to 127V AC or200V to 240V AC
Rack 200V to 240V AC
Redundant Power and Cooling Optional Standard
EnergyScaleActive Thermal Power Management
Dynamic Energy Save & Capping
Warranty 3 Years
# 1.8GB write cache with compression up to 7.2 GB effective
* 4 LP slots required optional PCIe raiser card which takes a GX++ slot
• Highly secure and scalable architecture providing a stable database and middleware platform for efficient deployment of business processing and mission critical applications• Ideal for mid-sized business customers consolidating UNIX, IBM i and Linux workloads
© 2014 International Business Machines Corporation
8
S814 list price summary
* Due to the memory module limitation of 4-core configuration, 2x16GB RAM price is higher than 32GB
© 2014 International Business Machines Corporation
+20%
+39%
POWER8 Processor and I/O Enhancements
Mark OlsonPower Systems WW Product Management
10© 2014 International Business Machines Corporation
4-core S814
12© 2014 International Business Machines Corporation
4-core 1S4U Scale-out System (June)
Power S814 Form Factor: 4U or Tower Single Socket
Cores: 4 (3.0 GHz) Memory: Up to 64 GB Slots: 7 PCIe Gen3 Full-high (Hotplug)
Ethernet: 4-port 1 Gbt in PCIe slot Integrated ports: USB (4/5), Serial (1), HMC (2) Internal Storage
DVD 8 SFF Bays * -- Split Backplane: 4 + 4 or 8 SFF Bays * with Easy Tier with 7GB write cache
Hypervisor: PowerVM OS: AIX, IBM i (P05 software tier), Linux
3 Yr Warranty
* Physically 12 bays or 18 bays are present, but usage of a max of 8 drives (SSD or HDD or mix) is supported, Note 10 June announcement was for 8 drives and 15 July announcement increased to 10 drives.
13© 2014 International Business Machines Corporation
4-core 1S4U Scale-out System (July)
Power S814 Form Factor: 4U or Tower Single Socket
Cores: 4 (3.0 GHz) Memory: Up to 64 GB Slots: 7 PCIe Gen3 Full-high (Hotplug)
Ethernet: 4-port 1 Gbt or 2-port 10/1 Gbt in PCIe slot Integrated ports: USB (4/5), Serial (1), HMC (2) Internal Storage
DVD 10 SFF Bays * -- Split Backplane: 5 + 5 or 10 SFF Bays * with Easy Tier with 7GB write cache
Hypervisor: PowerVM OS: AIX, IBM i (P05 software tier), Linux
3 Yr Warranty
* Physically 12 bays or 18 bays are present, but usage of a max of 10 drives (SSD or HDD or mix) is supported, Note 10 June announcement was for 8 drives and 15 July announcement increased to 10 drives. Also not split back plane can also be split 4+6 as well as 5+5
14© 2014 International Business Machines Corporation
4-Core Power S814
Four-core server for AIX, IBM i and Linux. Especially interesting to IBM i clients because of its P05 software tier 3 GHz cores Like the POWER7 4-core offering – no feature code I/O drawers like #5887 and
no future PCIe expansion drawer. (Fibre Channel attached drawers/SANs supported.)
Like the POWER7 4-core – 64GB memory maximum. 4-core POWER8 uses only 16GB memory features
Max of ten SFF-3 drives in system unit (SSD or disk or mix) -- POWER7 4-core maximum is eight. POWER8 4-core is 25% more drives as of July.
Supports 15k 139/146GB and 15k 283/300GB disk drives and supporting 387GB SSD. Not supporting other drive sizes.
4-core S814 offers better price/performance than 4-core 720 and higher function, but the absolute price of S814 4-core option higher than 720 4-core
16© 2014 International Business Machines Corporation
Power 720 Power System S814Processor POWER7+ POWER8Sockets 1 1Cores 4 4
Maximum Memory* 64 GB @ 1066 MHz 64 GB @ 1600 MHzMemory Cache No Yes
Memory DRAM Spare No Yes
System unit PCIe slots 6 PCIe Gen2 FHOpt 4 PCIe Gen2 LP 7 PCIe Gen3 FH
PCIe Hot Plug Support No YesEthernet ports in required
PCIe adapter 4-port 1 Gbt (in x4 slot)4-port 1 Gbt (x8 Slot)
or2-port 10/1 Gbt (x8 slot) *
SAS bays in system unit 6 or 8 SFF-1 bays 10** SFF-3 baysIntegrated write cache Optional 175 MB Optional effectively 7GB
Easy Tier Support No (IBM i can use OS integrated capability) Yes (AIX/Linux) IBM i can use OS integrated capability
Integrated split backplane* Yes ( 3 + 3 ) But not supported by IBM i
Yes ( 5 + 5 ) note zero write cache for SAS controller
Bay for SAS tape drive in System unit 1 HH bay No HH bay
4U Scale-out Comparison – 4-core
* with latest microcode level in adapter available late August** Physically more than 10 SAS bays, but a max of 10 drives (July) supported. Could split 4+6 if desired.
17© 2014 International Business Machines Corporation
CPW
S824 (1 or 2 socket) 6-core 3.8 GHz 72,000 12-core 3.8 GHz 130,000
8-core 4.1 GHz 94,500 16-core 4.1 GHz 173,500
12-core 1-socket not offered 24-core 3.5 GHz 230,500
S814 (1 socket) 4-core 3.0 GHz 39,500 6-core 3.0 GHz 59,500 8-core 3.7 GHz 85,500
740 POWER7+ (1 or 2 socket) 6-core 4.2 GHz 49,000 12-core 4.2 GHz 91,700
8-core 3.6 GHz 56,300 16-core 3.6 GHz 106,500
8-core 4.2 GHz 64,500 16-core 4.2 GHz 120,000
720 POWER7+ (1 socket) 4-core 3.6 GHz 28,400 6-core 3.6 GHz 42,400 8-core 3.6 GHz 56,300
+40%
18© 2014 International Business Machines Corporation
rPerf (with SMT8)
S824 (1 or 2 socket) 6-core 3.8 GHz 120.8 12-core 3.8 GHz 235.6
8-core 4.1 GHz 166.0 16-core 4.1 GHz 323.6
12-core 1-socket not offered 24-core 3.5 GHz 421.8
S814 (1 socket) 4-core 3.0 GHz 66.9 6-core 3.0 GHz 97.5 8-core 3.7 GHz 143.9
S822 (1 or 2 socket) 6-core 3.8 GHz 120.8 12-core 3.8 GHz 235.6
10-core 3.4 GHz 177.8 20-core 3.4 GHz 346.7
20© 2014 International Business Machines Corporation
Processor Activation Features
S814 S824 S822 S812L S822L 8286-41A 8286-42A 8284-22A 8247-21L 8247-22L
Processor DCM
Charge activateNo-charge activate
#EPXK4c 3.02 GHz
#EPYK#EPZK
#EPXE6c 3.89 GHz
#EPYE-
#EPX16c 3.89 GHz
#EPY1-
#ELPD10c 3.42 GHz
--#ELAD
#ELPD10c 3.42 GHz
--#ELAD
Processor DCM
Charge activateNo-charge activate
#EPX06c 3.02 GHz
#EPY0#EPZ0
#EPXF8c 4.15 GHz
#EPYF-
#EPXD10c 3.42 GHz
#EPYD-
#ELP312c 3.02 GHz
--#ELA3
#ELP412c 3.02 GHz
--#ELA4
Processor DCM
Charge activateNo-charge activate
#EPX68c 3.72 GHZ
#EPY6#EPZ6
#EPXH12c 3.52 GHz
#EPYH-
100% of processor cores are activated. No-charge activations used with IBM i solution editions or with Linux-only models #2319 factory deconfiguration is supported.
New 10 June
21© 2014 International Business Machines Corporation
IBM i Solution Editions
Prices are USA suggested list prices and are subject to change without notice. Reseller prices may vary.
#4927
For qualified sales of new servers with participating ISVsMinimum size deal requiredRegistration/Approval of deal required prior to installation
6-core or 8-core Power 8S14• 5 no charge processor core activations • IBM i users @ only $70• 1 IBM Service voucher• Unlimited users for IBM i Access Family • Reduced price development tools
#49284-core Power 8S14• 3 no charge processor core activations • IBM i users @ only $70• 1 IBM Service voucher• Unlimited users for IBM i Access Family • Reduced price development tools
New 10 June
Same as for POWER7+
22© 2014 International Business Machines Corporation
CBU for i -- Power S814
Offering for IBM i HA/DR environments
PrerequisitesNew server order Primary server must be a POWER7 720, 740, 750 or
POWER8 S814, S824 with equal or higher IBM i software tier.
Must purchase minimum of one IBM i processor license entitlement for new CBU server
Registration of primary system and CBU is required prior to CBU order being manufactured
#0444Primary for 6/8-core (P10) = Power 720, 740, 750, S824 or S814 (a P10 or P20)-----------------------------------------Primary for 4-core (P05) = Power 720, S814 ( a P05 or P10 )
IBM i processor license entitlement
IBM i user entitlements
Offering AdvantagesTemporary transfer of unused IBM i
processor license entitlement from primary to CBU server
Temporary transfer of unused IBM i user license entitlements
Note: no lower-priced hardware or lower priced IBM i licensing – savings is in transferability. Can not transfer user entitlements from primary servers which have no user entitlements.
Temporary transfers
CBU Power S814
See S814 sales manual for more details
New 10 JuneSame as for POWER7+ except no POWER6 as primary
23© 2014 International Business Machines Corporation
Memory Card for 4-core Power S814
Card capacity: 16 GB … feature code #EM8B (no other memory features supported on 4-core)
Up to 4 Cards --- Max 64GB1600 MHzMemory Sparing - RAS improvement vs POWER7+Plugs into backplane (no riser card)
4-core usage announced 10 June
24© 2014 International Business Machines Corporation
4-core S814 Storage Backplanes
Op-panel
DVD
Backplanes provide High performance integrated SAS controller(s) built on IBM industry
leading PCIe Gen3 SAS adapter technology All include RAID 0, 1, 5, 6, 10. Plus hot spare capability Split backplane option with zero-write cache controllers
Make sure performance ok without write cache Easy Tier® function* (AIX/Linux)
10** SAS bays for 2.5-inch (SFF) HDD or SSD One DVD bay
* With dual IOA, expanded function backplane with write cache for AIX/LInux** Physically more SAS bays are present, but only 10 bays are supported
4-core announced 10 June with
full set of backplane features
25© 2014 International Business Machines Corporation
Availability plan: - eConfig 15 July- GA Sept
4-core S814: 4U Storage Backplane Options
Must select one
10* SFF SAS bays 1 SAS controllerNo write cache
RAID-0,1,5,6,10DVD bay
10* SFF SAS baysDual SAS controllers
7.2**GB cacheRAID-0,1,5,6,10
DVD bayEasy Tier function
BaseExpandedFunction *
5+5* SFF SAS bays2 SAS controllers
No write cacheRAID-0,1,5,6,10
DVD bay
Split
* Physically more than 10 SAS bays are present, but use of max of 10 are supported. Also note the split backplane could be split 6+4 in addition to 5+5. ** 1.8GB physical write cache provides up to 7.2GB effectively with compression
4U server
Stagedavailability
4-core announced 10 June
26© 2014 International Business Machines Corporation
S814 / S824
27© 2014 International Business Machines Corporation
PCIe Slots & Expanded Function Backplane for 4U
4U1S 4U 2S 4U
Total PCIe slots(all hot swap)
7 11Required* LAN adapter (available for client use) 1 1
PCIe slots after required* LAN adapter 6 10However if use high performance, expanded function backplane AND DECIDE NOT TO USE #EJ0Z
6 without EJ0Z 10 without EJ0Z
PCIe slots after required* LAN and if using high performance backplane 5 with EJ0Z 9 with EJ0Z
• PCIe slots are all Gen3 slots • 4U are all full high• There is no PCI expansion drawer announced. There is an SOD.
* required for IBM Manufacturing
July 2014 news: optional #EJ0Z
29© 2014 International Business Machines Corporation
General Scale-out
server info
30© 2014 International Business Machines Corporation
Additional Scale-out Server AIX Support
On August 29, 2014, AIX 7.1 Technology Level (TL) 1 Service Pack (SP) 10, or later, AIX 7.1 TL 2 SP 5, or later, AIX 6.1 TL 7 SP 10, or later, and AIX 6.1 TL 8 SP 5, or later, will extend support for the following IBM Power Systems:
IBM Power System S822 Server (8284-22A) IBM Power System S814 Server (8286-41A) IBM Power System S824 Server (8286-42A)
31© 2014 International Business Machines Corporation
Additional Scale-out Server VIOS Support
On August 29, 2014, VIOS 2.2.2.5, or later, and VIOS 2.2.1.9, or later will extend support for the following IBM Power Systems: IBM Power System S822 Server (8284-22A)IBM Power System S814 Server (8286-41A)IBM Power System S824 Server (8286-42A)IBM Power System S812L Server (8247-21L)IBM Power System S822L Server (8247-22L)
32© 2014 International Business Machines Corporation
SOD for PCIe3 Expansion Drawers
The following information is not publically announced and is shared only for sales planning purposes. If sharing with clients, it needs to be under non-disclosure
PCIe drawer for Scale-out server attachment is not planned for 2014 announce
A drawer will connect to server using two x16 PCIe slots
Note this future drawer is for PCIe slots. The POWER8 servers already have support for the EXP24S disk/SSD only drawer.
Unannounced and subject to change
Repeating information shared in April – no change
33© 2014 International Business Machines Corporation
Dual port 10GBase-T RJ45 ports - Ethernet NIC trafficPorts default to auto negotiate the highest speed:
10Gb (10GBaseT), 1Gb (1000BaseT) or 100Mb (100BaseT) full duplex.
Port's configuration are independent of the one other, but both ports owned by one partitions or one VIOS
CAT-6A cabling supported
NIM/Linux Install support announced July 2014 (planned GA 29 Aug)
PCIe2 2-port 10/1GbE BaseT RJ45 Adapter
Supported on POWER8 SystemsOperating System support:AIX 6.1 & AIX 7.1 or laterIBM i via VIOS Linux
RHEL 6 or laterSLES 11 or later
PowerKVM HostVIOS
#EN0W (FH) / #EN0X (LP)CCIN 2CC4
Only $950
Plus inexpensive cabling
Prices are USA list prices and are subject to change. Reseller prices may vary.
34© 2014 International Business Machines Corporation
PCIe2 4-Port (10Gb+1GbE) Copper SFP+RJ45 Adapter
#EN0V (FH) / #EN0U (LP)CCIN 2CC3
Supported on POWER8 SystemsOperating System support:AIX 6.1 & AIX 7.1 or laterIBM i via VIOS Linux
RHEL 6 or laterSLES 11 or later
PowerKVM HostVIOS
Quad ports: Two 10GbE Copper SFP+ optical Plus Two 1GbE RJ45 Ethernet NIC traffic10Gb Copper SFP+ ports does not include transceiver – transceivers provided with active twinax cables for up to 5m cable distance (Cables = #EN01, #EN02, #EN03)RJ45 are 1Gb or 100Mb and use CAT-5 or CAT-6A UTP cablingPort's configuration are independent of the one other, but all four ports owned by one partitions or one VIOS CAT-6A cabling supportedNIM/Linux install support announced July 2014 (planned GA 29 Aug)
Only $1200
Prices are USA list prices and are subject to change. Reseller prices may vary.
35© 2014 International Business Machines Corporation
PCIe2 4-Port (10Gb+1GbE) SR+RJ45 Adapter
#EN0S (FH) / #EN0T (LP)CCIN 2CC3
Supported on POWER8 SystemsOperating System support:AIX 6.1 & AIX 7.1 or laterIBM i via VIOS Linux
RHEL 6 or laterSLES 11 or later
PowerKVM HostVIOS
Quad ports: Two 10GbE SR optical Plus Two 1GbE RJ45 Ethernet NIC traffic10Gb SR ports include optical transceiver for up to 100m cable distance RJ45 are 1Gb or 100Mb and use CAT-5 or CAT-6A UTP cablingPort's configuration are independent of the one other, but all four ports owned by one partitions or one VIOS CAT-6A cabling supported
NIM/Linux Install support announced July 2014 (planned GA 29 Aug)
Only $1600
Prices are USA list prices and are subject to change. Reseller prices may vary.
SR transceivers not shown in picture, but would be included in
shipment
36© 2014 International Business Machines Corporation
AIX NIM and Linux Network Install Support 29 August
Lack of current function fixed with microcode change to the three adapters: PCIe2 2-port 10/1GbE BaseT RJ45 Adapter PCIe2 4-Port (10Gb+1GbE) Copper SFP+RJ45 Adapter PCIe2 4-Port (10Gb+1GbE) SR+RJ45 Adapter
Fix planned to be available 29 August 2014Newly shipped above adapters will have the fix loaded on the adapter by that time (end August).
Already shipped adapters will need to have the clients download the fix from IBM and apply to the adapter to gain the function
For PCIe2 4-Port (10Gb+1GbE) SR+RJ45 Adapter (#EN0S, #EN0T) and PCIe2 4-Port (10Gb+1GbE) SFP+ Copper+RJ45 Adapter (#EN0U, #EN0V) the latest level of adapter microcode, level 20100130, or later, is required.
For PCIe2 LP 2-port 10/1GbE BaseT RJ45 Adapter (#EN0W, #EN0X, and #EL3Z) the latest level of adapter microcode, level 30080130, or later is required.
For download: http://www-933.ibm.com/eserver/support/fixes/fixcentral
37© 2014 International Business Machines Corporation
Additional Config Option for “base” Ethernet
For Scale-out servers: Before July annc: Must include a 4-port 1Gb Ethernet Adapter (#5899 or #5260)
After July annc with 29 Aug 29 ship dates For AIX/Linux/VIOS: Must include either one 4-port 1Gb Ethernet adapter
(#5899/5260) or one 2-port 10/1Gb Ethernet adapter (#EN0W, #EN0X, #EL3Z) For IBM i: no change, must include a 4-port 1Gb Ethernet Adapter (#5899 or #5260) (#EN0W IBM i support through VIOS, can not be LAN console)
4-port 1Gb 2-port 10/1GbFeat code #5899, 5260 #EN0W, EN0X, EL3Z
NIC 1Gb 10GBase-T
speed 1Gb or 100Mb or 10Mb 10Gb or 1Gb or 100Mb
NIM, Linux install Yes Yes *
ports RJ45 RJ45
cabling CAT5/6 CAT6A
List price on S814/S822 $315 $950
USA list prices. Subject to change without notice. Reseller prices may vary.
* with latest fixes planned 29 August
38© 2014 International Business Machines Corporation
#5289/5290 2-port Async Adapter Update The above adapter was announced as supported in the April 2014
announcement. However in mid May, testing found a problem which requires the adapter to not be supported on POWER8 servers. (The problem is an adapter problem, but the problem fortunately does not occur when used in the POWER6/7/7+ servers or their I/O drawers.)
As a result we will not be shipping any POWER8 servers which have a #5289/5290 adapter in their configuration and we will be removing #5289/#5290 from the POWER8 product structure. eConfig will be updated as soon as possible, but as of today still shows these adapters as valid options.
If you have a POWER8 proposal which uses one of these adapters, you should re-run the configuration without the adapter. No change is required for POWER6/7/7+ servers.
We are working to replace #5289/5290 with a future similar product, but it’s not ready to announce as of June.
Interim to that future product, if you need async ports: For AIX/LInux ... The 4-port Async card #5785/#5277 is was announced/supported
on the POWER8 on 10 June. For IBM i ... The #2893/2894 communications adapter was always supported, but
was made orderable for the POWER8 server on 10 June. If IBM i 7.2, consider a WAN over LAN option.
As of 13 June
July announce:
#EN27/#EN28 2-port Async Adapter announced
Equivalent to #5289/5290 – same function, same everything
(except is supported on POWER8 servers)
#EN27/EN28 support not announced on POWER7/POWER7+
servers. Continue to use #5289/5290 on POWER7+ servers
39© 2014 International Business Machines Corporation
CNA = Converged Network Adapter Fibre Channel over Ethernet (FCoE) and NIC traffic simultaneously NIC = Network Interface Card “Like 3 cards in one” …
A 2-port 10Gb Ethernet NIC card A 2-port 8Gb Fibre Channel Card A 2-port 1Gb Ethernet NIC card Save by buying one card vs 2 or 3 cards – lower price
Save up 2 PCIe slots … 66% reduction !!!
4-port 10GbE CNA (NIC/FCoE) & 1GbE Adapter
#EN0M – full high#EN0N – low profile
2 ports 10GbE CNA
2 ports 1GbE NIC only
For POWER8 Scale-out server10Gb optical Fibre LR ports
New 15 July 2014Long Range optical fibre
Very similar to#EN0H/EN0J/EL3B – optical SR#EN0K/EN0L/EL3C – copper twinax
LR = long range optical fiberUp to 10 km (NIC)
Not announced on POWER7+ serversMax 300m if using FCoETransceiver included in #EN0M/EN0N
40© 2014 International Business Machines Corporation
POWER8 PCIe Adapters Adds: June 2014
June AdditionsCommunications 2-port Async/Bisync (IBM i) #2893, #2894 Add orderableCommunications 4-port Async (AIX / Linux) #5277, #5785 Add support & order
Graphics 3D graphics for RHEL7 #EC42, #EC41 Linux REH7 only
41© 2014 International Business Machines Corporation
POWER8 PCIe Adapters Adds: July 2014
July AdditionsEthernet NIC 2-port 1GbE RJ45 #5767, #5281Ethernet NIC 2-port 1GbE SX optical #5768, #5274Ethernet NIC 4-port 1Gbe RJ45 #5717, #5271Ethernet NIC 1-port 10GbE SR optical #5769, #5275 Ethernet NIC & FCoE 2-port 10GbE SR optical #5708, #5270Ethernet NIC & FCoE 4-port 10GbE+1GbE Copper Twinax+RJ45 #EN0K, #EN0L, #EL3CEthernet NIC & FCoE 4-port 10GbE+1GbE LR+RJ45 #EN0M, #EN0N NEW adapter
Ethernet NIC & RoCE 2-port 10GbE Copper twinax #EC28, #EC27, #EL27
Fibre Channel 2-port 4Gb #5774, #5276, #EL09
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5805 Add support onlySAS RAID 3-port large cache PCIe2 HDD/SSD #5913 Add support onlySAS RAID 3-port large cache PCIe2 HDD/SSD #ESA3 Add support only
Communications 2-port Async (AIX / IBM i / Linux ) #EN27, #EN28 NEWReplace 5289/5290
42© 2014 International Business Machines Corporation
POWER8 PCIe Adapters Adds: June/July 2014
June AdditionsCommunications 2-port Async/Bisync (IBM i) #2893, #2894 Add orderableCommunications 4-port Async (AIX / Linux) #5277, #5785 Add support & order
Graphics 3D graphics for RHEL7 #EC42, #EC41 Linux REH7 only
July AdditionsEthernet NIC 2-port 1GbE RJ45 #5767, #5281Ethernet NIC 2-port 1GbE SX optical #5768, #5274Ethernet NIC 4-port 1Gbe RJ45 #5717, #5271Ethernet NIC 1-port 10GbE SR optical #5769, #5275 Ethernet NIC & FCoE 2-port 10GbE SR optical #5708, #5270Ethernet NIC & FCoE 4-port 10GbE+1GbE Copper Twinax+RJ45 #EN0K, #EN0L, #EL3CEthernet NIC & FCoE 4-port 10GbE+1GbE LR+RJ45 #EN0M, #EN0N NEW adapter
Ethernet NIC & RoCE 2-port 10GbE Copper twinax #EC28, #EC27, #EL27
Fibre Channel 2-port 4Gb #5774, #5276, #EL09
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5805 Add support onlySAS RAID 3-port large cache PCIe2 HDD/SSD #5913 Add support onlySAS RAID 3-port large cache PCIe2 HDD/SSD #ESA3 Add support only
Communications 2-port Async (AIX / IBM i / Linux ) #EN27, #EN28 NEWReplace 5289/5290
43© 2014 International Business Machines Corporation
POWER8 PCIe Adapters as of July (page 1)
Ethernet NIC 4-port 1GbE RJ45 #5899, #5260Ethernet NIC 2-port 10GbE 10GBase-T RJ45 #EN0W, #EN0X, #EL3ZEthernet NIC & FCoE (CNA) 4-port 10GbE+1GbE SR+RJ45 #EN0H, #EN0J, #EL3BEthernet NIC 4-port 10GbE+1GbE SR optical #EN0S, #EN0TEthernet NIC 4-port 10GbE+1GbE Copper twinax #EN0U, #EN0VEthernet NIC & RoCE 2-port 10GbE SR optical #EC29, #EC30, #EL2ZEthernet NIC 2-port 10GbE SR optical iSCSI TOE #5744, #5280Ethernet NIC 2-port 10GbE SR optical #5284, #5287, #EL2PEthernet NIC 1-port 10GbE LR optical (IBM i native) #5772Ethernet NIC & OpenOnload 2-port 10GbE Copper twinax #EL39, #EC2J, #EC2GEthernet NIC & RoCE 2-port 40GbE QSFP+ #EC3A, #EC3B
Ethernet NIC 2-port 1GbE RJ45 #5767, #5281Ethernet NIC 2-port 1GbE SX optical #5768, #5274Ethernet NIC 4-port 1Gbe RJ45 #5717, #5271Ethernet NIC 1-port 10GbE SR optical #5769, #5275 Ethernet NIC & FCoE 2-port 10GbE SR optical #5708, #5270Ethernet NIC & FCoE 4-port 10GbE+1GbE Copper Twinax+RJ45 #EN0K, #EN0L, #EL3CEthernet NIC & FCoE 4-port 10GbE+1GbE LR+RJ45 #EN0M, #EN0NEthernet NIC & RoCE 2-port 10GbE Copper twinax #EC28, #EC27, #EL27
w/ NIM
w/ NIM
w/ NIM
* Late change to drop. See details in following chart
Jul
44© 2014 International Business Machines Corporation
POWER8 PCIe Adapters as of July (page 2)
Fibre Channel 2-port 8Gb #5735, #5273, #EL2NFibre Channel 4-port 8Gb (FH) #5729Fibre Channel 4-port 8Gb (LP) #EN0YFibre Channel 2-port 16Gb #EN0A, #EN0B
Fibre Channel 2-port 4Gb #5774, #5276, #EL09
Communications 1-port Bisync (IBM i) #EN13, #EN14Communications 2-port Async/Bisync (IBM i) #2893, #2894Communications 4-port Async (AIX / Linux) #5277, #5785
Communications 2-port Async RS232 5289/5290 replace #EN27, #EN28
SAS RAID 4-port no-cache PCIe3 for SSD/HDD #EJ0J, #EJ0M, #EL3BSAS Tape/DVD 4-port tape/DVD PCIe3 #EJ10, #EJ11, #EL60SAS RAID 4-port huge-cache PCIe3 for SSD/HDD #EJ0LSAS RAID/Tape/DVD 2-port no-cache PCIe1 for HDD #5901, #5278, #EL10
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5805SAS RAID 3-port large cache PCIe2 HDD/SSD #5913SAS RAID 3-port large cache PCIe2 HDD/SSD #ESA3
Jun
Jul
Jul
Jul
45© 2014 International Business Machines Corporation
POWER8 PCIe Adapters as of July (page 3)
Infiniband (IB) 2-port QDR IB SR optical #5285, #5283
Graphics 2D graphics for general use #5748, #5269Graphics 3D graphics for RHEL7 #EC42, #EC41
Encryption Crypto Coprocessor 4765-001 #4807
USB 4-port USB-3 #EC45, #EC46
Programmable FPGA PCIe3 FPGA Accelerator #EJ12, #EJ13
Jun
46© 2014 International Business Machines Corporation
PCIe Adapters NOT Supported: July 2014
Ethernet NIC 2-port 10GbE copper twinax #5288, #5286 old
Ethernet NIC 1-port 10GbE CX4 #5732, #5272 Old
Ethernet NIC 4-port 10GbE+1GbE Copper twinax+ RJ45 #5745, #5279 Old
Ethernet NIC 2-port 10GbE Copper twinax #EL3A, #EC2K, #EC2H Use OpenOnload
Fibre Channel 1-port 4Gb #5773 Old, use 8Gb or if must, use 2-port 4Gb
Communications 2-port Async RS232 5/2014 add to list #5289, #5290 Use EN27/EN28
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5903 Use PCIe3, or use #59805 if you must
SAS RAID 2-port zero cache PCIe2 SSD #ESA1, #ESA2, #EL2K Use PCIe3 EJ0J/M
USB 4-port USB-2 #2728 Old, use USB-3
SSD on PCIe card 4-slot 1.8-inch SSD on SAS adapter #2053, #2054, 2055 Use controller in storage backplaneFlash on card Flash Adapter 90 #ES09
Much shorter list of “not supported” adapters now
48© 2014 International Business Machines Corporation
Integrated Ports on the System UnitNo port feature codes (except 4U SAS ports) 4U 2U
USB-3 with full client usage2 front2 rear
2 front,2 rear
USB-2 primarily IBM use, limited client use supported*. Ports off Service Processor card 2* rear 2 rear
HMC ports - 1Gb Ethernet RJ45 2 rear 2 rearSerial / System port - RJ45 ** 1 rear 1 rear2 SAS ports with high performance, dual IOA controller storage backplane on 2-socket servers – can attach one EXP24S drawer
2 rearMandatory #EJ0Z
feature. Ports take a PCIe slot
2 rearNo feat code. Ports do not take a PCIe
slot
* For IBM i Unlike POWER7 or POWER6, IBM i communication to UPS is NOT via the serial port on POWER8 server. POWER8 connection to UPS for IBM i is over the USB-2 ports off the service processor card. A converter cable #ECCF should be used to convert USB port to 9-pin D-Shell connector which can be connected to the UPS cable. The cable can be attached after the server is powered up and running. Once the cable is plugged in, the service processor to which the USB-2 ports are attached senses the cable and its integrated cable type ID information and then sets the USB-2 port up for UPS communications.
** For AIX/Linux For attaching serial devices like a Async console which doesn’t have a RJ45 interface. Just like on POWER7/POWER7+, use #3930 converter cable to provide a 9-pin D-Shell connector.
Depending on country, #ECCF availability varies
49© 2014 International Business Machines Corporation
ECCF Cable Details
Late breaking news in late May 2014. Testing/approvals by different certification organizations around the world for the #ECCF cable didl not support a 10 June 2014 GA. Functionally the cable has been tested and is ready for GA. However, cables have to be approved by different organizations with different standards around the world. We project to have certifications/approvals in place for this cable on the following schedule.
18 June Canada/USA 25 June Australia/Japan 9 July European Union 16 July remainder of the world except Korea/Taiwan 6 Aug Korea/TaiwanThe above projections are our current best estimates and are subject to change.
The UPS communication does NOT impact the ability of a 9910 UPS to provide power to the server. But the cable allows status information to be provided to the , the server, alerting it to the fact its electrical power is coming from a UPS. Assuming you‘ve set up your server to do so, it can more gracefully shut down if the UPS batteries are running out before regular power sources are restored. This is the only UPS communication mechanism for IBM i. AIX/Linux can alternatively implement an Ethernet-based option where UPS-provided appliction code runs on the server and talks to the UPS.
The cable can be attached without booting the server.
52© 2014 International Business Machines Corporation
POWER7+EXP30 Ultra
Drawer
53© 2014 International Business Machines Corporation
SSD Refreshed in EXP30 Ultra Drawer
New 1.8-inch SSD feature codes: #ES0J/ES0K and #ESRJ/ESRKNew CCIN 59BESame 387GB capacity as existing SSD featuresNewer eMLC3 technology, a little faster than eMLC2 SSD (#ES02/ES04) Almost 20% LOWER LIST PRICE than eMLC2 1.8-inch SSD
Can intermix eMLC2 and eMLC3 SSD in the same EXP30 drawer (#EDR1 or #5888) and can mix in the same array
Differs physically from previous features. New features require a carrier #EB2W to fit into EXP30 bay. Each SSD needs one carrier. Six pack SSD features need six #EB2W. Previous SSD included a carrier already
NOT used in POWER8 servers
June 10 annc
54© 2014 International Business Machines Corporation
Reminder:the April 30th hardware deepdive pitch on
Scale-out servers and other April content has been updated w/ fixes & add’l content. Do you have the “update4” version?
Posted on SSI / PartnerWorld IBMers: http://w3.ibm.com/sales/support/ShowDoc.wss?
docid=SGDF097039N48949N97&node=brands,B5000|brands,B5Y00|clientset,IA (http://w3.ibm.com/sales/support/ShowDoc.wss?docid=SGDF097039N48949N97&node=brands,B5000%7Cbrands,B5Y00%7Cclientset,IA)
IBM Business Partners: http://www.ibm.com/partnerworld/wps/servlet/ContentHandler/SGDF097039N48949N97
55© 2014 International Business Machines Corporation
Thanks !
Corsa and FPGA Overview
Robert SherwoodProduct Offering Manager, IBM
Corsa 5 A7 Altera Stratix V PCIE Gen 3 card Supports both PCIe I/O & CAPI models Initial offering with Z gzip use case for JAVA Dual 10 GB (lower latency internal PHY)
Not currently supported on Power 8 GB DDR3 1600 SDRAM Full Card Level RAS Partial Reconfiguration
Attributes FPGA base accelerator card PCIe gen3 x8, ranges between 25W & 40W depending on application
~21W for gzip application Follows Altera Stratix roadmap
PCIe base I/O adaptor JAVA 7.1 gzip acceleration use case Single root I/O virtualization, 15 virtual functions
Future support for Power Server CAPI Coherent Accelerator Processor Interface
OS Support AIX 7.1
Software/Firmware Support eFW 8.1
RAS Evaluation in progress of existing device driver features
This application not reprogammable by customers
Energy Efficiency / Power Management FPGA thermals are use-case dependent
Certifications FCC Class A Environmental Support TBD (pending compliance test) Acoustic Category – TBD (pending thermal eval)
Corsa PCI-E FPGA JAVA gzip adapter
PoC Ready May 2013, general use caseTransparent zlib HW acceleration integrated into JAVA 7.1Driving PCIe Tuleta AIX attach 2Q14 JAVA use caseFuture RPQ: Driving PCIe Tuleta RHEL 6.6 attach JAVA use case
© 2014 International Business Machines Corporation 62
CustomHardware
Application
POWER8
CAPP
Coherence Bus
PSL
FPGA or ASIC
Customizable HardwareApplication Accelerator • Specific system SW, middleware, or user application• Written to durable interface provided by PSL
POWER8
PCIe Gen 3Transport for encapsulated messages
Processor Service Layer (PSL)• Present robust, durable interfaces to applications• Offload complexity / content from CAPP
Virtual Addressing• Accelerator can work with same memory addresses that the
processors use• Pointers de-referenced same as the host application• Removes OS & device driver overhead
Hardware Managed Cache Coherence• Enables the accelerator to participate in “Locks” as a normal
thread Lowers Latency over IO communication model
POWER8 CAPI (Coherent Accelerator Processor Interface)
© 2014 International Business Machines Corporation 63
© 2014 International Business Machines Corporation 64
Processor Enablement
CAPP
PCIe
Power Processor
CAPI overPCIe
Coherently AttachedDevice
Coherent Attached Processor Proxy (CAPP) in processor– Unit on processor that extends coherency to an attached device– On processor directory responds on behalf of off-chip device
(Filtering snoops)
Coherency protocol tunneled over standard PCIe– Eliminates the need for special I/Os and protocol logic
• CAPI utilizes standard Posted Write and Non-posted Reads– Reduces the complexity and bandwidth requirements of the
attached device
Enables attached device to be a peer to the processor– Simplifies programming model between application– Enables device to use same effective address as application
running in processor– Eliminates the cumbersome I/O Device Driver requirements
• Pinned memory not required
Coherent Accelerator Processor Interface (CAPI) Overview
CAPP PCIe
Power Processor
FPGA
Function n
Function 0
Function 1
Function 2
CAPI
IBM Supplied POWER Service Layer
Typical I/O Model Flow
Flow with a Coherent ModelShared Mem.
Notify Accelerator Acceleration Shared MemoryCompletion
DD Call Copy or PinSource Data
MMIO NotifyAccelerator Acceleration Poll / Int
CompletionCopy or Unpin
Result DataRet. From DDCompletion
Advantages of Coherent Attachment Over I/O Attachment
Virtual Addressing & Data Caching– Shared Memory– Lower latency for highly referenced data
Easier, More Natural Programming Model– Traditional thread level programming– Long latency of I/O typically requires
restructuring of application
Enables Applications Not Possible on I/O– Pointer chasing, etc…
Actual feature(s)
Interface logic
© 2014 International Business Machines Corporation 65
IBM PowerLinux FPGA Development Kit (RPQ 8A2158)
• Provides a platform which allows programmers to develop OpenCL code which targets IBM PowerLinux processors and accelerator cards with Altera FPGAs
• Utilizes the Nallatech “Power OpenCL Development Kit” PN: P385-A72-SYSP-01 with an IBM PowerLinux 7R2.
• The Nallatech Power OpenCL Development Kit includes - PCIe-385 Card PN: P385-A72-0813P-81 w/CCR (A7 Card) - USB Blaster II (UB2) Development and debug Card PN NT101-0563-03 - Altera Quartus II DKE License - Altera OpenCL SDK - Altera provided Power Linux device driver
• The IBM PowerLinux FPGA Development Kit also includes 8 hours of on site IBM Lab Services expertise
• The kit requires a separate purchase of an IBM PowerLinux 7R2 server (8246-L2D with 4.2GHz processors)
• To order the IBM PowerLinux FPGA Development Kit– Order the PowerLinux 7R2– Order and Apply RPQ 8A2158 to the PowerLinux 7R2– Order the Nallatech Power OpenCL Development Kit directly from Nallatech– Call IBM Lab Services to schedule installation and set up.
© 2014 International Business Machines Corporation 66
© 2014 International Business Machines Corporation 67
IBM GZIP Acceleration Adapter (EJ13)
• Corsa card with GZIP compression/decompression
• Useful for customers running workloads which require frequent GZIP compression and decompression such as WebSphere
• Customers running JAVA/Util/GZIP will also see significant performance improvements
• Feature is particularly effective for workloads requiring transfer of large buffers
• Utilizing this adapter can reduce both the storage requirements and congestion in a customer’s environment
68© 2014 International Business Machines Corporation 68
Field-Programmable Gate Arrays (FPGAs)
Hardware-back Java compression APIs
Work sent to custom card firmware rather than the CPU.
Not only does it run faster on the card, but it frees up the CPU to do other things.
Benchmarking Liberty Power Linux shows high performance extensible log (HPEL) engine writes compressed logs as quick as uncompressed
© 2014 International Business Machines Corporation 69
© 2014 International Business Machines Corporation
Store your Data - Power Data Compression and IBM Java 7R1
** IDC: The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East
With IBM Java 7R1 :Java application to compress files using java.util.zip.GZIPOutputStream classUp to 91% reduction in CPU time using zEDC hardware versus zlib softwareUp to 74% reduction in Elapsed time (not shown)Compression ratio up-to ~5x
Every day over 2000 petabytes of data are created Between 2005 to 2020, the digital universe will grow by 300x, going from 130 to 40,000 exa-bytes** 80% of world's data was created in last two years alone
(Controlled measurement environment, results may vary)
What is it? zEDC Express is an IO
adapter that does high performance industry standard compression
Applications can use zEDC via industry standard APIs (zlib and Java)
Raw throughput up to 1 GB/s per zEDC Express Hardware Adapter
CPU Time for Software versus zEDC Hardware CompressionUsing - java.util.zip.GZIPOutputStream Class
-
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,000
Public Domain Books SVC Dump SMF Data
Compressed Data Files
CPU
Tim
e zlib Software
zEDC Hardware
Size of Compressed Data - Software versus zEDC HardwareUsing - java.util.zip.GZIPOutputStream Class
-
20
40
60
80
100
120
Public Domain Books SVC Dump SMF Data
Compressed Data FilesFi
le S
ize
in M
ega
Byt
es Input File Size
zlib Software
zEDC Hardware
HW Exploit of FPGA Compression on POWER
70
IBM RackswitchesMTM Transitions
Pramodh MallipatnaNetworking Products
7272
SND Switch OEM-out to Power - MTM Transitions
Name MTM Current MTM New
IBM RackSwitch G8264 1455-64C 7120-64C
IBM RackSwitch G8124E 1455-24E 7120-24E
IBM RackSwitch G8052 1455-48E 7120-48E
IBM RackSwitch G7028 1455-24L 7120-24L
IBM RackSwitch G8264T 1455-48T 7120-48T
IBM RackSwitch G8264CS 1455-64F 7120-64F
IBM RackSwitch G8316 1611-16E 7120-16E
7 current MTMs will be withdrawn from Power WTAAS; Announced 05/13 with Effective Date 07/31.7 MTMs will be re-introduced in 2 stages.
• Stage 1: 4 MTMs to be re-released. • G8264, G8124W, G8052, G7028 - Announce 08/12; GA 09/01
• Stage 2: 3 MTMs to be re-released• G8264T, G8264CS, G8316 - Announce & GA TBD (GCOIM align).
© 2014 International Business Machines Corporation 72
73
Thank You
MerciGrazie
GraciasObrigadoDanke
Japanese
English
French
Russian
GermanItalian
Spanish
Brazilian PortugueseArabic
Traditional Chinese
Simplified Chinese
Hindi
Tamil
Thai
Korean
© 2014 International Business Machines Corporation