software development at sap labs korea - snummlab.snu.ac.kr/courses/2014_fall_seminar/snu ce... ·...
TRANSCRIPT
2© 2014 SAP SE or an SAP affiliate company. All rights reserved.
WHO IS SAP
SAP is the first global software companyfounded in 1972
Market leader in enterprise SW (ERP,Planning, in-Memory Computing, …)67,000+ Employees Globally
3© 2014 SAP SE or an SAP affiliate company. All rights reserved.
Who is SAP? Mobile First, Cloud, Open Planform
Live KPIs and Summaries, Connected to PreciseDetails, In a Collaborative User Experience
SAP HANA Platform
Applications Analytics
Simplified User Experience
Suppress the Noise. Focus on the Key Factors.
4© 2014 SAP SE or an SAP affiliate company. All rights reserved.
SAP Business Applications and Analytics
Sales OrderManagement
Production Planning Talent Management
Financial/MgmtAccounting
BusinessIntelligence
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 5Internal
:20 x 36 720 (72 billion)
100B 7.2 TB (= 72 billion x 100B)
?
– (filtering)– (grouping)– (aggregation)7.2TB HDD , 2(7,200GB / 1GB/s = 7,200s)7.2TB DRAM , 4(7,200GB / 15GB/s / 2 channels = 240s)
http://www.scottlogic.com/blog/2014/03/20/app-store-analysis.html
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 6Internal
Hardware Advances: Moore’s Law – Supercomputer
Moore’s Law: HW Power 10 100
(SGI)12TB Memory + 1024 processors 24TB Memory + 960 processing cores
2003 2013
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 7Internal
Hardware Advances: Moore’s Law – DRAM
Year Price/GB2013 $5.502010 $12.372005 $1892000 $1,1071995 $30,8751990 $103,8801985 $859,3751980 $6,328,125
Source: http://www.statisticbrain.com/average-historic-price-of-ram/
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 8Internal
Hardware Advances: Servers for In-Memory Computing
HANA Server Box (2013)Blade Box (2007)
4 x 10-core CPU, 2TB DRAM(32GB DIMM x 8 x 2 channels/cpu x 4 cpu)
2 x 4-core CPU, 32GB DRAM(4GB DIMM x 4 x 2 memory channels/system)
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 9Internal
Software Advances: Build for In-Memory ComputingReduce Memory Access Stalls
In-Memory Computing: It is all data-structures (not just tables)Parallelism: Take advantage of tens, hundreds of coresData Locality: On-chip cache awareness
Using Intel Ivy Bridge for approximate values.Actual numbers depend on specific hardware.
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 10Internal
Order Store … Sales456 France … 1.99457 Italy … 4.99458 Italy … 9.99459 Spain … 0.99
In-Memory Computing – Columnar Data Structures
456 France … 1.99
457 Italy … 4.99
458 Italy … 9.99
459 Spain … 0.99
456457458459
FranceItalyItaly
Spain
...
...……
1.994.999.990.99
Typical Database
SAP HANA: column order
SELECT Country, SUM(sales) FROM SalesOrdersWHERE Product = ‘corn’GROUP BY Country
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 11Internal
SAP HANA: Dictionary Compression
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 12Internal
Col C2500
2178675
3432423
12356743
3425644523523
3665364
134341433129089
89089562356
processed by Core 3
Core 4processed by
Col B4545
766347264
4353434
3424553333333
87894523523
78787
1252
Col A1000032
678678682345
89886757234123
234234378787
999999313427777
454544711
21
Core 1 Core 2
proc
esse
dby
proc
esse
dby
676731223423123123123 789976
12122009
200022346098
SAP HANA: Multi-Core Parallelization
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 13Internal
HANA Development Process
Make & Test Farm
…
Engine Developer
Central Code
HANA
~2,000 builds a day
~85,000 test suite executions a day (> 350,000regression test cases are grouped into ~900 test suites)
~1,000 servers with 40 cores and 1TB memory
Check out
Merge a change
Submit a change
Workstation
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 14Internal
Development Tools
Git, Gerrit, Jenkins, BugZilla, Jira, …Static Code Analysis: Coverity, ConQAT, …Performance ProfilingCode Coverage
© 2014 SAP SE or an SAP affiliate company. All rights reserved. 17Internal
One Global HANA Platform Team