con10850_potapov-con10850-real-time analytics for oracle business intelligence with intel...

Upload: sbabuind

Post on 06-Jul-2018

222 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    1/31

    Real-Time Analytfor Oracle BusineIntelligence with

    Intel TechnologieNikolai Potapov – !T"# Oracle orporationynthia $eng - "oftware %ngineer# Intel orporation &'()*()'&+

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    2/31

    "afe ,aror "tatement The following is inten.e. to outline our general pro.uct .irection/ It ifor information purposes only# an. may not e incorporate. into any is not a commitment to .eliver any material# co.e# or functionality# anot e relie. upon in making purchasing .ecisions/ The .evelopmentan. timing of any features or functionality .escrie. for Oracle0s pro

    remains at the sole .iscretion of Oracle/

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    3/31

    Agen.a

    BI Analytics an. role of In-memory .at

    %ngineere. "ystems in Analytics

    One In-memory %ngineere. "ystem ev

    "ummary

    1

    2

    3

    4

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    4/31

     Technology ,ighlights

    Oracle

    %1alytics

    In-memory !O2AP.ataase %ssase

    Intel

    N3! %1press ""4s

    5eon

    3tune

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    5/31

    Achievements

    In-memory software

    "caling to all availale ores 789

    2ighting fast internal IO on N3!-e $lash ""4s

    4ramatically improve. remote IO y utili:ing !!AP

    !achine e;ually goo. for serial calculation as for massworkloa.s y using "uper-"

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    6/31

    Agen.a

    BI Analytics an. role of In-memory .at

    %ngineere. "ystems in Analytics

    One In-memory %ngineere. "ystem ev

    "ummary

    1

    2

    3

    4

    • 4ata in era of IoT

    • Real-time Analytics nee.s In-memory

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    7/31

    MORE DATA Analytics

    Data in era of IoT?

    IoT era iscoming:

    • 9 ln internet!e"ices in

    2#12

    • $# ln y2#2#• 9#% !ata

    create! inlast 2 years

    • $#& gro't(

    y 2#2#

    )ee!meaningf*l

    DATA insig(t

    • +3## lnestimate!

    re"en*e for IoT,ro!*cts an!ser"ices y

    2#2#-./

    0oso

    InMsoft

    reAn

    Engsystems,eci

    An'o

    8 >artner# press release '?(&@()'&6# >artner"ays the Internet of Things ill Transformthe 4ata enterC

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    8/31

    Real-time Analytics nee.s In-memory

    Active"paces Aerospike A2TIBA"% ,4B A2TIBA"Apache >eo.e Big!emory .ash4B 4atalit:7formerly 4ali9 4B) B2= 4B) for i %hcache %5Ae5treme4B $uel4B >em$ire >em$ire 54 >P=.,) 74B!"9 ,a:elcast Informi1arehouse AcceIn!emory/Net

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    9/31

    Agen.a

    BI Analytics an. role of In-memory .at

    %ngineere. "ystems in Analytics

    One In-memory %ngineere. "ystem ev

    "ummary

    1

    2

    3

    4

    • iPhoneC for %nterprises

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    10/31

    %ngineere. "ystems in Analytics

    8*t 8om,leity 8*t 8osts ;et Etreme 0erformance

    OracleGs engineere. systems simplify IT operations an. lowecosts with e1treme performanceHaccelerate. .eploymentsspee. processing# an. lightning-fast analytics/

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    11/31

    Agen.a

    BI Analytics an. role of In-memory .at

    %ngineere. "ystems in Analytics

    One In-memory %ngineere. "ystem ev•%1alytics•5eon•N3! %1press ""4•"uper-"

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    12/31

    %1alytics 5+-6ps %thernet

    =oft'areBI Analytics ,latform

    Oracle BI $oun.ation "uiteOracle %nterprise Performance !anagement

    InMemoryOBI%% In-!emory Acceleration an. a.vance. In-!emory capailities%ssase ,ar.ware "pecic Acceleration an. In-!emory oIn-!emory 4ata achingBI Pulisher Accelerator

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    13/31

    %1alytics evolution

    5)-65?-6

    56-6

    1 TB RAM

    4 Intel® Xeon® E7-487040 physical cores total

    3! TBs o" ra# $is% capacity40 &'ps In"iniBan$ ( ) ports

    10 &'ps Ethernet ( ) ports

    1 &'ps Ethernet ( 4 ports

    2 TB RAM

    4 Intel® Xeon® E7-4870

    40 physical cores total

    2.4TB PCI Flash5.4 TBs of raw disk capacity

    40 &'ps In"iniBan$ ( ) ports

    10 &'ps Ethernet ( ) ports

    1 &'ps Ethernet ( 4 ports

    2 TB DRAM

    4 Intl! "on! #$%&&'5 (2

    )* physical cors total

    2.4TB PCI Flash

    $.2 TBs of raw disk capacity

    40 &'ps In"iniBan$ ( ) ports

    10 &'ps Ethernet- 4 ports

    > 1TB RAM> 254 TB 08Ilas(> igger !iss

    > =*,er=@ 80> e"en igger!iss> e"en more RAM

    5+-6

    + TB DRAM

    4 Intl! "on! #$%&&'5

    $2 physical cors total

    4.&TB PCI Flash

    $.2 TBs of raw disk cap

    40 &'ps In"iniBan$ ( ) p

    10 &'ps Ethernet- 4 por

    > =*,er=@ > e"en iggelas(> e"en more

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    14/31

    %1alytics 5+-6 vs/ 56-6 vs/ 5)-6

    aster5 Bigger

    8a,acity

     Ne1t %1alytics generation isfaster then previous one

     Ne1t %1alytics generation hasigger capacity an. can han.lemore users than previous one

    -./ MD& calc*lation 'orloa!8leane! *, aggregates "ie's=er"erT(rea!sn*mer of ,(ysical 8ores=ame Essase 115152545 release

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    15/31

    5eon – generation to generation reakt

    DuickPath Interconnect 7DPI9 provi.es fast

    point-to-point processor connect

    Improve. processor technologyL

      5eon %K family ?)nm -M ))nm

    Increase. memory capacity an.with

    Increasing numer of cores per socket

    Increase. cache si:e

    C0I"151

          ,  C

          ,  C "on

    &4DMI2

       0   8   I  e   .

       3

       #

    08Ie.

    35#

    ?) P?/' (&4DMI2

          ,  C

          ,  C

          ,  C

          ,  C

          ,  C

          ,  C "on

     4x JordanCreek

    memoryexpansion

     per socket 

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    16/31

    N3!

    • N3!e ""4 onnects .irectlyto PIe with ?)>B(s an.withv/s/ &)>B(s with a tra.itional"A"-? ""4

    • Intel ""4 ase. car. oastsse;uential rea.s of )+''

    !B(s an. writes of &+'' !B(swhile the IOP" performance israte. at 66'< Rea. an. K'<write 6

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    17/31

    "uper-"

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    18/31

    "uper-",: ?/66 >,:.. test K'?/FK *)@/&& K6/K* &&/FF

    $re;uency )/@K >,: ?/66 >,:c ase. enchmarkL echo G)'Q)Q)'G time -f S= =ser# SP P= (usr(in(cM (.ev(null.c ase. enchmarkL nohup .. count&@@@@@@@F' if(.ev(:ero of(.ev(null

    turostatC package – to monitor P= ores fre;uency

    U of Turo Active ores

    &-* K-F @-&)

    &?-&6

    &+-&F

    !a1 Turo $re;uency#>,:

    ?/+ ?/6 ?/? ?/) ?/'

     

    1

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    19/31

    3tune proling/ "tu.y U&

    &' )' ?' 6' +'

    '/''

    &'/''

    )'/''

    ?'/''

    6'/''

    +'/''

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    20/31

    3tune proling/ "tu.y U&

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    21/31

    3tune proling/ "tu.y U&

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    22/31

    3tune proling/ "tu.y U&

    $#%

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    23/31

    %ssase B"O committe. mo.e

    • committe. mo.e is use. to ensure AI4 7Atomicity# onsistency# Isolatio

    • 3tune prole showing ottleneck on single usy threa. while other threa.con.itional variale which was signale. every three secon.s

    3tune proling/ "tu.y U)

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    24/31

    %ssase B"O committe. mo.e

    • Removing ottleneck re.uces single le loa.ing time from 294# minutes secon.s

    • Improve. concurrency from one single usy threa.s to more threa.s with loa.

    3tune proling/ "tu.y U)

    #

    "uect to

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    25/31

    !!AP# ackgroun. writing

    • !!AP

    !emory-mappe. les feature is anotherstep to make fully in-memory pro.uct yastracting IO level completely fromcalculation engine/ It0s especially enecialfor .eployments involving slow storageoptions such as remote storage connecte.via N$"

    • Backgroun. 4B writer

    3#

    789 in some cases 4isk an. remote storage performanceRA!

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    26/31

    lou. rea.iness

    •AI4 har.ening# committe. mo.e/

     Tra.itionally %ssase .ataase was use. y nancial applications usage rulesC were often guarantee. y application logic an. notre;uestsC were not e1pecte./ Opening .ataase to wi.er au.itoryhar.ening important task an. committe. mo.e is a goo. step in t

    •Remote storage improvements

    !any clou. .eployments are ase. on separation of compute 7P

    an. storage/ Therefore achieve. remote storage improvements arsuch .eployments/

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    27/31

    Agen.a

    BI Analytics an. role of In-memory .at

    %ngineere. "ystems in Analytics

    One In-memory %ngineere. "ystem ev

    "ummary

    1

    2

    3

    4

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    28/31

    "ummary

     In-memory software makes real-time analytics possile with the ai. fa.vance. har.ware technology inclu.ing powerful P=# lighting fast stoincrease. memory capacity

     The close integration of Oracle %1alytics In-memory software an. har.software optimi:ation through eWective proling tools like Intel 3tune enperformance

    Intel an. Oracle collaoration working on improving Oracle %1alytics pprove. to e very successful an. contriute. to overall improve. e1perOracle BI customers

    Nee. more info on %1alyticsXheck out httpsL((www/oracle/com(engineere.-systems(e1alytics(in.e1/html

     Thank youY

    Intel > Oracle.

     8ollaoration HinHin f

    https://www.oracle.com/engineered-systems/exalytics/index.htmlhttps://www.oracle.com/engineered-systems/exalytics/index.htmlhttps://www.oracle.com/engineered-systems/exalytics/index.html

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    29/31

    "afe ,aror "tatement The following is inten.e. to outline our general pro.uct .irection/ It ifor information purposes only# an. may not e incorporate. into any is not a commitment to .eliver any material# co.e# or functionality# anot e relie. upon in making purchasing .ecisions/ The .evelopmentan. timing of any features or functionality .escrie. for Oracle0s pro

    remains at the sole .iscretion of Oracle/

    O h h i l " i

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    30/31

    Other Technical "essionsfrom Oracle P"R group

      4ON%

     =ession

    ID

    Title Day Tim

    ON@?6) %1treme "calaility with Oracle Access !anagement suite Oct )* &&L''a

    ON&'F+'

    Real-Time Analytics for Oracle Business Intelligence withIntel Technologies

    Oct )* &)L&+

    ON&'F+&

    A "poonful of Analytics for lou. PerformanceOptimi:ation

    Oct )* 6L''p

    ON@?)K   Packing Them InL o-operative !emory !anagement an.

    !ulti- Tenancy in e2ogicOct )K 6L''p

    ON@)@&   Performance of Oracle Paa" services Oct )F ?L''p

    ON@??' OBI%% Performance an. rp. optimi:ation techni;ues Oct )@ &L&+p

  • 8/17/2019 CON10850_Potapov-CON10850-Real-Time Analytics for Oracle Business Intelligence With Intel Technologies

    31/31

    D A