intro to deeplearning4j on apachespark sds dl workshop 16

Introduction to Large-Scale DeepLearning with DeepLearning4J and ApacheSpark @romeokienzler Swiss Data Science Conference 16 - ZHAW - Winterthur

Upload: romeo-kienzler

Post on 14-Apr-2017

332 views

Category:

Engineering

8 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Introduction to Large-Scale DeepLearning with

DeepLearning4J and ApacheSpark

@romeokienzler Swiss Data Science Conference 16 - ZHAW - Winterthur

Page 2: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

–Assembler vs. Python?

“High-level programming”

Page 3: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Components

• DeepLearning4JEnterprise Grade DeepLearning Library

• DataVec CSV/Audio/Video/Image/… => Vector

• ND4J / ND4S (NumPy for the JVM)

Page 4: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

ND4J

• Tensor support (Linear Buffer + Stride)

• Multiple implementations, one interface

• vectorized c++ code (JavaCPP), off-heap data storage, BLAS (OpenBLAS, Intel MKL, cuBLAS)

• GPU (CUDA 7.5)

Page 5: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

turn on GPU

Page 6: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

DL4J parallelisation• TensorFlow on ApacheSpark =>

• Scoring

• Multi-model hyper-parameter tuning

• Parallel training since V r0.8

• DeepLearning4J =>

• Scoring, Multi-model hyper-parameter tuning

• Parallel training“Jeff Dean style parameter averaging”

Page 7: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

“Code local vs spark”

vs.

Page 8: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

DemoIoT / Industry / Predictive Maintenance Use Case

Page 9: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 10: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 11: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 12: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 13: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

data

https://github.com/romeokienzler/pmqsimulator https://ibm.biz/joinIBMCloud

https://github.com/romeokienzler/pmqsimulator

https://ibm.biz/joinIBMCloud

Page 14: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 15: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 16: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 17: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 18: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 19: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 20: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

•Outperformed traditional methods, such as •cumulative sum (CUSUM) •exponentially weighted moving

average (EWMA) •Hidden Markov Models (HMM)

•Learned what “Normal” is •Raised error if time series pattern

haven't been seen before

Page 21: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Page 22: Intro to DeepLearning4J on ApacheSpark SDS DL Workshop 16

Introduction to Roc Bevel - Rocplasrocplas.co.uk/door-lights-catalogue.pdf · DL 018 DL 016 DL 019. PAGE Inspiration 07 DL 020 DL 023 DL 021 DL 024 DL 022 DL 025 DL 026. Contemporary

Application Guide - SCIEX€¦ · SDS-MW Gel Buffer - proprietary formulation, pH 8, 0.2% SDS 140 mL SDS-MW Sample Buffer - 100 mM Tris-HCl pH 9.0, 1%SDS 50 mL SDS-MW Size Standard

Land Use Designations - Regional District of Central Okanagan · DL 4513 DL 4508 (DL 14) (DL l4) DL 4507 DL 4505 DL 4506 DL 4095 DL 4507 DL 4502 D L 2 4 0 5 1 DL 3742 DL 4048 DL 3906

TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf

Range Tenure RAN076373 (PIETER BLEEKER) Overlap with or ......dl 8155 dl 8532 dl 8294 dl 8472 dl 2913 dl 4639 dl 474 dl 2202 dl 5301 dl 5297 dl 5300 dl 5296 dl 5298 dl 5295 dl 8159

Safety Data Sheet SDS Number: PI-SDS-M700 Revision Date: 8 ......8/17/2018 3 PI-SDS-M520 PI-SDS-M520 Insect Screening Product Name: Revision Date: Version: SDS Number: Product Code:

Electoral Area 'G' - Crooked River-Parsnip · 2366 dl 2367 dl 2373 dl 2374 dl 2375 2376 dl 2377 2383 2378 dl 2384 dl 2386 dl 2387 dl 2388 2282 dl 2283 dl 2284 dl ... 2325 2324 2323

Advanced deeplearning4j features

KTPPLktppl.com/Catalogues/DFC-Catalogue.pdf · 2020. 4. 22. · DFC 20 DL DFC 25 DL DFC 30 DL DFC 35 DL DFC 40 DL DFC 50 DL DFC 60 DL DFC 80 DL DFC 90 DL DFC 100 DL Size DFC DL Rated

Ersatz meetup - DeepLearning4j Demo

SDS-Polyacrylamide Gel Electrophoresis - KSUfac.ksu.edu.sa/.../files/4.sds-polyacrylamide_gel_electrophoresis.pdf · -Sodium Dodecyl Sulfate-Polyacrylamide gel Electrophoresis (SDS-PAGE),

Introduction to Deeplearning4j

SAFETY DATA SHEET (SDS) SDS #500 - Welding · SAFETY DATA SHEET (SDS) SDS #500 . 1. IDENTIFICATION. ... AWS A5.5, A5.18, A5.28. Product Intended/Recommended Use: …

SDS PAGE = SDS polyacrylamide gel electrophoresis

SDS QuickCheck Marijuana DL Tube Item # 10132

82G - alc.gov.bc.ca · ALC Website: This map represents Agricultural ... DL 937 DL 126 DL 0676 DL 106 DL 426 DL 7206 DL 26029 DL 1021 DL 128 DL 2313A DL 10144

SDS - medline.com€¦ · 29/9/2014 · SDS Sagent Pharmaceuticals, Inc. Adenosine Injection, USP Safety Data Sheet (SDS) Issue Date: Sep 29, 2014 SDS No.: SDS 001 SDS Version No.:

CONTENTS · DL 018 DL 016 DL 019. PAGE Inspiration 07 DL 020 DL 023 DL 021 DL 024 DL 022 DL 025 DL 026. Contemporary designs and styles inspired by nature PAGE 08 DL 029 DL 032 DL

Lexical SDs. Lexico -syntactical SDs

DL-1020 Features DL-1021 DL-1022

Deep learning on a mixed cluster with deeplearning4j and spark

SDS Rv1 0411 Confidential 1. SDS Rv1 0411 Confidential 2 Agenda Conclusion HIPAA Risk SDS Technology Benefits

Safety Data Sheet (SDS① SDS № 1/27

92B€¦ · ir 2 deadman's island l 26 d 160 dl 171 dl 218 dl 225 dl 172 dl 286 dl 186 dle 168 dl 189 dl 211 dl 220 dl 163 dl 269 dl 287 dl 291 dl 20 dl 270 l 167 dl 177c dl 173 dl

82E...DL 7S DL 1982S DL 2971,0 KRUGER 0MC DL 2968, STRATHCONA MC DL 633S DL 558S, LEAMINGTON MC DL 3064S, BRITISH MC DL 1928, HORN SILVER MC DL 2973, IOWA MC DL 2393S, SILVER BELL

SDS & Work

DL -HD18-272B - DREAMLIFE MT · dl-hd18-272e dl -hd18-272b dl-hd18-272a dl-hd18-271b dl-hd18-271c dl-hd18-271f dl-hd18-271a dl-hd18-271d dl -hd18 271e dl-hd18-271g dl-hd18-271h dl-hd18-271i

Power Tools - · PDF fileTool Holder SDS Plus SDS Plus SDS Plus SDS Plus SDS Max SDS Max SDS Max ... Safety Clutch 4 4 4 4 4 4 4 ... Cordless Power Tools Hammer Drill Driver

Lightning Talks & Integrations Track - Integration of DeepLearning4j Library with Apache Apex @ ABDW17, Pune

AutomationDirect ECOM Driver Help - Kepware · AutomationDirectECOMDriverHelp DeviceSetup SupportedDevices* DL-05 DL-06 DL-240 DL-250(-1) DL-260 DL-430 DL-440 DL-450 *AllPLCsviaanHx-ECOMmodule

82F - alc.gov.bc.ca · DL 1004 DL 525 L 1270 DLD 1269 DL 3878 DL 3877 DL 8624 DL 9557 DL 7717 DL 1271A DL 16326 DL 12715 DL 12843 DL 3864 DL 524 DL 15878 Sec 220, TP 7 DL 9556 Sec

SMART MANUFACTURING - events.static.linuxfound.org · AGENDA •Introduction •Smart Manufacturing •Applications •Deep learning solution •CNN •Deeplearning4j (DL4J) •Apache

Dynamic Series Subwoofer - Nortek Security & Control · 2017-06-28 · Subwoofer SDS-8, SDS-10, and SDS-12 SDS-8230, SDS-10230, and SDS-12230 Location Your SDS Subwoofer is designed

DeepLearning4J: Open Source Neural Net Platform

SDS Advanced Topics Guide - dellemc.com · 6 SDS Advanced Topics Guide Typographical Conventions • SDS Administrator’s Guide The central book to use when learning about SDS. It