tensorflow serving, deep learning on mobile, and deeplearning4j on the jvm - enterprise deep...
TRANSCRIPT
TensorFlow Serving, Deep Learning on Mobile, and
Deeplearning4j on the JVM
Sam Putnam6/8/2017
Want to learn live in New York? I am teaching the Deploying Deep Learning Track at Deep Learning Conf®
Tickets are available now: www.DeepLearningConf.com
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deep Learning on Mobile
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deeplearning4j on the JVM
Part 1 of 3
TensorFlow Serving
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Exporting Your Model
http://www.nqbao.com/blog/2017/02/tensorflow-exporting-model-for-serving/
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Question Answering at Zendesk
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Training to Production
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception V1 (GoogLeNet) ‘14
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
https://www.quora.com/What-is-the-vanishing-gradient-problem
think Oxford’s VGG 16
https://arxiv.org/pdf/1409.4842.pdf
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://research.googleblog.com/2016/08/improving-inception-and-image.html
6/8/2017
Inception V3 ’15 (2x deep, ~2x memory)
Softmaxhttps://www.youtube.com/watch?v=gNhogKJ_q7U
Part 2 of 3
Deep Learning on Mobile
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deploying TensorFlow to Android (presumably works - I don’t know because I have an iOS device)
Deep Learning on Mobile
https://chatbotslife.com/deploying-a-tensorflow-model-to-android-69d04d1b0cba
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/https://youtu.be/XxDbKlIomhc
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
YOLO
https://youtu.be/OUdN4srAtRA
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MobileNets
https://youtu.be/0vBsU__JTlA
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MNIST (of course)
https://youtu.be/EL78-Rgoyfw
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
.dat or .bin files
https://github.com/LunarFlash/convolutional-neural-network-image-recognitionhttps://www.youtube.com/watch?v=EYP7099z6kk
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Speech Recognition and API call
https://github.com/marcdown/SayWhat https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Live Video Captioning
https://github.com/zats/SpeechRecognition https://www.youtube.com/watch?v=Xt8o3dlH7uQ
6/8/2017
Part 3 of 3
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deeplearning4j is a Deep Learning Framework that runs on the JVM
https://deeplearning4j.org/
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Today in the DL4j Gitter
https://gitter.im/deeplearning4j/deeplearning4j
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
DL4j Integrates with Spark for Distributed Deep Learning
https://www.slideshare.net/jpatanooga/deep-learning-with-dl4j-hadoop-summit-2015/17
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
From S3 to DL4j to Spark
https://dzone.com/articles/deep-learning-on-the-jvm
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Python Java for Training, Java for Deploy
https://youtu.be/R3lzuXPbybY?t=5m41s
6/8/2017
Thank you
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Thank you to Google, Yoni Tsafir, Skymind, Bat Nguyen, ZenDesk, Others who have published diagrams and photos. Slides are for today only.
Always looking for new members & new locations in Cambridge, US or NYC & new speakers to present on Deep Learning in Production topics
https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77
6/8/2017