deep learning demystified - nvidiaon-demand.gputechconf.com/gtcdc/2018/pdf/dc8108... · deep...

Will Ramey

DEEP LEARNING DEMYSTIFIED

Sr. Director, Global Head of Developer ProgramsNVIDIA Corporation

DEFINITIONS

BEYOND DEEP LEARNINGOpportunities to accelerate data science

Deep

LearningTraditional Machine Learning (regressions, decision trees, graph) Analytics

MACHINE LEARNING / DATA ANALYTICS

ARTIFICIAL INTELLIGENCE

DENSE DATA TABULAR/SPARSE DATA

2.2 exabytes (2.2B GB) of data created daily – McKinsey

$166B in 2018 revenues for big data and business analytics – IDC

RAPIDS DATA SCIENCE PLATFORMGPU-accelerated OSS libraries for data science

VisualizeData Preparation Model Training

cuDF cuDNNcuMLcuGraph

Analytics Deep

Learning

Machine

Learning

Graph

Analytics

RTX

Visualization

Apache Arrow

www.rapids.ai

AI IS CRITICAL FOR INTERNET APPLICATIONSUsers expect intelligence in services

Source: Jeff Dean, leads the Google Brain team, making machines intelligent. www.wsdm-conference.org/2016/slides/WSDM2016-Jeff-Dean.pdf

DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES

MEDICINE MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES

Cancer cell detection

Diabetic grading

Drug discovery

Pedestrian detection

Lane tracking

Recognize traffic signs

Face recognition

Video surveillance

Cyber security

Video captioning

Content based search

Real time translation

Image/Video classification

Speech recognition

Natural language processing

INTERNET SERVICES

news.developer.nvidia.com

WHAT PROBLEM ARE YOU SOLVING?Defining the AI/DL task

BUSINESS QUESTION

AI/DL TASKEXAMPLE OUTPUTS

HEALTHCARE RETAIL FINANCE

Is “it” present

or not?Detection Cancer Detection Targeted ads Cybersecurity

What type of thing

is “it”?Classification Image Classification Basket Analysis Credit Scoring

To what extent is

“it” present?Segmentation

Tumor Size/Shape

Analysis

Build 360º

Customer ViewCredit Risk Analysis

What is the likely

outcome? Prediction

Survivability

Prediction

Sentiment &

behavior recognitionFraud Detection

What will likely

satisfy the objective? Recommendations

Therapy

Recommendation

Recommendation

Engine

Algorithmic

Trading

INPUTS

Text Data Images

AudioVideo

DEEP NEURAL NETWORKSDifferent models for different tasks

Source: Asimov Institute - www.asimovinstitute.org/neural-network-zoo

DEEP LEARNING APPLICATION DEVELOPMENT

DEEP LEARNING APPLICATION DEVELOPMENT

UntrainedNeural Network

Model

DEEP LEARNING APPLICATION DEVELOPMENT

UntrainedNeural Network

Model

Deep Learning

Framework

TRAININGLearning a new capability

from existing data

DEEP LEARNING APPLICATION DEVELOPMENT

UntrainedNeural Network

Model

Deep Learning

Framework

TRAININGLearning a new capability

from existing data

Trained ModelNew Capability

DEEP LEARNING APPLICATION DEVELOPMENT

UntrainedNeural Network

Model

Deep Learning

Framework

TRAININGLearning a new capability

from existing data

Trained ModelNew Capability

Trained ModelOptimized for Performance

DEEP LEARNING APPLICATION DEVELOPMENT

UntrainedNeural Network

Model

Deep Learning

Framework

TRAININGLearning a new capability

from existing data

Trained ModelNew Capability

App or ServiceFeaturing Capability

INFERENCEApplying this capability

to new data

Trained ModelOptimized for Performance

CHALLENGES

DEEP LEARNING NEEDS WHY

Data Scientists New computing model

Latest Algorithms Rapidly evolving

Fast Training Impossible -> Practical

Deployment Platforms Must be available everywhere

www.gputechconf.com

Come join us at a GTC near you - www.gputechconf.com

DISCOVER

See how GPU technologies are creating amazingbreakthroughs in importantfields such as deep learning

CONNECT

Connect with technology experts from NVIDIA and other leading organizations

LEARN

Gain insight and valuable hands-on training through hundreds of sessions and research posters

INNOVATE

Hear about disruptive innovations as early-stage companies and startups present their work

ADVANCE YOUR DEEP LEARNING TRAINING AT GTCDon’t miss the world’s most important event for GPU developers

NVIDIA DEEP LEARNING INSTITUTE

Helping the world to solve challenging problems using AI and deep learning

On-site workshops and online courses presented by certified instructors

Covering complete workflows for proven application use cases

Fundamentals, Autonomous Vehicles, Finance, Healthcare, Video Analytics, IoT/Robotics, …

Hands-on training for data scientists and software engineers

www.nvidia.com/dli

Benefits

Technology access

AI expertise

Go-to-market support

Inception: Virtual Accelerator For AI Startups

300

3200

Jun 2016 Sep 2018

~10x

Membership Impact

Showcasing innovation

Creating a global community

Inception: Virtual Accelerator For AI Startups

www.nvidia.com/inception

NVIDIA DEEP LEARNING SDK and CUDA

developer.nvidia.com/deep-learning-software

NVIDIA DEEP LEARNING SOFTWARE PLATFORMTRAINING

Training

Data Management

Model Assessment

Trained NeuralNetwork

TrainingData

INFERENCE

Embedded

Automotive

Data center GRE + TensorRT

DriveWorks SDK

JETPACK SDK

NVIDIA GPU CLOUD

Discover 30 GPU-Accelerated ContainersDeep learning, third-party managed HPC applications, NVIDIA HPC visualization tools, and partner applications

Innovate in Minutes, Not WeeksGet up and running quickly and reduce complexity

Access from AnywhereUse on PCs with NVIDIA Volta or Pascal™ architecture GPUs, NVIDIA DGX Systems, and supported cloud providers

Simple access to a comprehensive catalog of GPU-accelerated software

END-TO-END PRODUCT FAMILY

FULLY INTEGRATED AI SYSTEMS

DESKTOP

TITAN

WORKSTATION

DGX Station

DATA

CENTER

Tesla V100

DATA CENTER

Tesla V100

AUTOMOTIVE EMBEDDED

Tesla P4/T4

Drive AGX Pegasus Jetson AGX Xavier

VIRTUAL

WS

Virtual GPU

SERVER

PLATFORM

HGX1/ HGX2

HPC / TRAINING INFERENCE

DGX-1 DGX-2

CHALLENGES

DEEP LEARNING NEEDS SOLUTIONS

Data Scientists Deep Learning Institute, GTC

Latest Algorithms NGC, GPU Accelerated Frameworks, DL SDK

Fast Training DGX, V100/T100, TITAN V

Deployment Platforms TensorRT, V100/T4, Drive AGX, Jetson AGX

READY TO GET STARTED?Project checklist

What problem are you solving, what are the AI/DL tasks?

What data do you have/need, and how is it labeled?

Which tools & environment will you use?

On what platform(s) will you train and deploy?

Autonomous Vehicles

Digital Content Creation

Internet Services

Media & Entertainment

Security & DefenseIntelligent Video Analytics

Finance HealthcareGenomics

WHAT’S NEXT?

Work through DLI online courses – www.nvidia.com/dli

Review examples of AI in action - news.developer.nvidia.com

Listen to the NVIDIA AI Podcast - blogs.nvidia.com/ai-podcast

Register for GTC near you – www.nvidia.com/gtc

Thank you!

www.nvidia.com/dli

27

www.nvidia.com/dli