matlab and the gpu who is accelereyes? –accelereyes is a mathworks partner –jacket: gpu engine...

18

Upload: gilbert-west

Post on 28-Dec-2015

219 views

Category:

Documents

0 download

Report

Download

Tags:

Embed Size (px):

TRANSCRIPT

Page 1: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Page 2: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

MATLAB and the GPU• Who is AccelerEyes?

– AccelerEyes is a MathWorks partner– Jacket: GPU Engine for MATLAB

• What’s a GPU?– Graphics processing unit– Traditionally used for video games– Now redesigned for use for science as well– Massively parallel with 240 processor cores

Page 3: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

MATLAB and the GPU• Who is AccelerEyes?

– AccelerEyes is a MathWorks partner– Jacket: GPU Engine for MATLAB

• What’s a GPU?– Graphics processing unit– Traditionally used for video games– Now redesigned for use for science as well– Massively parallel with 240 processor cores

• What’s in it for you?– Low-priced speed

Page 4: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

MATLAB Options• CPU Solutions

(blue arrows)– MATLAB and the

Parallel Computing toolbox enable PC and clustered MATLAB computing

• GPU Solutions (green arrow)– Jacket enables

CUDA MATLAB Computing

Page 5: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Why GPUs?

Speed

Page 6: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Why Jacket?

Jacket combines the speed of CUDA and the graphics of the GPU with the user friendliness of MATLAB.

Page 7: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Supported platforms?

Page 8: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Jacket at Work

CPU GPU

This Neural Net only required 3 changes (in red).

Page 9: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Jacket Functionality

Generators: geye, gones, gzeros Element-wise: +, *, -, / Reductions: sum, min, max … Indexing: subscripted referencing /

subscripted assignment Linear Algebra: matrix multiply, … FFT: fft, ifft, fftn, ifftn Filtering: filter, filter2, convn Interpolation: interp2 Parallel for-loops: gfor

• standard CUDA functionality: libraries• MEX files + CUDA• Customized low-level GPU codes

Page 10: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Graphics Toolbox

True visual computing OpenGL API in MATLAB Interactive OpenGL Key functions: gsurf, gimage, gscatter3, gplot, … Visualization scripts are open and modifiable.

Jacket includes the Graphics Toolbox

Page 11: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Kernel Benchmarks

54x Speedup 16x Speedup

Page 12: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Application Benchmarks

Page 13: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Page 14: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Page 15: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Some Jacket Customers

Page 16: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Jacket Roadmap: 09-10

– more gfor– gdouble– multi-GPU support (for clusters of GPUs)– LAPACK (eig, inv, etc.)– signal processing– image processing (and computer vision)– statistical functions– handle graphics– Simulink® on the GPU– lots of other MATLAB functions (finance,

biology, etc.)

Lo

w-e

nd

To

olb

ox

esH

igh

-en

d

Page 17: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Jacket Pricing

Page 18: MATLAB and the GPU Who is AccelerEyes? –AccelerEyes is a MathWorks partner –Jacket: GPU Engine for MATLAB What’s a GPU? –Graphics processing unit –Traditionally

Questions?

[email protected]

Forum support:www.accelereyes.com/forums

Sprinx Systemshttp://hpc.sprinx.cz/sw/jacket.aspx

[email protected]

Dec, 2015 2014 ReflectionS FROM DEPARTMENT A Perfect Way ...cvrce.edu.in/images/documents/NEWSLETTER-2015.pdf · Algorithm in Image Segmentation using MATLAB on GPU Architecture",

Deep Learning with MATLAB - INAF (Indico)€¦ · NVIDIA NGC & DGX Supports MATLAB for Deep Learning GPU-accelerated MATLAB Docker container for deep learning – Leverage multiple

Deploying Deep Neural Networks to Embedded GPUs and CPUs - Matlab · MATLAB Coder and GPU Coder generates code that takes advantage of: NVIDIA® CUDA libraries, including TensorRT

GPU Computing with MATLAB - GPU Technology …on-demand.gputechconf.com/.../gtc-express-gpu-computing-with-ma… · Speed up MATLAB code with NVIDIA GPUs ... • Cross correlation,

Image Processing and Computer Vision with MATLAB and …€¦ · Image Processing and Computer Vision with MATLAB and SIMULINK By Joss Knight Senior Developer, GPU and Parallel Algorithms

MathWorks v. AccelerEyes et. al

Accelerating MATLAB using CUDA- Enabled GPUs · 1 Accelerating MATLAB using CUDA-Enabled GPUs February 2009 John Melonakos AccelerEyes [email protected] Sumit Gupta NVIDIA

GPU Benefits for Earth System Science › sites › default › files... · GPU Benefits for Earth System Science. 2 TOPICS ... 19km GPU 19km CPU 1.9km GPU.93km GPU ... NOAA FV3 GPU

Parallel and Distributed Computing with MATLAB · Statistics and Machine Learning Resampling Methods, k-Means clustering, GPU-enabled functions Neural Networks Deep Learning, Neural

GPU Computing with MATLAB - Nvidia · PDF fileGPU Computing with MATLAB ... Desktop Computer ... – Invoke CUDA kernels directly from MATLAB – No MEX programming necessary 10. 11

What’s New in MATLAB R2012b · – FMCW generation and processing, MATLAB Compiler support (R2012b) – Polarization support, three new MATLAB apps (R2013a) GPU computing (R2012b)

Intro to Matlab GPU Programming

M ltiMulti-GPU S t f GPU Support for pp MATLAB Ui J ... · Gallagher PryorGallagher Pryor, James MalcolmJames Malcolm, John MelonakosJohn Melonakos, TauseefTauseef ur Rehman ... malcolm@,@,

GPU-Accelerated Preconditioned Iterative Linear Solverssaad/PDF/umsi-2010-112.pdf · GPU-Accelerated Preconditioned Iterative Linear Solvers ... Fortran, Java and MATLAB are ... A

[Harvard CS264] 15a - Jacket: Visual Computing (James Malcolm, Accelereyes)

GPU Computing with Matlab® @ CBI Laboratory

Cygnus: GPU meets FPGA for HPC - RIKEN R-CCS · 2020. 2. 27. · FPGA-GPU DMA (FPGA ← GPU) FPGA-GPU DMA (FPGA → GPU) direction via CPU FPGA-GPU DMA GPU→FPGA 17 1.44 FPGA→GPU

GPU Computing with Matlab® @ CBI Laboratory. Overview GPU History & Hardware – GPU History – CPU vs. GPU Hardware – Parallelism Design Points GPU Software

GPU Architecture: Implications & Trendss08.idav.ucdavis.edu/luebke-nvidia-gpu-architecture.pdf · GPU Architecture: Implications & Trends ... GPU architecture increasingly centers

MatConvNet - MathWorks · Examples, demos, tutorials MATLAB Parallel Computing Toolbox (GPU) MatConvNet Primitives vl_nnconv, vl_nnpool, … (MEX/M ﬁles) An increasingly powerful

Introduction to Matlab GPU Acceleration for Computational ...mx.nthu.edu.tw/~chhan/IntroMatlabGPU.pdf · ! 2! Figure 1. Comparison of the number of cores on a CPU system and a GPU

Image Processing with MATLAB and GPU - IntechOpen

GPU Computing with MATLAB - GTC On Demand · 10 GPU Functionality Call GPU(s) from MATLAB or toolbox/server worker Support for CUDA 1.3 enabled devices GPU array data type – Store

Parallel & GPU computing in MATLAB ITS Research Computing Lani Clough

What’s New – MATLAB and Simulink · 18 Solving Bigger Problems with MATLAB Problems that take too long for one processor to solve –Growing toolbox support (parallel and GPU)

Enterprise level GPU DevelopmentEnterprise level GPU Development. 3x Single Precision 1.8x Memory Bandwidth Image, Signal, Seismic ... GADGET2 MATLAB Mathematica NBODY Paradigm VoxelGeo

GPU Computing with Matlab II - University of Minnesota · PDF fileGPU Computing with Matlab II ... module load matlab matlab -r “MaxNumCompThreads(1) ... Control the default parallel

GPU Computing with MATLAB - University of …sbel.wisc.edu/Courses/ME964/2011/Lectures/lecture050… · · 2011-05-03Example: Parameter Sweep of ODEs ... GPU Computing with MATLAB

GPU, GP-GPU, GPU computing

An Introduction to GPU ProgrammingThe General Purpose GPU (GPGPU) movement had dawned. ... C++ Thrust, CUDA C++ Python PyCUDA, Copperhead F# Alea.cuBase Numerical analytics MATLAB,

GPU Physics - Nvidiadeveloper.download.nvidia.com/.../siggraph/gpu_physics-siggraph-06.pdf · NVIDIA GPU Physics Multi-GPU configurations, mixed or same GPU type One GPU does both

Build GPU Cluster Hardware for Efficiently Accelerating ... · Hardware GPU dense HPC Cluster CPU Host RAM GPU #5 PHB IB Card Host RAM CPU GPU #0 PHB IB Card GPU #1 GPU #4 GPU #2

GPU Compu*ng with MATLAB - UABgrid Documentation · 2017-11-07 · MATLAB and GPU Compu*ng • MATLAB makes GPU compu0ng easy • Many func0ons support gpuArrays • A large number

Best Practices GPU-Based Video Processing | GTC 2013on-demand.gputechconf.com/...Based-Video-Processing... · GPU-Based Video Processing Optimal GPU Upload GPU Processing GPU Readback

GPU Computing with MATLAB - · PDF fileGPU Computing with MATLAB ... Desktop Computer ... – Invoke CUDA kernels directly from MATLAB – No MEX programming necessary 10. 11