csce 636 neural networks (deep learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · csce 636 neural...
TRANSCRIPT
![Page 1: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/1.jpg)
CSCE636NeuralNetworks(DeepLearning)
Lecture1:IntroductiontoDeepLearning
Anxiao (Andrew)Jiang
![Page 2: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/2.jpg)
AI,MachineLearning,andDeepLearning
Coming up: Prerequisites forthecourse
![Page 3: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/3.jpg)
Prerequisitesforthecourse
• FamiliarwiththePythonprogramminglanguage• Basicbackgroundinmachinelearning,linearalgebra,calculus.
Coming up: coursewebsite
![Page 4: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/4.jpg)
Coursewebsite
• http://faculty.cse.tamu.edu/ajiang/636.html
Coming up: textbook
![Page 5: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/5.jpg)
Textbook:DeepLearningwithPython(required)
Coming up: textbook
![Page 6: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/6.jpg)
Textbook:DeepLearning(recommended)
Coming up: textbook
![Page 7: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/7.jpg)
Textbook:DeepLearningQuickReference(recommended)
Coming up: textbook
![Page 8: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/8.jpg)
Textbook:NeuralNetworksandDeepLearning(recommended)
Coming up: textbook
![Page 9: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/9.jpg)
Textbook:LearningfromData(recommended)
Coming up: deep learning andneural network
![Page 10: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/10.jpg)
DeepLearningandNeuralNetwork
NeuralNetworkInput Output
Whatneuralnetworkisdoing:computing(oftentransformationoffeatures/representations,andmakingafinaldecision).
Coming up: example oftransformation
![Page 11: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/11.jpg)
Exampleoftransformation
Coming up: example oftransformation
![Page 12: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/12.jpg)
Exampleoftransformation
Coming up: example ofdeepneural network (DNN)
![Page 13: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/13.jpg)
ExampleofDeepNeuralNetwork(DNN)
Coming up: example ofDNN(continued)
![Page 14: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/14.jpg)
ExampleofDNN(continued)
Coming up: example ofDNN
![Page 15: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/15.jpg)
ExampleofDNN
Coming up:whataneural network does: learnafunction
![Page 16: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/16.jpg)
Whataneuralnetworkdoes:learnafunction
NeuralNetworkx
valueoff(x)
Theneuralnetworklearnsthefunctionf(x),eitherexactlyorapproximately.
Coming up:whatisaneuron
![Page 17: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/17.jpg)
Whatisaneuron
Coming up:whatisaneural network (NN)
![Page 18: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/18.jpg)
Whatisaneuralnetwork
Coming up: how totrainaneural network
![Page 19: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/19.jpg)
Howtotrainaneuralnetwork
NeuralNetworkx
valueoff(x)
Theneuralnetworklearnsthefunctionf(x),eitherexactlyorapproximately.
1.Usealotof(input,output)pairstotraintheneuralnetwork.2.Adjustweightstominimize thedifferencebetween f(x)andtheneuralnetwork’spredicted valuesoff(x)
Coming up: applications ofdeep learning
![Page 20: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/20.jpg)
ApplicationsofDeepLearning
• Computervision(smartcamera,robot,self-drivingcars,etc.)• Naturallanguageprocessing(machinetranslation,chatbot,etc.)• Gameplaying(alphaGo,videogames,etc.)• Createartorproducts(painting,music,poem,fashion,etc.)• Datastorageandtransmission(datacompression,transmission,etc.)• Financeandeconomy(trading,recommendation,economysurvey,etc.)• Healthcare(readX-raypictures,diagnosis,drugdesign,etc.)• Physics,business,education,smarthomes,etc.(Moreandmoreapplicationseveryday.)
Coming up:whydeep learning now?
![Page 21: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/21.jpg)
Whydeeplearningnow?
• Hardware:GPU,CUDA,parallelcomputing• Data:ImageNetandmanymore• Algorithms:activationfunctions,weight initializationschemes,optimizationschemesfortraining.
Coming up: homework (without submission)
![Page 22: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/22.jpg)
Homework(withoutsubmission)
ReadChapter2BeforeNextClass
Coming up: Videos ondeep learning
![Page 23: CSCE 636 Neural Networks (Deep Learning)faculty.cse.tamu.edu/ajiang/636_01.pdf · CSCE 636 Neural Networks (Deep Learning) Lecture 1: Introduction to Deep Learning Anxiao (Andrew)](https://reader030.vdocument.in/reader030/viewer/2022040409/5ec4e68ae1d7e06923410d84/html5/thumbnails/23.jpg)
Videosondeeplearning
• Howweteachcomputerstounderstandpictures,https://www.youtube.com/watch?v=40riCqvRoMs• ArtisticStyleTransferForVideos,https://www.youtube.com/watch?v=Uxax5EKg0zA• ChopinMusicGenerationwithRNN(RecurrentNeuralNetworks)andDeepLearning,https://www.youtube.com/watch?v=j60J1cGINX4