191123 deeplearning day1 copy - blog.kakaocdn.net
TRANSCRIPT
![Page 1: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/1.jpg)
딥-러닝딥러닝,�첫�번째�날�
2019.11.23.
Deep�Learning
![Page 2: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/2.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
첫�번째�날
딥러닝�이론�
케라스�
Azure�Cloud�설정�
MLP�생성�(Multi�Layer�Perceptron)
이론�
실습�
두�번째�날
이미지�분류�이론�
Azure�Cloud�GPU�활용�
cifar10�이미지�분류
이론�
실습�
실습�
![Page 3: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/3.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
딥-러닝�개론/용어를�이해한다�
MLP�모델을�이해/활용할�수�있다�
이미지�분류�문제를�해결할�수�있다
![Page 4: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/4.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Deep�Learning�
Deep�Neural�Network�
Artificial�Neural�Network(ANN)�
Multi�Layer�Perceptron
![Page 5: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/5.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
인공지능
머신러닝
딥러닝
http://bisintek.com/science/2017/12/27/knowing-basic-artificial-intelligence/
![Page 6: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/6.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://miro.medium.com/max/1200/1*c_fiB-YgbnMl6nntYGBMHQ.jpeg
Data�Driven�Machine�Learning
![Page 7: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/7.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://www.extremetech.com/wp-content/uploads/2015/12/Brain-Machine-2-640x356.jpghttps://www.alzheimersreadingroom.com/2016/07/alzheimer-tau-protein-spreads-through-brain.html
![Page 8: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/8.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://blog.siodigital.com/artificial-neural-networks-and-marketing
Multi�Layer�Perceptron
![Page 9: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/9.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Perceptron
![Page 10: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/10.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Frank�Rosenblatt
![Page 11: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/11.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
인공�신경
입력1
입력2
입력3
Perceptron
가중치2
가중치1
가중치3
함수출력
![Page 12: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/12.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
출력f(x)
인공�신경
x1
x2
x3
w1
w2
w 3
Perceptron
출력
![Page 13: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/13.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
출력f(x)인공�신경
x1
x2
x3
w1
w2
w3
Perceptron
출력
![Page 14: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/14.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
f(x)
x1
x2
x3
w1
w2
w3
w1x1 + w2x2 + w3x3 + b = ∑ wnxn + b
f∑ wnxn + b
인공�신경 출력
![Page 15: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/15.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
f∑ wnxn + b ≥ θ
f∑ wnxn + b < θ
1
0
θ =threshold*
![Page 16: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/16.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://qbi.uq.edu.au/brain/brain-anatomy/axons-cable-transmission-neurons
![Page 17: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/17.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x
y
1
θ
f∑ wnxn + b
Step�Function
0
![Page 18: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/18.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
f∑ wnxn + b ≥ θ
f∑ wnxn + b < θ
1
0
Linear�Binary�Classifier
θ =threshold*
![Page 19: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/19.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://miro.medium.com/max/1624/1*xsR57_PO8U7PB_ItLslLmA.png
![Page 20: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/20.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
0�or�10�or�1
AND�Function
AND�Gatex2
0�or�1
0�or�1
![Page 21: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/21.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
AND�Function
0 0
AND
0
0 1 0
1 0 0
1 1 1
x1 x2 f(x) y
![Page 22: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/22.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x1
x2
1
1
0
![Page 23: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/23.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
XOR�Function
0 0
XOR
0
0 1 1
1 0 1
1 1 0
x1 x2 f(x) y
![Page 24: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/24.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
0�or�1
XOR�Function
XOR�Gatex2
0�or�1
0�or�1
![Page 25: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/25.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x1
x2
1
1
0
![Page 26: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/26.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x1
x2
1
1
0
![Page 27: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/27.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
0�or�1ANDx2
0�or�1
0�or�1ORx2
0�or�1
0�or�1 NOT�ANDx2
0�or�1
0�or�1
0�or�1
0�or�1
![Page 28: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/28.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Multi�Layer�Perceptron(MLP)
x2
0�or�1
0�or�1
0�or�1
![Page 29: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/29.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://blog.siodigital.com/artificial-neural-networks-and-marketing
Multi�Layer�Perceptron
![Page 30: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/30.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
How�it�works?
![Page 31: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/31.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Weight�Initialization�
Forward�Propagation�
Back�Propagation
![Page 32: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/32.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
0�or�11x2
0
1
![Page 33: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/33.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Weight�Initialization
wj = [[−10,10], [20, − 20], [5, − 10]] wk = [−20,10, − 20]
x2
0
1
1
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 34: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/34.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Forward�Propagation
wj = [[−10,10], [20, − 20], [5, − 10]] wk = [−20,10, − 20]
x2
0
1
10
-20
-10
1
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 35: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/35.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x
y
1
θ
f∑ wnxn + b
Step�Function
0
![Page 36: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/36.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Forward�Propagation
wj = [[−10,10], [20, − 20], [5, − 10]] wk = [−20,10, − 20]
1
x20
0
0
1
10
-20
-10
1
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 37: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/37.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Forward�Propagation
wj = [[−10,10], [20, − 20], [5, − 10]] wk = [−20,10, − 20]
1
x20
0
0
1
10
-20
-10
1
0-20
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 38: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/38.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
차이�비교
wj = [[−10,10], [20, − 20], [5, − 10]] wk = [−20,10, − 20]
1
x20
0
0
1
10
-20
-10
1
0-20
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 39: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/39.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
1
x20
0
0
1
Back�Propagation
wj = [[−10,10], [20, − 20], [5, − 10]]
10
-20
-10
1
wk = [−20,10, − 20]
0-20
wk = [10, − 10,15]wj = [[5, − 20], [−30,10], [−15,20]]
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
UPDATE
![Page 40: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/40.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Weight�Initialization�
Forward�Propagation�
비교�
Back�Propagation
![Page 41: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/41.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
차이�비교
wj = [[−10,10], [20, − 20], [5, − 10]] wk = [−20,10, − 20]
1
x20
0
0
1
10
-20
-10
1
0-20
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 42: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/42.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Cost�Function
![Page 43: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/43.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
예측�값과�실제�값의�차이를�기반으로��
모델의�정확도(성능)을�판단하기�위한�함수
Cost�Function *�loss�function�
*�error�function�
*�objective�function
![Page 44: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/44.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
J(w, b) =1n
n
∑i
(h(xi)) − yi)2
mean�squared�error
![Page 45: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/45.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
w, b
J(w, b)
0
Gradient�Descent�
![Page 46: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/46.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
w, b
J(w, b)
0
Gradient�Descent�
w = w − αδ
δwJ(w)
![Page 47: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/47.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Optimizer어떻게?
![Page 48: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/48.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
http://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf
![Page 49: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/49.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Optimizer
https://ruder.io/optimizing-gradient-descent/
![Page 50: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/50.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://ruder.io/optimizing-gradient-descent/
Optimizer
![Page 51: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/51.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://www.slideshare.net/yongho/ss-79607172
![Page 52: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/52.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Optimizer
Perceptron MLP
Weight�InitializationForward�Propagation
Back�PropagationCost�Function
![Page 53: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/53.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Overfitting
Vanishing�Gradient
![Page 54: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/54.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
f(x)
x1
x2
x3
w1
w2
w3
w1x1 + w2x2 + w3x3 + b = ∑ wnxn + b
f∑ wnxn + b
인공�신경 출력
![Page 55: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/55.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x
y
1
θ
f∑ wnxn + b
Step�Function
0
![Page 56: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/56.jpg)
https://theffork.com/activation-functions-in-neural-networks/
Sigmoid�Function
![Page 57: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/57.jpg)
https://ayearofai.com/rohan-4-the-vanishing-gradient-problem-ec68f76ffb9b
![Page 59: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/59.jpg)
https://medium.com/@anishsingh20/the-vanishing-gradient-problem-48ae7f501257
![Page 60: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/60.jpg)
![Page 61: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/61.jpg)
https://theffork.com/activation-functions-in-neural-networks/
Sigmoid
![Page 62: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/62.jpg)
https://theffork.com/activation-functions-in-neural-networks/
ReLU�Rectified�Linear�Unit
![Page 63: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/63.jpg)
https://theffork.com/activation-functions-in-neural-networks/
tanh
![Page 64: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/64.jpg)
https://theffork.com/activation-functions-in-neural-networks/
Leakey�ReLU
![Page 65: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/65.jpg)
https://www.quora.com/Why-is-ReLU-the-most-common-activation-function-used-in-neural-networks
![Page 66: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/66.jpg)
https://theffork.com/activation-functions-in-neural-networks/
![Page 67: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/67.jpg)
![Page 68: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/68.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Overfitting
Vanishing�Gradient
![Page 69: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/69.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Model�Capacity
x
yy = ax + b
![Page 70: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/70.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Model�Capacity
x
yy = ax + b
![Page 71: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/71.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x
yy = ax + b
y = k + ax0 + bx1 + cx2
![Page 72: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/72.jpg)
https://youtu.be/_sz3KTyB9Lk
![Page 73: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/73.jpg)
https://youtu.be/_sz3KTyB9Lk
![Page 74: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/74.jpg)
https://youtu.be/_sz3KTyB9Lk
![Page 75: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/75.jpg)
https://hackernoon.com/memorizing-is-not-learning-6-tricks-to-prevent-overfitting-in-machine-learning-820b091dc42
Regularization
![Page 76: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/76.jpg)
https://i.stack.imgur.com/CewjH.png
Dropout
![Page 77: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/77.jpg)
https://deepestdocs.readthedocs.io/en/latest/004_deep_learning_part_2/image/0042_fig0.jpg
![Page 78: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/78.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
케라스, 뭔가요?
Keras
![Page 79: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/79.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 80: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/80.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
AI�접근성과�민주화� 딥러닝의�대중화�
Keras�
François�Chollet
![Page 81: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/81.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
- 파이썬으로�구현된�high-level�deep�learning�API�
- TesnsorFlow,�Theano,�CNTK�
- 쉬운�사용법과�간단한�문법,�빠른�설계�가능
![Page 82: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/82.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
김태영의 케라스 블로그: https://tykimos.github.io/
뿔 진실
상아 거짓
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 83: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/83.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
김태영의 케라스 블로그: https://tykimos.github.io/
우리가 만든 모델이 진실을 말해주길…
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 84: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/84.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 85: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/85.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://t1.daumcdn.net/cfile/tistory/99BB78335993E64726
![Page 86: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/86.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 87: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/87.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 88: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/88.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Keras
https://towardsdatascience.com/deep-learning-framework-power-scores-2018-23607ddf297a
![Page 89: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/89.jpg)
Model�모델
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 90: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/90.jpg)
Model�모델
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 91: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/91.jpg)
네트워크�network
목표함수�objective�function
최적화기�optimizer
Model�모델
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 92: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/92.jpg)
Network�네트워크
Objective�Function�목표함수
Optimizer�최적화기
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 93: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/93.jpg)
Network�네트워크
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 94: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/94.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
x2
0
1
1
wj1
wj2
wj3
wj4
wj5
wj6
wj7
wj8
wj9
![Page 95: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/95.jpg)
Network�네트워크
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 96: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/96.jpg)
256
1024
512
784
1
1
0
네�트�워�크
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
0
1
![Page 97: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/97.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
https://keras.io/applications/
● Xception (88 MB, 126) ● VGG16 (528 MB, 23) ● VGG19 (549 MB, 26) ● ResNet50 (99 MB, 168) ● InceptionV3 (92 MB, 159) ● InceptionResNetV2 (215 MB, 572) ● MobileNet (17 MB, 88) ● DenseNet121 (33 MB, 121) ● DenseNet169 (57 MB, 169) ● DenseNet201 (80 MB, 201) ● NASNet
![Page 98: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/98.jpg)
InceptionResNet
V2
Xception VGG16 VGG19
ResNet50
InceptionV3
MobileNet
Dense Net
NASNet
![Page 99: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/99.jpg)
Objective�Function�목표함수
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 100: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/100.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
예측�값과�실제�값의�차이를�기반으로��
모델의�정확도(성능)을�판단하기�위한�함수
Cost�Function *�loss�function�
*�error�function�
*�objective�function
![Page 101: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/101.jpg)
https://keras.io/losses/�
● mean_squared_error�● mean_absolute_error�● mean_absolute_percentage_error�● mean_squared_logarithmic_error�● squared_hinge�● hinge�● categorical_hinge�● logcosh�● categorical_crossentropy�● sparse_categorical_crossentropy�● binary_crossentropy�● kullback_leibler_divergence�● poisson�● cosine_proximity
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 102: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/102.jpg)
mean�squared�
categorical� binary�
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 103: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/103.jpg)
Optimizer�최적화기
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 104: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/104.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://ruder.io/optimizing-gradient-descent/
Optimizer
![Page 105: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/105.jpg)
https://keras.io/optimizers/�
● SGD�● RMSprop�● Adagrad�● Adadelta�● Adam�● Adamax�● Nadam�● TFOptimizer
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 106: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/106.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
https://keras.io/optimizers/�
● SGD�● RMSprop�● Adagrad�● Adadelta�● Adam�● Adamax�● Nadam�● TFOptimizer
![Page 107: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/107.jpg)
SGD RMSprop Adagrad Adam
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 108: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/108.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
Compile�컴파일
Network�네트워크
Objective�Function�목표함수
Optimizer�최적화기
![Page 109: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/109.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
Compile�컴파일
Network�네트워크
Objective�Function�목표함수
Optimizer�최적화기
![Page 110: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/110.jpg)
네트워크�network
목표함수�objective�function
최적화기�optimizer
Model�모델
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 111: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/111.jpg)
adam
binary
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 112: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/112.jpg)
sgd
categorical
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
![Page 113: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/113.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
𝑿 𝒀
![Page 114: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/114.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
𝑿 𝒀𝒀 '
![Page 115: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/115.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
𝑿
𝒀 ' 𝒀
𝒀𝒀 '
![Page 116: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/116.jpg)
블록과 함께하는 파이썬 딥러닝 케라스, (주)인스페이스 기술이사 김태영
𝑿
𝒀 ' 𝒀
𝒀𝒀 '
![Page 117: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/117.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
첫�번째�날
딥러닝�이론�
케라스�
Azure�Cloud�설정�
MLP�생성�(Multi�Layer�Perceptron)
이론�
실습�
![Page 118: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/118.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
AI�Service�On�Azure�Cloud�
![Page 119: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/119.jpg)
![Page 120: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/120.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
DSVM
https://azure.microsoft.com/en-us/services/virtual-machines/data-science-virtual-machines//?WT.mc_id=AI-MVP-5003262
![Page 121: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/121.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://azure.microsoft.com/en-us/services/virtual-machines/data-science-virtual-machines//?WT.mc_id=AI-MVP-5003262
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 122: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/122.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 123: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/123.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Before�we�run,
![Page 124: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/124.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Resource�Group�
Resource�
Subscription�
![Page 125: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/125.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Resource�
![Page 126: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/126.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Region�
![Page 127: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/127.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://azure.microsoft.com/en-us/global-infrastructure/regions/
![Page 128: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/128.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://azure.microsoft.com/en-us/global-infrastructure/regions/
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 129: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/129.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Region East�US
![Page 130: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/130.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Resource�Group�
Resource�
Subscription�
![Page 131: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/131.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Region Korea�Central
![Page 132: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/132.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
![Page 133: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/133.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Resource�Group�
Resource�
Subscription�
![Page 134: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/134.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Pay�As�You�Go
![Page 135: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/135.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Resource�Group�
Resource�
Subscription�
Virtual�Machine
AzureClass2324
AI_GroupKorea�Central
East�West2
![Page 136: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/136.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Let’s�Strat�HOL�💻
![Page 138: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/138.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
데이터�셋�준비
문제�정의
모델�설정
모델�훈련�/�평가
![Page 139: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/139.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
AND��Function
1번�문제�정의
![Page 140: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/140.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
0�or�10�or�1
AND�Function
AND�Gatex2
0�or�1
0�or�1
![Page 141: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/141.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
AND�Function
0 0
AND
0
0 1 0
1 0 0
1 1 1
x1 x2 f(x) y
![Page 142: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/142.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
�XOR��Function
2번�문제�정의
![Page 143: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/143.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
XOR�Function
0 0
XOR
0
0 1 1
1 0 1
1 1 0
x1 x2 f(x) y
![Page 144: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/144.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
0�or�1
XOR�Function
XOR�Gatex2
0�or�1
0�or�1
![Page 145: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/145.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
�당뇨병�발병�예측�
3번�문제�정의
![Page 146: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/146.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Pima�Indian�Diabets
https://www.researchgate.net/figure/Pima-Indian-Diabetes-dataset-attributes_tbl1_325653625
![Page 147: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/147.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Activation�Layers
![Page 148: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/148.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
은닉층�(Hidden�Layer)
ReLU Leaky�ReLu ELU
Rectifier�linear Leaky�ReLUExponential�Linear�Units
![Page 149: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/149.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
출력층�(Output�Layer)
linear sigmoid softmax
특정�값��예측
이진�클래스��예측
다중�클래스��예측
![Page 150: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/150.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Data
![Page 151: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/151.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
batch_size
X_train Y_train
문제�몇개를�풀고�답을�확인�할�것인가?
![Page 152: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/152.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
epochs
![Page 153: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/153.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
epochs문제를�총�몇번�풀�것인가?
………
![Page 154: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/154.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
만일,�
epoch=100,000�
정확도가�100%�되지�않을까??��
😏
![Page 155: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/155.jpg)
Overfitting
https://hackernoon.com/memorizing-is-not-learning-6-tricks-to-prevent-overfitting-in-machine-learning-820b091dc42
![Page 156: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/156.jpg)
https://static1.squarespace.com/static/5213a664e4b01a5565dc90f1/t/5bc4e0c4e4966bc550291202/1546736393368/Machine+Learning+Generalization
![Page 157: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/157.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Data
X_train
X_test
Y_train
Y_test
![Page 158: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/158.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Data
X_train
X_test
Y_train
Y_test
X_val Y_val
![Page 159: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/159.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
https://hackernoon.com/memorizing-is-not-learning-6-tricks-to-prevent-overfitting-in-machine-learning-820b091dc42
epoch
loss
Loss�Function
![Page 160: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/160.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
우리도�할�수�있어요,�
딥-러닝�🥳
![Page 162: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/162.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Keras
케라스�문서�
같은�결과가�나오도록�학습하는�방법�
30초만에�케라스�시작하기�
케라스�튜토리얼(한글)�
김태영님의�케라스�강의(한글)�
케라스�코리아(페이스북)
![Page 163: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/163.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
Data�Science�Virtual�Machine
DSVM�이란?�
DSVM�DeepLearning�VM�생성하기�
Linux�및�Windows용�DSVM�소개�
DSVM�딥러닝�프레임워크�
�DSVM�데이터�수집도구�
Linux�DSVM�사용하기
![Page 164: 191123 DeepLearning day1 copy - blog.kakaocdn.net](https://reader034.vdocument.in/reader034/viewer/2022050313/626f4bb0a4a5500f050e5ab7/html5/thumbnails/164.jpg)
2019.11.23.�|�한이음�ICT�멘토링�|�딥러닝�특강1�|�전미정
What the hell is perceptron
From perceptron to deep neural nets
Neural�Networks�6:�solving�XOR�with�a�hidden�layer
Optimizing-gradient-descent
Activation�functions�in�neural�networks
DeepLearning