![Page 1: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/1.jpg)
Deep Learning meets Big Data
Juliano Viana - CTOZunnit Technologies
![Page 2: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/2.jpg)
AgendaO que é Deep Learning?
Redes Neuronais
Deep Learning
…meets Big Data
Conclusão
2
![Page 3: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/3.jpg)
Deep Learning?
![Page 4: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/4.jpg)
Fonte: “Delving Deep into Rectifiers:Surpassing Human-Level Performance on ImageNet Classification" Microsoft Research http://arxiv.org/pdf/1502.01852v1.pdf
Interpretação de Imagens
4
![Page 5: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/5.jpg)
Fonte: “Delving Deep into Rectifiers:Surpassing Human-Level Performance on ImageNet Classification" Microsoft Research http://arxiv.org/pdf/1502.01852v1.pdf
Reconhecimento de Objetos em Tempo
Real5
![Page 6: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/6.jpg)
Fonte: http://deeplearning.cs.toronto.edu/i2t
Descrição(!!) de Imagens
6
![Page 7: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/7.jpg)
Fonte: http://deeplearning.cs.toronto.edu/i2t
Aprendizado dinâmico7
![Page 8: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/8.jpg)
Deep Learning e Redes Neuronais Artificiais
![Page 9: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/9.jpg)
Input layer
Hidden layer
Output layer
Redes Neuronais9
Input layer
Hidden layer
Output layer
Idade
Gênero
Localidade
Preço do Produto
Hora do dia
Fraude?
![Page 10: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/10.jpg)
inputs weights
transfer activation
i1 w1
i2 w2
... w3
iN w4
Bias w5
Σ φ Output
Neurônios10
![Page 11: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/11.jpg)
Input layer
Hidden layer
Output layer
Redes Neuronais: Treinamento
11
Y
Error Function
dE/dY
dE/dW
Feature 1 Feature 2 Feature 3 Feature 4 Feature 5 Label ( )
![Page 12: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/12.jpg)
Input layer
Hidden layer 1 Hidden layer 2 Hidden layer 3 Hidden layer 4
Output layer
O que uma rede neuronal aprende?
12
Linhas Cores
Gradientes
Listras Texturas
Contornos
Olhos Boca
Orelhas
Felinos Primatas Répteis
(c) Koshy Koshy/Flickr
Tigre
![Page 13: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/13.jpg)
O que uma rede neuronal aprende?
13
Source: “Intriguing properties of neural networks” http://arxiv.org/pdf/1312.6199v4.pdf
![Page 14: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/14.jpg)
Deep Learning
![Page 15: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/15.jpg)
1943 1975
Treshold Logic
Restricted Boltzmann Machines
20002006
15
Deep Learning: Histórico1958
Perceptrons Backpropagation
1980
Primeiras redes “Deep”1990
“Dark Age” “Dark Age”2007
Autoencoders
2015
Enormes Avanços em diversas áreas: reconhecimento de voz, tradução automática, reconhecimento de imagens, processamento de linguagem…
![Page 16: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/16.jpg)
• Não se sabia como treinar redes neuronais com uma profundidade muito grande (>3 camadas)
• A quantidade de dados disponíveis para treino era relativamente pequena
• O baixo poder de processamento do hardware impedia o treinamento de modelos muito complexos
O que havia de errado com as Redes
Neuronais?
16
![Page 17: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/17.jpg)
Unsupervised Learning
17
TrainPre-train
Finetune
DataData
Data
![Page 18: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/18.jpg)
Pré-treinamento18
Input layer
Hidden layer
Output layer
Input layer
Hidden layer
Output layer
![Page 19: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/19.jpg)
Exemplo: Reconhecimento de Escrita
19
Input Layer
NL LayerLinear Layer
NL Layer
Output Layer
78450250
784
![Page 20: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/20.jpg)
Exemplo: Reconhecimento de Escrita
20
Demo
![Page 21: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/21.jpg)
… meets Big Data
![Page 22: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/22.jpg)
22
Big Data
![Page 23: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/23.jpg)
Volume Complexidade
23
The Curse of Dimensionality
![Page 24: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/24.jpg)
24
The Curse of Dimensionality
![Page 25: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/25.jpg)
Volume
25
The Curse of Dimensionality
![Page 26: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/26.jpg)
Volume
26
Reduzindo dimensionalidae
• 10 dimensões • 90000 instâncias
Vetorização Autoencoder
(treinamento)Autoencoder
(redução) Clusterização
![Page 27: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/27.jpg)
Conclusões (precipitadas?)
![Page 28: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/28.jpg)
Para conhecer ou usar
https://www.coursera.org/course/neuralnetsNeural Networks for Machine Learning
28
http://deeplearning4j.org/DeepLearning4J
http://torch.ch/Torch
http://www.zunnit.com
![Page 29: Deep Learning Meets Big Data - QConSP · 2015. 5. 27. · Deep Learning Meets Big Data.key Created Date: 4/9/2015 11:46:27 AM](https://reader034.vdocument.in/reader034/viewer/2022051810/601658c89ea5ef5ee32eccfd/html5/thumbnails/29.jpg)
www.vizualus.com // +385 2132 231
@jjviana zunnit.com
#QCONBIGDATA