![Page 1: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/1.jpg)
SHAFAATUNNUR HASAN
SITI MARIYAM SHAMSUDDIN
UTM BIG DATA CENTRE,
UNIVERSITI TEKNOLOGI MALAYSIA,
81310 SKUDAI JOHOR
DEEP LEARNING FOR SURFACE RECONSTRUCTION
![Page 2: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/2.jpg)
![Page 3: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/3.jpg)
![Page 4: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/4.jpg)
1.Universiti Teknologi Malaysia is an innovation-driven entrepreneurial Research University and a leading research-intensive university in engineering, science and technology ranked in the top 100 world ranking in engineering and technology.
2.It is located both in Kuala Lumpur, the capital city of Malaysia and Johor Bahru, the southern city in Iskandar Malaysia, which is a vibrant economic corridor in the south of Peninsular Malaysia
![Page 5: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/5.jpg)
RESEARCH STRUCTURE IN UTM
Three (3) HiCoE
a. Wireless Communication Centre (WCC)
b. Advanced Membrane Technology Centre
c. Institute of Noise and Vibration (IKG)
Six (6) Research Institutes:
a. Ibnu Sina Institute for Scientific and Industrial Research (ISI-SIR)
b. Institute for Smart Infrastructures and Innovative Construction (ISIIC)
c. Institute for Vehicle Systems and Engineering (IVeSE)
d. Institute of Human CenteredEngineering (IHCE)
e. Institute of Future Energy (IFE)
f. Research Institute for Sustainable Environment (RISE)
Five (5) Research Alliances
a. Frontier Materials
b. Innovative Engineering
c. Health and Wellness
d. Resource Sustainability
e. Smart Digital Community
![Page 6: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/6.jpg)
WHO WE ARE
UTM Big Data Centre - rooted from well-experienced researchers and practitionersfrom one of the research groups in UTM –Soft Computing Research Group (SCRG).With almost 20 years experiences in the fieldof Machine Learning, Pattern Recognition,Data Analytics, and Intelligent Graphicsmodelling, as well as in Big Data Analyticsand GPU-based Machine Learning.
![Page 7: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/7.jpg)
PRIMARY FOCUSWhat is our expertise?
Data Science
Big Data
CO
PYR
IGH
T @
UTM
BIG
DA
TA C
ENTR
E
Big Data Science
![Page 8: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/8.jpg)
UTM BIG DATA PLATFORM 3.0
FUSION
DATA
FACTORY
CO
PYR
IGH
T @
UTM
BIG
DA
TA C
ENTR
E
![Page 9: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/9.jpg)
CO
PYR
IGH
T @
UTM
Big
Dat
a C
entr
e
GPUMLiB-- AI as a Service
(AIaaS) @ UTM Big Data Centre
![Page 10: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/10.jpg)
GPU MACHINE LEARNING LIBRARY
(GPUMLiB)- OPEN SOURCE LIBRARY
![Page 11: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/11.jpg)
11
What we are presenting now
Deep Learning SOM for
Surface Reconstruction
![Page 12: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/12.jpg)
.
The exponential growth of 3D objects, images, devices upto the Nth dimensional representation and constructionwill decrease the performance drastically. Thus, DeepLearning SOM algorithm is proposed in this study tooptimize the performance of 3D reconstruction andrepresentation.
Wai Pai Lee, Shafaatunnur Hasan, Siti Mariyam Shamsuddin and Noel Lopes. GPUMLib: Deep Learning SOM Library for Surface Reconstruction. International Journal of Advances in Soft Computing and its Application, 9, 2(2017), 1-16
What & Why Deep Learning for Surface Reconstruction
![Page 13: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/13.jpg)
Where to implement Deep Learning SOM?
13
Surface Representation
Surface Reconstruction
Representing the point cloud data set into a viewable
state in a computer such as a computer vision object.
Including two categories: Explicit and Implicit.
Usually assumed as part of surface reconstruction.
The process of retrieving the point cloud data set
generated by a device.
Connecting the coordinates in point cloud data set which
are attached with the points information.
![Page 14: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/14.jpg)
How to implement Deep-learning SOM in Close Surface Environment ?
![Page 15: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/15.jpg)
How to implement Deep-learning SOM in Close Surface Environment ?
• Point Cloud Collection• PCL data set repositoryPhase 1
• Data Preprocessing• GPUMLib data representationPhase 2
• Deep Learning SOM• Deep Learning GPUMLib SOM Optimization
Phase 3
• Surface Representation• PCL ViewerPhase 4
![Page 16: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/16.jpg)
SOM
SOM
How to implement Deep-learning SOM in Close Surface Environment ?GPUMLib Framework
![Page 17: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/17.jpg)
SOM- GPUMLib RESEARCH DESIGN
GPUMLib Implementation
Host (CPU) and device (GPU) memory access framework Reduction framework
HostArray
DeviceArray
HostMatrix
DeviceMatri
x
CudaArray
…
MinIndex
…
SOM Implementation
Host (CPU) Device (GPU)
Read input data
Initialize weights
Compute distance and find
BMU
Update the weights
Display output
Termination
is satisfied?
Compute distanceComputeDistancesSOMkernel<<<…>>>
Find BMUMinSmallArrayIndex<<<…>>>
Copy value to hostUpdateHost()
Update the weightsUpdateWeightsSOMkernel<<<…>>>
Normalize the weightsNormalizeWeightsSOMkernel<<<…>>>
yes
no
How to implement Deep-learning SOM in Close Surface Environment ?
SOM-GPUMLib Research Design
![Page 18: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/18.jpg)
Point Cloud with
Connectivity
Point Cloud without
Connectivity
Output
point based
on the final
mapping
from the
previous
layer
Output point
based on the
final weights
-Map size reducesas Iteration increases
How is the Architecture of Deep Learning SOM?The Proposed Deep-layer SOM
![Page 19: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/19.jpg)
Original
Output Results
The Proposed Deep-learning SOM Surface Reconstruction Output
![Page 20: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/20.jpg)
Single Layer SOM Deep-Layer SOM
Model Sphere Bunny1 Bunny2 Eagle Sphere Bunny1 Bunny2 Eagle
Points 422 8171 35947 796825 422 8171 35947 796825
Iteration 1000 1000 1000 500 1575 1575 1575 1575
MapX 10 25 25 100 20 40 40 100
MapY 20 40 50 200 40 60 60 200
Time (s) 4.84 124.528 619.12 52560 10.08 60.192 75.21 4392
CPU GPU
Model Sphere Bunny1 Bunny2 Eagle Sphere Bunny1 Bunny2 Eagle
Points 422 8171 35947 796825 422 8171 35947 796825
Iteration 1575 1575 1575 1575 1575 1575 1575 1575
MapX 20 40 40 100 20 40 40 100
MapY 40 60 60 200 40 60 60 200
Time (s) 4.30 64.70 87.32 9540 10.08 60.192 75.21 4392
Performance Comparison between CPU and GPU using Deep-Layer SOM
Deep-layer SOM Performance Comparison between Single Layer SOM and Deep-Layer SOM
Performance Comparison of Single Layer and Deep-layer SOM
![Page 21: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/21.jpg)
21
The proposed Deep Learning SOMwill be an alternative solution fordeep optimization in searching, re-organizing and optimizing higherdimensional spaces for complexproblems, i.e., complex design andscenes. Our future work will bedeveloping mobile-based GPUMLib:Deep Learning SOM for optimizingcomplex objects, scenes and related.
AcknowledgementThe authors thank NVIDIA CORPORATION for the support in sponsoring the passes to GTC 2018; Malaysian Ministry of Higher Education (MOHE) for the financial support in conducting this project and Universiti Teknologi Malaysia for the R & D activities.
Conclusion & Future Direction
![Page 22: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/22.jpg)
Short Demo
![Page 23: DEEP LEARNING FOR SURFACE RECONSTRUCTION · 2018. 3. 30. · The proposed Deep Learning SOM will be an alternative solution for deep optimization in searching, re-organizing and optimizing](https://reader035.vdocument.in/reader035/viewer/2022071500/611f60a4bc4533545e5a2903/html5/thumbnails/23.jpg)
THANK YOU
&
Terima Kasih