Upload File

image style transfer using convolutional neural networks · image style transfer using...

  • Home
  • Documents
  • Image Style Transfer using Convolutional Neural Networks · Image Style Transfer using Convolutional Neural Networks Architecture Results Content vs StyleTypeequationhere. Color Preservation
1
Dhruv Gelda and Anish Shenoy Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign Image Style Transfer using Convolutional Neural Networks Architecture Results Content vs Style Color Preservation References Acknowledgements Der Schrei, Edvard Munch, 1893 The Starry Night, Vincent Van Gogh, 1889 Femme nue assise, Pablo Picasso, 1910 Style image is transformed to match the color histogram of the content image. Femme nue assise, Pablo Picasso, 1910 Starry Night over the Rhone, Vincent Van Gogh, 1888 = 10 −3 = 10 −4 = 10 −5 = 10 −6 1. Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "Image style transfer using convolutional neural networks." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016. 2. Gatys, Leon A., et al. "Preserving color in neural artistic style transfer." arXiv preprint arXiv:1606.05897 (2016). 3. GitHub repository: https://github.com/ckmarkoh/neuralart_tensorflow 4. GitHub repository: https://github.com/leongatys/PytorchNeuralStyleTransfer 5. GitHub repository: https://github.com/jcjohnson/neural-style Style Loss Function Content Loss Function Feature correlations Style layer weights Convolutional layer outputs Style Reconstruction Content Reconstruction

Upload: others

Post on 21-Jun-2020

3 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Image Style Transfer using Convolutional Neural Networks · Image Style Transfer using Convolutional Neural Networks Architecture Results Content vs StyleTypeequationhere. Color Preservation

Dhruv Gelda and Anish ShenoyDepartment of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign

Image Style Transfer using Convolutional Neural Networks

Architecture

Results

Type equation here.Content vs Style

Color Preservation

References

Acknowledgements

Der Schrei, Edvard Munch, 1893

The Starry Night, Vincent Van Gogh, 1889 Femme nue assise, Pablo Picasso, 1910

Style image is transformed to match the color histogram of the

content image.

Femme nue assise, Pablo Picasso, 1910

Starry Night over the Rhone, Vincent Van Gogh, 1888

𝛼

𝛽= 10−3

𝛼

𝛽= 10−4

𝛼

𝛽= 10−5

𝛼

𝛽= 10−6

1. Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "Image style transfer

using convolutional neural networks." Proceedings of the IEEE Conference on

Computer Vision and Pattern Recognition. 2016.

2. Gatys, Leon A., et al. "Preserving color in neural artistic style transfer." arXiv

preprint arXiv:1606.05897 (2016).

3. GitHub repository: https://github.com/ckmarkoh/neuralart_tensorflow

4. GitHub repository: https://github.com/leongatys/PytorchNeuralStyleTransfer

5. GitHub repository: https://github.com/jcjohnson/neural-style

Style Loss Function

Content Loss Function

Feature correlations

Style layer weights

Convolutional layer

outputs

Style

Reconstruction

Content

Reconstruction

Hyperbolic Graph Convolutional Neural Networkspapers.nips.cc › paper › 8733-hyperbolic-graph-convolutional-neural-networks.pdfGraph Convolutional Neural Networks (GCNs) are state-of-the-art

Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Using Support Vector Machines, Convolutional … Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural ... orcircuit ,andmuchANNresearch

Convolutional Neural Network · Convolutional Neural Networks (CNN) •A.k.a. CNN or ConvNet Adit Deshpande, A Beginner's Guide To Understanding Convolutional Neural Networks. Digital

Training Convolutional Neural Networksraul/RS/Training Convolutional... · • Data-dependent Initializations of Convolutional Neural Networks by Krähenbühl et al., ... In practice,

Neural Predictive Coding using Convolutional Neural ...Neural Predictive Coding using Convolutional Neural Networks towards Unsupervised Learning of Speaker Characteristics Arindam

Detecting Object Affordances with Convolutional Neural ...dkanou.github.io/publ/P9__Nguyen_Kanoulas_Caldwell_Tsagarakis__… · Detecting Object Affordances with Convolutional Neural

A Convolutional Neural Network Cascade for Face … · A Convolutional Neural Network Cascade for Face Detection ... using a GPU, and achieves state ... Convolutional Neural Network

CONVOLUTIONAL NEURAL NETWORKS: MOTIVATION, …

Image Style Transfer Using Convolutional Neural … Style Transfer Using Convolutional Neural Networks Leon A. Gatys Centre for Integrative Neuroscience, University of Tubingen, Germany¨

ImageNet Classification with Deep Convolutional Neural …kriz/imagenet_classification_with_deep_convolutional.pdfImageNet Classification with Deep Convolutional Neural Networks

Convolutional Neural Networks (Part II)lvelho.impa.br/ip17/proj/slides/1110GoingDeeperConv.pdf · Convolutional Neural Networks 1 Convolutional Neural Networks (Part II) 08, 10 &

Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Deep Convolutional Neural Network for Image …papers.nips.cc/paper/5485-deep-convolutional-neural...Deep Convolutional Neural Network for Image Deconvolution Li Xu ∗ LenovoResearch

ImageNet Classification with Deep Deep Convolutional …rita/visual_recog_course/talks/ImageNet... · ImageNet Classification with Deep Deep Convolutional Convolutional Neural Neural

Convolutional Neural Networks for No-Reference Image Quality Assessmentopenaccess.thecvf.com/...Convolutional_Neural_Networks_2014_CVPR_paper.pdf · Convolutional Neural Networks

Using Support Vector Machines, Convolutional Neural ... · Using Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural

Understanding Convolutional Neural Networks

Convolutional Neural Networks for Deep Learning: An Introduction · 2017-10-05 · Introduction: Convolutional Neural Networks (CNN) Convolutional Neural Networks: A deep learning

Convolutional Neural Networks

Deep convolutional neural networks - Computer Science- …web.cs.ucdavis.edu/.../lee_lecture19_deeplearning_notes.pdf · Deep convolutional neural networks ... “Deep” architecture

Shepard Convolutional Neural Networks - Neural Information …papers.nips.cc/paper/5774-shepard-convolutional-neural... · 2016-02-16 · Shepard Convolutional Neural Networks (ShCNN)

Pixel-Adaptive Convolutional Neural Networksopenaccess.thecvf.com/content_CVPR_2019/papers/Su_Pixel-Adaptive_Convolutional_Neural...Pixel-Adaptive Convolutional Neural Networks Hang

Convolutional Neural Fabrics - arXiv

Convolutional Neural Networks Arise From Ising Models …sunilpai/convolutional-neural-networks.pdf · Convolutional Neural Networks Arise From Ising Models and Restricted Boltzmann

Convolutional Neural Networks Arise From Ising Models and ...web.stanford.edu/~sunilpai/convolutional-neural-networks.pdf · Convolutional neural networks are an attractive option

Constrained Convolutional Neural Networks for …vgg/rg/slides/ccnn1.pdf · Constrained Convolutional Neural Networks for Weakly Supervised Segmentation ... [CCNN] Convolutional Neural

Convolutional neural networks for direct inference of ...eprints.whiterose.ac.uk/142937/1/Convolutional Neural Networks for... · This is a repository copy of Convolutional neural

Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Convolutional Neural Networks Analyzed via Convolutional ...yromano/posters/ml_csc_poster.pdf · Convolutional Neural Networks ... Recently, convolutional sparse coding (CSC)

Meta Networks for Neural Style Transfer · for a new style. We provide a new perspective on the algorithms for neural style transfer, which indicates that convolutional neural networks

Convolutional Neural Networks - arXiv

Image Style Transfer Using Convolutional Neural Networksliaoqing.me/course/AI Project/[2016 CVPR]Image... · Figure 1. Image representations in a Convolutional Neural Network (CNN)

Convolutional Neural Networkscis581/Lectures/Fall2018/CNN-intr… · Convolutional Neural Network (CNN) Pipeline: A Monitor. Convolutional Neural Nets (CNNs) in a nutshell: • A

O-CNN: Octree-based Convolutional Neural Networks for … · O-CNN: Octree-based Convolutional Neural Networks for 3D ... object classification, ... Octree-based Convolutional Neural