generative adversarial networks - sds...unpaired image-to-image translation using cycle-consistent...

Generative

Adversarial Networks:

When fake never

looked so real

Evan Ntavelis1,2

Dr. Iason Kastanis1

Philipp Schmid1

{ens, iks, psd}@csem.ch

1. Robotics & Machine Learning

CSEM SA

2. Computer Vision Lab

ETH Zürich

2

CSEM at a glance – Close to industry

N A L

MZ

Zürich

Muttenz

Neuchâtel

Alpnach

Landquart

83.0Turnover

(mio CHF)

450Persons

175Industrial

clients

64European

projects

3

Technologies in focus at CSEM

4

Unpaired Image-to-Image Translation using

Cycle-Consistent Adversarial Networks

Zhu et al. 2017

5

AttnGAN: Fine-Grained Text to Image Generation

with Attentional Generative Adversarial Networks}

Xu et al 2018

6

A Style-Based Generator Architecture

for Generative Adversarial Networks

Karras et al. 2018

7

Semantic Image Synthesis with

Spatially-Adaptive Normalization

Park et al. 2019

8

Source: datagrid.co.jp 2019

9

Few-Shot Adversarial Learning of

Realistic Neural Talking Head Models

Zakharov et al. 2019

10

Generative Adversarial Nets

• Introduced in 2014 by Ian

Goodfellow

• Rapidly Adopted

• Unprecedented Generational

Quality

11

Generative Adversarial Nets

• An adversarial game between

two subnets:

• The Generator

• The Discriminator

12

• In the era of Fake News do highly realistic images harbor dangers to

the society?

Deep Fakes

13

Defense Mechanisms

14

How can we use GANs in the industry?

The important question…

15

• Gathering data is tedious and

costly

• Good quality labels require

even more effort

The Problem

16

• Adversarial Domain Adaptation

• Train on a simulated data and

adapt for the use case

• Data Augmentation

• Learn how to generate new

samples to train with

• Generate images with desired

attributes

A Solution Using Adversarial Networks

Sources: CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Hoffman et al. 2017,

GAN-based Synthetic Medical Image Augmentation

for increased CNN Performance

in Liver Lesion Classification

Frid-Adar et al, 2018

17

• GANs are not a panacea

• Nascent technology

• Difficult to train

• Require abundance of data

• Clever schemes may reduce the

effort

• Yet, very promising results

• Worth the effort!

But…

18

Are you interested in being part of a highly stimulating environment

working on the latest Deep Learning Technologies?

We are hiring!

That’s all folks!