Upload File

learned representations

38
Learned Representations @ejlbell

Upload: eddie-bell

Post on 15-Apr-2017

316 views

Category:

Software


0 download

Report

TRANSCRIPT

Page 1: Learned Representations

Learned Representations

@ejlbell

Page 2: Learned Representations

Me

2

Page 3: Learned Representations

Lyst

3

Page 4: Learned Representations

4

Feature engineering

Page 5: Learned Representations

5

Type of transform Examples

Unary exp, log, sqrt

Normalisation mean, variance

Aggregation count, sum, mean

Dimensional reduction PCA, clustering, manifold

Text tagging, parsing, stemming

Image histograms, key points, super pixels, segmentation

Others temporal / spatial

Page 6: Learned Representations

AI must fundamentally understand the

world around us and this can only be

achieved if it can learn to identify and

disentangle the underlying explanatory

factors hidden in the observed milieu of

low-level sensory data.

2014 - Representation Learning: A Review and New Perspectives. - Bengio et al.

Page 7: Learned Representations

Human ingenuity and prior knowledge

Feature Engineering

Representation Learning

Sufficiently powerful models that learn “good” feature transforms

Page 8: Learned Representations

8

Deep Learning

Page 9: Learned Representations

Image Filters

-1

-2

-1

0

0

0

+1

+2

+1

-1

0

+1

-2

0

+2

-1

0

+1

Page 10: Learned Representations

VGG

Representations

2015 - Very Deep Convolutional Networks for

Large-Scale Image Recognition. Simonyan and

Zisserman

Page 11: Learned Representations

Regularization

11

Page 12: Learned Representations

12

Representations

Page 13: Learned Representations

13

Cat

Dog

Male

Female

Page 14: Learned Representations

14

Cat

Dog

Male

Female

Page 15: Learned Representations

15

Cat

Dog

Male

Female

Page 16: Learned Representations

Content

Page 17: Learned Representations

Similar to ‘dress’

Page 18: Learned Representations
Page 19: Learned Representations
Page 20: Learned Representations

20

Applications

Page 21: Learned Representations
Page 22: Learned Representations

22

a group of young girls standing next

to each other on the beachA clock tower with a clock on top of it

Page 23: Learned Representations

A bunch of bananas hanging from a tree

Page 24: Learned Representations

24

Page 25: Learned Representations

25

Page 26: Learned Representations

26

+ =

Page 27: Learned Representations

27

Page 28: Learned Representations
Page 29: Learned Representations

29

Page 30: Learned Representations

30

Page 31: Learned Representations

31

Page 32: Learned Representations

32

Page 33: Learned Representations

33

Page 34: Learned Representations

34

Page 35: Learned Representations

35

1 0 0

1 0 0

0 1 0

0.7 -0.6 -8

0 0 1

0 0 1

0 1 0

-8 -0.6 0.7

Page 36: Learned Representations

But … not a magic bullet

36

* Expensive in terms of hardware

* Expensive in terms of time

* Expensive in terms of expertise

* Expensive in terms of labelled data

* Blackbox, can’t do inference

Page 37: Learned Representations

Thanks especially to all the people I stole this content from

Page 38: Learned Representations

Questions?

@ejlbell


Visualizing chess position representations learned using ... · Visualizing chess position representations learned using convolutional autoencoders Visualisierung von Schachpositions-Repräsentationen

Learned in Translation: Contextualized Word Vectorspapers.nips.cc/paper/7209-learned-in-translation-contextualized-word... · et al.[2016] propose to combine text representations

Product-Aware Helpfulness Prediction of Online Reviewsresearch.baidu.com/Public/uploads/5d12ebb70ddf8.pdf · prediction. The learned representations do not require tedious labor on

View-tolerant face recognition and Hebbian learning imply ... · The computational insight enabling depth-rotation tolerant representations to be learned from experience is that,

DEEP-LEARNED GENERATIVE …people.cs.umass.edu/~hbhuang/files/thesis_lowres.pdfDEEP-LEARNED GENERATIVE REPRESENTATIONS OF 3D ... DEEP-LEARNED GENERATIVE REPRESENTATIONS OF 3D SHAPE

Sustainability Appraisal Representations...Sustainability Appraisal Representations 11 representations were received on the Sustainability Appraisal. Of these, 8 representations were

LEEP: A New Measure to Evaluate Transferability of Learned ... · LEEP: A New Measure to Evaluate Transferability of Learned Representations 2014) – not only for large target data

What have we learned from deep representations for action recognition?feichtenhofer.github.io/pubs/Feichtenhofer_Actions_FVT_2017.pdf · What have we learned from deep representations

Visual Dynamics: Probabilistic Future Frame Synthesis via ...visualdynamics.csail.mit.edu/visualDynamics16.pdf · and present an analysis of the learned network representations. 2

DEEP IMAGE REPRESENTATIONS USING CAPTION ... learned with this stronger supervision to achieve ef-ficient task specific image representations. referred to as transfer learning or

Learning Representations for Relation Classificationcs224d.stanford.edu › reports › ZhongVictor.pdfrecurrent model, with the addition of learned representations for the sampled

A Classification-Based Polyphonic Piano Transcription ...juhan/pubs/ISMIR2011_poster.pdf · A Classification-Based Polyphonic Piano Transcription Approach Using Learned Feature Representations

Learning Structured Low-Rank Representations for Image ... › openaccess › content_cvpr_2013 › pa… · native dictionary can be learned from all training samples simultaneously

arXiv:2010.02415v1 [cs.LG] 6 Oct 2020in learned representations. This results in a simplified GNN with significantly fewer learned parameters compared to competing methods. We demonstrate

What have we learned from deep representations for action ...What have we learned in: –Fusion of appearance and motion streams –Long-term feature aggregation •Visualization of

Sparse learned representations for image restoration · Sparse learned representations for image restoration Julien Mairal1 Michael Elad2 Guillermo Sapiro3 1 INRIA, Paris-Rocquencourt,

MODELING NATURAL LANGUAGE SEMANTICS ADISSERTATIONmanning/dissertations/Bowman... · 2016. 7. 30. · modeling natural language semantics in learned representations adissertation submitted

Updating representations of learned scenesnmr.mgh.harvard.edu › ... › wp...representations2007.pdfrepresentations and that observers would be forced to rely on enduring, allocentric

Intermediate Representations - EPITArenault/teaching/cmp2/... · Intermediate Representations 1 Intermediate Representations Compilers Structure Intermediate Representations Tree

Fusion of Learned Multi-Modal Representations and Dense Trajectories for Emotional Analysis in Videos

Protein-protein docking using learned three-dimensional ...complex three-dimensional representations. Each point in the volume containing the protein is described by 48 learned features,

SoundNet: Learning Sound Representations from Unlabeled …vondrick/soundnet.pdfthe emergence of massive labeled datasets [31, 42, 10] and learned deep representations [17, 33, 10,

DeepTrack: Learning Discriminative Feature Representations ... · Training patches Normalized patches Learned filters in Layer-1 Training faces Pre-learn Class-Specific Cue Layer-1

Computational Analysis of Learned Representations …cogsci.fmph.uniba.sk/~farkas/Papers/kuzma-farkas.ijcnn18.pdfComputational Analysis of Learned Representations in Deep Neural Network

On Disentangled Representations Learned from Correlated Data

Deeply-learned Hybrid Representations for Facial Age Estimation · ods either learn the global representations from the whole face [Rotheet al., 2018; Niuet al., 2016; Tanet al.,

On the Intrinsic Dimensionality of Image Representations ...openaccess.thecvf.com/content_CVPR_2019/...and visualizing the learned projections on the Swiss Roll dataset, and (7) Section7:

Image Denoising via Learned Dictionaries and Sparse Representations Michael Elad The Computer Science Department The Technion – Israel Institute of technology

Deeply Learned Face Representations Are Sparse, Selective ...xgwang/papers/sunWTcvpr15.pdf · Deeply learned face representations are sparse, selective, ... deep learning achieved

Sketch Tokens: A Learned Mid-level Representation for ...people.csail.mit.edu › lim › paper › SketchTokens_cvpr13.pdf · Effective mid-level representations abstract low-level

Action Recognition with Trajectory-Pooled Deep-Convolutional …wanglimin.github.io/papers/WangQT_CVPR15.pdf · 2020-04-16 · The second type of representations are the deep-learned

Image Denoising via Learned Dictionaries and Sparse ... · Image Denoising Via Learned Dictionaries and Sparse representations By: Michael Elad 15 Option 1: Use a database of images,

INDIVIDUAL DIFFERENCES IN …d-scholarship.pitt.edu/10236/1/BalassMichal_Dec132004.pdfINDIVIDUAL DIFFERENCES IN REPRESENTATIONS OF NEWLY LEARNED WORDS: AN EVENT-RELATED INVESTIGATION

Network embeddingyunshengb.com/wp-content/uploads/2017/10/network_embedding_re… · mapping function from word co-occurrence [Rumelhart+, 2003] We hope that the learned representations

New 1 Accelerated dynamic MRI using learned representationsresearch.engineering.uiowa.edu/slingala/sites/research... · 2019. 9. 3. · 1 Accelerated dynamic MRI using learned representations