using computer vision to analyse historical sources filepipeline harvest images recognize faces...

21
Algorithmes and images Using computer vision to analyse historical sources Thomas Smits Radboud University illustratednewspictures.tumblr.com [email protected] @thomassmits

Upload: others

Post on 06-Sep-2019

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Algorithmes and images

Using computer vision to analyse

historical sources

Thomas Smits

Radboud University

illustratednewspictures.tumblr.com

[email protected]

@thomassmits

Page 2: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Willem Jan Faber

[email protected]

Page 3: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Erik Kessels, 24 Hours in Photos (2011)

Page 4: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet
Page 5: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

http://openframeworks.cc/ofBook/chapters/image_processing_computer_vision.html

Page 6: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

https://commons.wikimedia.org/wiki/File:Dawlish_railway_station_geograph-2444513-by-Ben-Brooksbank.jpg

Page 7: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet
Page 8: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

http://setosa.io/ev/image-kernels/

Page 9: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

http://www.iro.umontreal.ca/~bengioy/talks/DL-Tutorial-NIPS2015.pdf

Page 10: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Pipeline

Harvest images

Recognize faces

Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet music, weather reports)

Recognize illustration/photograph

Convolutional neural network

Machine learning

XML

Dataset of classified images and accompanying articles

Page 11: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet
Page 12: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Pipeline

Harvest images

Recognize faces

Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet music, weather reports)

Recognize illustration/photograph

Convolutional neural network

Machine learning

XML

Dataset of classified images and accompanying articles

Page 13: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Delpher.nl

Page 14: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Pipeline

Harvest images

Recognize faces

Recognize categories (buildings, cartoons, chess, crowds, logo’s, maps, schematics, sheet music, weather reports)

Recognize illustration/photograph

Convolutional neural network

Machine learning

XML

Dataset of classified images and accompanying articles

Page 15: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet
Page 16: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

1900-1910 1915-1920

Page 17: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet
Page 18: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Delpher.nl

Page 19: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Pipeline

Harvest images

Recognize faces

Recognize categories (buildings, cartoons, chess, crowds, logo’s, maps, schematics, sheet music, weather reports)

Recognize illustration/photograph

Convolutional neural network

Machine learning

XML

Dataset of classified images and accompanying articles

Page 20: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet
Page 21: Using computer vision to analyse historical sources filePipeline Harvest images Recognize faces Recognize categories (buildings, cartoons, chess, crowds, logo’s, schematics, sheet

Thank you!

• Digital research at the National Library of the Netherlands http://lab.kb.nl/

• My website illustratednewspictures.tumblr.com

Thomas Smits

Radboud University

illustratednewspictures.tumblr.com

[email protected]

@thomassmits