british library labs roadshow 2016 open data meetup bristol

65
1 http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu ttp://goo.gl/I3tBR

Upload: labsbl

Post on 15-Apr-2017

313 views

Category:

Education


1 download

TRANSCRIPT

Page 1: British Library Labs Roadshow 2016 Open Data Meetup Bristol

1http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://goo.gl/I3tBRu

Page 2: British Library Labs Roadshow 2016 Open Data Meetup Bristol

2http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.bl.uk/projects/british-library-labsFunded by the Andrew W. Mellon Foundation

21st March 2016 – BL Labs Roadshow 2016Presentation at British Library’s Digital Content and Open Data Meetup, Bristol

Page 3: British Library Labs Roadshow 2016 Open Data Meetup Bristol

3http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.bl.uk/projects/british-library-labsFunded by the Andrew W. Mellon Foundation

21st March 2016 – BL Labs Roadshow 2016Presentation at British Library’s Digital Content and Open Data Meetup, Bristol

Page 4: British Library Labs Roadshow 2016 Open Data Meetup Bristol

4http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Distant Reading – Adam Crymble

https://www.youtube.com/watch?v=tp4y-_VoXdA

Page 5: British Library Labs Roadshow 2016 Open Data Meetup Bristol

5http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Digital research methods

http://labs.bl.uk/Launch+Event (has some examples from researchers)

Corpus analysis toolsText Mining

Visualisations

Location based searching

Geotagging

Annotation

Natural Language Processing

Using Application Programming Interfaces for datasets e.g. Metadata, Images

Transcribing

Crowdsourcing / Human Computation

Page 6: British Library Labs Roadshow 2016 Open Data Meetup Bristol

6http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

One of Largest Library’s in the World180 million* items

1-2 %* digitised

* estimate

Page 7: British Library Labs Roadshow 2016 Open Data Meetup Bristol

7http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

IntersectionYou and the Library

Your research interestsDigital

collections interested in

British LibraryDigital

collections we have

This is where Labs works

It starts with a conversation!

Page 8: British Library Labs Roadshow 2016 Open Data Meetup Bristol

8http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Managing expectations:Looking for very specific things digitally

•Research interests?

•What digital collections are you interested in?

•Only a small amount of content is digitised!

•Might not be the treasure you expect at the end of a digital journey!

Page 9: British Library Labs Roadshow 2016 Open Data Meetup Bristol

9http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

You might get very lucky!Fly fishing by JR Hartley

https://www.youtube.com/watch?v=r2TilNclT8k

Page 10: British Library Labs Roadshow 2016 Open Data Meetup Bristol

10http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.bl.uk/subjects/digital-scholarship

http://labs.bl.uk/Digital+Collections

Soon…http://data.bl.uk

Mini Network Area Storage Device (NAS) guide:http://goo.gl/E8aRyQ

Page 11: British Library Labs Roadshow 2016 Open Data Meetup Bristol

11http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

How?

Page 12: British Library Labs Roadshow 2016 Open Data Meetup Bristol

12http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

•Submit ideas by 11 April 2016.

•Two finalists announced late May 2016.

•Residency June – October 2016.•Up to £3600 support, technical, curatorial etc.

•Showcase @ Symposium Monday 7 Nov 16.

•Winner £3000 & Runner up £1000!

Competition

Page 13: British Library Labs Roadshow 2016 Open Data Meetup Bristol

13http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

•Projects already using BL digital content in interesting and innovative ways.

•Submit projects (previous and new) by 5 September 2016.

•Artistic, Commercial, Research and Learning / Teaching categories.

•Winners announced @Symposium 7 Nov 16.

•£500 Winner & £100 Runner Up.

Awards

Page 14: British Library Labs Roadshow 2016 Open Data Meetup Bristol

14http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Projects & Ideas• Ideas change once you try to access, examine and use the data!

•Talk to us about working on potential ideas / projects.

Page 15: British Library Labs Roadshow 2016 Open Data Meetup Bristol

15http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Competition

Page 16: British Library Labs Roadshow 2016 Open Data Meetup Bristol

16http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Katrina Navickas (2015) Political Meetings Mapper

http://politicalmeetingsmapper.co.ukLabs Symposium 2015 (33 mins)

https://goo.gl/Qq78Oa

Interview 2015 (4 mins)https://goo.gl/BSA3be

The Chartist Newspaperhttp://goo.gl/vOLSnH

Chartist Monster Meeting

Page 17: British Library Labs Roadshow 2016 Open Data Meetup Bristol

17http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Chartists Un-CoveredHistory in London

Chartist’s London Walking Tour 21 Sep 15

The Red Lion Pub, SohoChartists Re-enactment

Chartist’s Meeting Locations in London

Chartist’s Meetings Heatmap in London

Page 18: British Library Labs Roadshow 2016 Open Data Meetup Bristol

18http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Chartists Re-enactment London

https://goo.gl/BSA3be

Page 19: British Library Labs Roadshow 2016 Open Data Meetup Bristol

19http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Victorian Meme Machine (2014)Competition Winner

https://www.youtube.com/watch?v=zK95lzaPNp0Bob Nicholson

http://victorianhumour.tumblr.com/

Page 20: British Library Labs Roadshow 2016 Open Data Meetup Bristol

20http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://victorianhumour.tubmblr.com

Page 21: British Library Labs Roadshow 2016 Open Data Meetup Bristol

21http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Rob WalkerVictorian Mother-in-law Jokes

https://www.youtube.com/watch?v=-GRgj7Q5OM0

Bob Nicholson interviewed on Radio 4 Making History Programmehttp://www.bbc.co.uk/programmes/b07378d1

Page 22: British Library Labs Roadshow 2016 Open Data Meetup Bristol

22http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Awards

Page 23: British Library Labs Roadshow 2016 Open Data Meetup Bristol

23http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Commercial (2015)Etsy project by Dina Malkova

https://www.etsy.com/shop/DinaMalkova

Labs Symposium 2015https://goo.gl/OfJujM

Read more: http://goo.gl/pbxZUv

Page 24: British Library Labs Roadshow 2016 Open Data Meetup Bristol

24http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Commercial (2015) Runner UpSarah Wingate-Gray and Kate Lomax

http://goo.gl/s1dVSC

Page 25: British Library Labs Roadshow 2016 Open Data Meetup Bristol

25http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.lancaster.ac.uk/fass/projects/spatialhum.wordpress/

Labs Symposium 2015: https://goo.gl/ZCU56a

Research (2015)Spatial Humanities: Lancaster University

Combining Text and Geographic Informationhttp://goo.gl/yZ3xCJ

Investigating geographical representation of disease in digitised 19th Century newspapers

Page 26: British Library Labs Roadshow 2016 Open Data Meetup Bristol

26http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Projects and Ideas

Page 27: British Library Labs Roadshow 2016 Open Data Meetup Bristol

27http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Creative with Wildlife Sounds

http://goo.gl/s7siv0

Sound Edit Wildlife Films Competition 2013 http://vimeo.com/60401313

'Dave's Wild Life' by Samuel de Ceccatty, won first prize!

http://sounds.bl.uk/Environment

Page 28: British Library Labs Roadshow 2016 Open Data Meetup Bristol

28http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Dave’s Wildlife

Page 29: British Library Labs Roadshow 2016 Open Data Meetup Bristol

29http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

2016 Competition Announcedhttp://gamecity.org/off-the-map

2015 - http://gamecity.org/alices-adventures-off-the-map-winners-announced/

Page 30: British Library Labs Roadshow 2016 Open Data Meetup Bristol

30http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Sound fileshttps://soundcloud.com/the-british-library/sets/shakespeare-off-the-map

Closing dateMonday 6th June 2016

2016 Off The Map Sub-themes

Page 31: British Library Labs Roadshow 2016 Open Data Meetup Bristol

31http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

What can 65,000books tell us?

Image: Artwork by Alicia Martin

Just one digital collection

Page 32: British Library Labs Roadshow 2016 Open Data Meetup Bristol

32http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Snipping out imagesfrom 65,000 Digitised Books

Face recognition

Mechanical Curator

Flickr

Worked better for female faces than men’s

Press

http://mechanicalcurator.tumblr.com>400,000,000 views

> 500,000 tags

http://www.flickr.com/photos/britishlibrary/

1,020,418 imagesneed tagging!

Creative uses of imageshttp://goo.gl/qPPgxX

Page 33: British Library Labs Roadshow 2016 Open Data Meetup Bristol

33http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Tagging a million imagesIterative Crowdsourcing

http://goo.gl/j6fxac

Cardiff University’sLost Visions Project

http://www.metadatagames.org/

James Heald

Mario Klingemann

Chico 45

Use computational methods

Human Tagger

Top British Library Flickr Commons Taggers

Page 34: British Library Labs Roadshow 2016 Open Data Meetup Bristol

34http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Curious Images Event 2014https://goo.gl/ubL0AO

Labs Symposium 2015https://goo.gl/gRZ5Ia

44 Men who Look 44(Notice the direction faces)

Tragic Looking Women

Collage Art

Artistic (2015)Mario Klingeman - Quasimondo

Read more: http://goo.gl/dM8ieAA Hat on the GroundSpells trouble

Page 35: British Library Labs Roadshow 2016 Open Data Meetup Bristol

35http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Interview David Normal

https://youtu.be/Q3SBxO34Zlc

‘It was beyond my wildest dreams’

Page 36: British Library Labs Roadshow 2016 Open Data Meetup Bristol

36http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Finding one image on Flickr

Finding many more!Make collagesMake 4 paintingsExhibit light boxes at Burning Man 2014

In Nevada USA

Work with Labs & British Library to installLight boxes in London

In 2015

Page 37: British Library Labs Roadshow 2016 Open Data Meetup Bristol

37http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Page 38: British Library Labs Roadshow 2016 Open Data Meetup Bristol

38http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Let’s have a party!

Music mix by DJ Yoda using British Library Sounds

Exhibited from June to Nov 2015

20th June 2015

https://soundcloud.com/bbc6music/dj-yodas-library-jamInstallation in Poet’s Circle in Piazza outside at BL in St Pancras London

Images from Burning Man and Flickr brought into the Poet’s Circle

Page 39: British Library Labs Roadshow 2016 Open Data Meetup Bristol

39http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

- https://goo.gl/QilqqT By Kestrel Moon

Animating static images

Page 40: British Library Labs Roadshow 2016 Open Data Meetup Bristol

40http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

- https://goo.gl/QilqqT By Kestrel Moon

Animating static images

Page 41: British Library Labs Roadshow 2016 Open Data Meetup Bristol

41http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Adam Crymble (2015)Crowdsource Arcade

What if crowd sourcing

looked like this?

http://goo.gl/LBfJ4W

Game Jam - http://goo.gl/OH9pOZ30 mins talkLabs Symposium (2015)https://goo.gl/7z0j8p

5 min interview (2015)https://goo.gl/SSRsdd

http://goo.gl/0APpE8

Page 42: British Library Labs Roadshow 2016 Open Data Meetup Bristol

42http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Art Treachery – Januz Druz Tag Attack – Antonio Padial

Art Treachery and Tag Attack

https://www.youtube.com/watch?v=xoCgHo2rwN4

Page 43: British Library Labs Roadshow 2016 Open Data Meetup Bristol

43http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Special Jury’s Prize (2015)James Heald – Wikimedia and Map work

https://goo.gl/WYZCB2

http://goo.gl/HNQq5e

https://goo.gl/VPgffL

https://commons.wikimedia.org/

Labs Symposium (2015)https://goo.gl/djtm1b

Page 44: British Library Labs Roadshow 2016 Open Data Meetup Bristol

44http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Challenges

Page 45: British Library Labs Roadshow 2016 Open Data Meetup Bristol

45http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Starting a ConversationLanguage Problems

•Finding the intersection…

•Misunderstood words–Access–Collections–Content–Crowdsourcing

Page 46: British Library Labs Roadshow 2016 Open Data Meetup Bristol

46http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Data Problems [stuff goes in here]

•Metadata isn’t as clean as many

•Square brackets to indicate inferred information

•Code to plot when a record had square brackets by Ben O’Steen

Page 47: British Library Labs Roadshow 2016 Open Data Meetup Bristol

47http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Page 48: British Library Labs Roadshow 2016 Open Data Meetup Bristol

48http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Optical Character Recognition

Page 49: British Library Labs Roadshow 2016 Open Data Meetup Bristol

49http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Simple Data Structures

•Everything has a URL

•URL links to page which tells you about the thing

•Link to other things

•URL readable by machine not just a human

•Not there yet!

Page 50: British Library Labs Roadshow 2016 Open Data Meetup Bristol

50http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Training / Teaming up with Expert?• Many researchers have the domain knowledge but lack the technical skills to use Digital Research Methods

• Should our support be more focused on training?

• There are plenty of computational experts looking for problems to solve

• Should they be teamed up with those that have problems that need solving

Page 51: British Library Labs Roadshow 2016 Open Data Meetup Bristol

51http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

only in Reading

Rooms due to ©

only on site due to

©

not online – various storage devices

online and open

British Library

online behind paywall

Digital access at the Library

Labs Residency Modelhttps://goo.gl/tvNVRB

http://goo.gl/ii0XHG

Page 52: British Library Labs Roadshow 2016 Open Data Meetup Bristol

52http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Ideas change once you try to examine, access and use

the data!

Page 53: British Library Labs Roadshow 2016 Open Data Meetup Bristol

53http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Why is the Library doing this?

Page 54: British Library Labs Roadshow 2016 Open Data Meetup Bristol

54http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

SupportingDigital Experiments better

BL Labs Git Hub Site Re-OCRing Newspapers Flickr API

BL Explore – Search Catalogue Python Code

Page 55: British Library Labs Roadshow 2016 Open Data Meetup Bristol

55http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Lessons…•Huge appetite to use BL digital content & data (e.g. Flickr Commons stats).

•Identifying / bridging gaps for researchers to use BL data.

•Labs can help researchers navigate through the Library to get the data they want.

Page 56: British Library Labs Roadshow 2016 Open Data Meetup Bristol

56http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Perfection vs Imperfection

•If we focus too much on perfection we will never get anything done!

•Fear of failure seen as a negative thing.

•Just don’t be scared to try experiments!

Page 57: British Library Labs Roadshow 2016 Open Data Meetup Bristol

57http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Jimmy Wales, Founder of Wikipedia

Fail fasterSmall experiments!

https://goo.gl/Vlv3Yu Let yourself reboot!

Page 58: British Library Labs Roadshow 2016 Open Data Meetup Bristol

58http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Finally…

•Try and examine, use our data and talk to us about your ideas and projects!

•Consider entering the Competition and Awards!

•You never know you might….

Page 59: British Library Labs Roadshow 2016 Open Data Meetup Bristol

59http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Change the world with …British Library digital content

Page 60: British Library Labs Roadshow 2016 Open Data Meetup Bristol

60http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Accessing the Mini NASMini Network Area Storage Device (NAS) guide:

http://goo.gl/E8aRyQ

Find the ‘opendata’ wireless access point and join it. The password is ‘opendata’Accessing data foldersUsername:guestPassword:guest

Or use ftp://10.0.0.1/

Page 61: British Library Labs Roadshow 2016 Open Data Meetup Bristol

61http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Page 62: British Library Labs Roadshow 2016 Open Data Meetup Bristol

62http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

What’s on the Mini NAS?• British National Bibliography – 3.5 million records (2 Gb), in RDF XML, other

formats on request

• 90,000 Playbills – 1602 – 1902 (60 Gb), pdfs, OCR XML

• ALTO XML (includes METS and MODS) for OCR of 65,000 volumes, 22 million pages mostly from the 19th Century (909 Gb)

• 1 million images snipped from books put on Flickr (667 Gb), 70,000 tagged images (170 Gb)

• 9,000 digitised book bindings

• 130 digitised maps

• 55,000 music metadata records

• 430,00 PhD abstracts, 170,000 with text

Page 63: British Library Labs Roadshow 2016 Open Data Meetup Bristol

63http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

It’s messy but fascinating!

Page 64: British Library Labs Roadshow 2016 Open Data Meetup Bristol

64http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Goody bag!

Page 65: British Library Labs Roadshow 2016 Open Data Meetup Bristol

65http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://goo.gl/I3tBRu