analysis tools for danish newspapers · 3 dighumlab: national collaborative project: 6 partners: 2...
TRANSCRIPT
![Page 1: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/1.jpg)
20/09/2016 1
CLARIN-PLUS Workshop September 19-21 Lene Offersgaard Centre for Language Technology Faculty of Humanities
Analysis tools for Danish newspapers
![Page 2: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/2.jpg)
Analysis tools for Danish newspapers
Outline
• Danish digitised newspapers
• Statsbibliotekets Lab
• CLARIN-DKs toolbox • Converting pdf’s to text for tools
• Linguistic annotation
• Plans and visions
20/09/2016 2
![Page 3: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/3.jpg)
National Landscape in Denmark
3
DIGHUMLAB: national collaborative project: 6 partners:
2 national libraries: Royal Library and Statsbiblioteket (now merging)
4 universities: University of Copenhagen (CLARIN), University of Aarhus (DARIAH), University of Aalborg, and University of Southern Denmark
Statsbibliotektet has the responsibility of preserving the old newspapers
![Page 4: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/4.jpg)
Danish digitised newspapers
• Newspapers(still publishing) “digitising” their own newspapers http://www.kb.dk/da/nb/samling/ds/aviser/danskeaviser
“Politikken” digitised their newspapers, available for current subscribers
http://www.nordjyske-avisarkiv.dk/10 newspapers
Also some indexes, selections of articles
• Mediastream, Statsbiblioteket Now 24 mio. pages, targeting 32 mio. pagees
See list of digitised newspapers: http://www2.statsbiblioteket.dk/mediestream/avis/list
(sorry for Danish interface)
21/09/2016 4
![Page 5: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/5.jpg)
Danish digitised newspapers: Mediestream
20/09/2016 5
![Page 6: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/6.jpg)
Statsbibliotekets Labs: EXPERIMENTAL & BETA
20/09/2016 6
![Page 7: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/7.jpg)
Statsbibliotekets Labs: Smurf (beta)
20/09/2016 7
![Page 8: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/8.jpg)
Statsbibliotekets Labs: Smurf (beta)
20/09/2016 8
![Page 9: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/9.jpg)
Statsbibliotekets Labs: Smurf (beta)
21/09/2016 9
![Page 10: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/10.jpg)
Statsbiblioteket: Mediestream
20/09/2016 10
![Page 11: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/11.jpg)
Statsbiblioteket : Mediestream
20/09/2016 11
![Page 12: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/12.jpg)
CLARIN-DKs toolbox
20/09/2016 12
• Standalone tools wrapped as web services
• Workflow manager to make tools easier to choose and chains of tools easier to select for non-skilled NLP users
• NLP segmentation and annotation tools
• Corpus search: supporting special corpora
• Integration with CLARIN Language Switchbord
![Page 13: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/13.jpg)
13
Converting pdf’s to TEI text with Metadata - ready to use with toolbox
![Page 14: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/14.jpg)
14
Linguistic annotation and workflow manager
![Page 15: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/15.jpg)
15
![Page 16: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/16.jpg)
16
![Page 17: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/17.jpg)
17
Personalized annotations:
Working with formats which are easy for researchers to add information into
…. and for us to easily configure for other use cases
TEI and JSON
Plans and visions
![Page 18: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/18.jpg)
18
Timeline selection of data:
Plans and visions
![Page 19: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/19.jpg)
19
Visualization of places:
• Working on general solution, so it can be re-used for selected subcorpus
Collaboration:
Interested in fitting current and new tools to new material and research questions
Plans and visions
![Page 20: Analysis tools for Danish newspapers · 3 DIGHUMLAB: national collaborative project: 6 partners: 2 national libraries: Royal Library and Statsbiblioteket (now merging) 4 universities:](https://reader034.vdocument.in/reader034/viewer/2022051904/5ff5183a7ca37b200d1649d2/html5/thumbnails/20.jpg)
21/09/2016 20
Work done together with: Mitchell Seaton Bart Jongejan Dorte Haltrup Hansen About Smurf: contact: [email protected]
Thanks for listening!