locloud geolocation enrichment tools: on the map

42
On the Map (Stein) Runar Bergheim (@runarbe) Asplan Viak Internet AS

Upload: locloud

Post on 14-Jan-2017

277 views

Category:

Internet


5 download

TRANSCRIPT

Page 1: LoCloud geolocation enrichment tools: On the Map

On the Map

(Stein) Runar Bergheim (@runarbe)

Asplan Viak Internet AS

Page 2: LoCloud geolocation enrichment tools: On the Map

Who am I?

• I, (Stein) Runar Bergheim work for AVINETA small but perfectly shaped Norwegian tech company operating in Norway, Europe and the Middle East

• Been part of the community around Europeana since 2008EuropeanaLocal, CARARE, PATHS - and presently LoCloud

• Feel privileged to be part of a project and community with brilliant people bringing forward the accumulated results of many Europeana projects

Page 3: LoCloud geolocation enrichment tools: On the Map

Just and ID, I thought…

• Identifiers: Numbers to find an item in a list, I thought• Intelligent identifiers in the digital era: the product of

deranged minds, I still think

• Little did I know about the people, resources engagement and community working eagerly to attach value-added information to the records identified by these strings and numbers – before I embarked on my journey with Europeana

Abc/1234_2334/12-1a/45:2

nbenfjglo000000001

Page 4: LoCloud geolocation enrichment tools: On the Map

Enrichment and data quality

Who What When Where

Page 5: LoCloud geolocation enrichment tools: On the Map

Location is greatFits «everything» togetherIs language independentThe «perfect» way of integrating heritage

(but brings with it it’s own set of challenges)

Page 6: LoCloud geolocation enrichment tools: On the Map

Geography excellentfor exploration

I know what I am looking for and I know it exists in there

I am interested in information that is relevant to my location/place

DatabaseMap

Page 7: LoCloud geolocation enrichment tools: On the Map

Location of a single object

Page 8: LoCloud geolocation enrichment tools: On the Map

Search and exploration

Page 9: LoCloud geolocation enrichment tools: On the Map

Visualization of related objects

Page 10: LoCloud geolocation enrichment tools: On the Map

The 19th centuryexploits of «Viking Danske»

Eivindvik

SvanøyAskrova

Kalvåg

MåløySelje

Source: «church books, birth registry»

Page 11: LoCloud geolocation enrichment tools: On the Map

So it is all good then?

Page 12: LoCloud geolocation enrichment tools: On the Map

well, there’s a tiny problem!Location is all but absent in most of the metadata contributed to EuropeanaMay exist «by proxy» Geographical names Contextual location (focus of collection, location of institution etc)

But to exploit the potential – we need coordinates

Page 13: LoCloud geolocation enrichment tools: On the Map

So how can we get coordinates?

Automatic geocoding Non-trivial but perfectly doable task Based on what exist in our metadata… Named entity extraction / geographical names Street addresses Property gazetteer identifiers

Page 14: LoCloud geolocation enrichment tools: On the Map

Sounds (too) good…What’s the catch? Can only find coordinates if metadata references

locations Typically finds «intermediate» resolution locations, i.e.

village, city, municipality etc. False «hits» due to common names i.e. «Blue

Mountains» Ambiguous hits – more than one hit per object Requires quality assurance

Page 15: LoCloud geolocation enrichment tools: On the Map

?

Page 16: LoCloud geolocation enrichment tools: On the Map

How to improve accuracy?There are two optionsA. Add locations to your metadata records manuallyB. Simply don’t do it; wait (or hope) for someone else to do it for

you

If you go for Option A Try to harness the knowledge and experience of individuals to

place your digital objects on the map It is urgent – the pyramids may not be forgotten so easily but

pieces of local history become extinct every day

Page 17: LoCloud geolocation enrichment tools: On the Map

Manually, you say…?

Page 18: LoCloud geolocation enrichment tools: On the Map

That is too much work! Just think about A, B, C … Z

It will certainly involve a lot of work and nobody says it is easy.

But it is made a great deal easier with the proper tool And this is where LoCloud and this presentation comes in…

And you can always ask for help; «the crowd» is out there …and if the Norwegian-American emigrant crowd is anything to go by – they

are active and committed, occasionally bordering on requiring a restraining order.

Page 19: LoCloud geolocation enrichment tools: On the Map

Principle: Enrichment at ornear source

Collection

management syste

m

Aggregator

Europeana

Page 20: LoCloud geolocation enrichment tools: On the Map

LoCloud’s approachWe’ve built a tool that allow you to add detailed geolocations to any existing data

Page 21: LoCloud geolocation enrichment tools: On the Map

Allow me to explain

Upload you

r data

as tables

Enrich

your content

using the

appliation

Download data

as tables, SQL statements or RDF

Update

your original

data source

Any is a «big word»

Page 22: LoCloud geolocation enrichment tools: On the Map

Prepare file

Only requirement is a unique id, a descriptive

title is helpful

Page 23: LoCloud geolocation enrichment tools: On the Map

Log in: http://locloud.avinet.no/demo

user

*****

Page 24: LoCloud geolocation enrichment tools: On the Map

Overview of User Interface

List of data sources

Top menu

List of items to be geotagged Geotagging,

editing form

Search databases

User management

Map, map tools

Search results

Page 25: LoCloud geolocation enrichment tools: On the Map

Upload data source

Page 26: LoCloud geolocation enrichment tools: On the Map

Create users

Page 27: LoCloud geolocation enrichment tools: On the Map

Assign access to users

Page 28: LoCloud geolocation enrichment tools: On the Map

Select data source

You can have many data

sources and control who

has access to do what with each source

Page 29: LoCloud geolocation enrichment tools: On the Map

Select item

Select, filter and navigate

your uploaded

data sources

Page 30: LoCloud geolocation enrichment tools: On the Map

Specify geometry

You can add points, lines or polygons

Page 31: LoCloud geolocation enrichment tools: On the Map

Select from different base maps

Mainstream web maps – but also

INSPIRE compliant map services

Page 32: LoCloud geolocation enrichment tools: On the Map

Edit attributes as well as location

Propose edits to title or any other

attribute

Page 33: LoCloud geolocation enrichment tools: On the Map

Set quality

Confidence is stored

Map resolution is

stored

Page 34: LoCloud geolocation enrichment tools: On the Map

Search for entities

Select from available

names sources: geonames,

LoCloud APIs,National

gazetteers

Page 35: LoCloud geolocation enrichment tools: On the Map

Click to openwith same

extent

Use alternative sources

Page 36: LoCloud geolocation enrichment tools: On the Map

Download data

Download as GeoJSON, KML,

RDF or CSV

Page 37: LoCloud geolocation enrichment tools: On the Map

Test in Google Earth

Page 38: LoCloud geolocation enrichment tools: On the Map

Where from here…?

• Visit: www.locloud.eu to learn about LoCloud

• A demo version of the tool is available to be tried out at locloud.avinet.no/demo

• If you want a user account or an introduction, email [email protected]

• Tool available under supported and GPL license –available for free on GitHub for «self-hosters»

Page 39: LoCloud geolocation enrichment tools: On the Map

Is it used?

• Yes, quite a lotBy ASPLAN VIAK AS – a Norwegian consulting engineering company (owner of AVINET)By NORPLAN AS – an international consulting partnership with an emphasis on South-Asia, Middle-East and Sub-Saharan AfricaBy the Ministry of Tourism in the Sultanate of Oman

The first user and the one who provided the requirements and specifications for the tool was the National Archives of Norway – big thanks.

Page 40: LoCloud geolocation enrichment tools: On the Map

Adding geolocation to your data:Is it worth the effort?

• You must assess for yourselfIf your mission is isolated to preserving historical records/information that are not in themselves geographical by nature, then maybe not.If your mission includes engaging the interest of your users and help them explore your content, then we believe yes.

• Catalogs and databases are tools for people who already know what they are looking for

• Maps are tools for explorers

Page 41: LoCloud geolocation enrichment tools: On the Map

…at the endof the road

Through LoCloud, AVINET has enjoiyed the experience of standing on the proverbial «shoulders of giants»…As we are approaching the end of our journey together – a big thanks to all of you – and in particular to Kate Fernie for managing our mostly benign but somewhat unruly partnership.

Page 42: LoCloud geolocation enrichment tools: On the Map

Thank you for the attention(assuming you paid any)

Stein Runar BergheimDirector of Research & Development

Asplan Viak Internet AS