governmental linked data

Haklae Kim, PhDEmail: haklae.kim@gmail.com

Governmental Linked DataFeel free to re-use or mash-up this presentation under Creative Commons 2.0 licence (non-commercial, attribution)

Thanks to Alain Thys (http://www.slideshare.net/alainthys). This slide uses his template and some pictures from his slides.

Introduction Open Data and Open Government Data

Governmental Linked Data & The

Semantic Web

Summary

This Presentation .....Today

2

OpenStreetMap - Project Haiti

The World Wide Web: "vague, but exciting"

a system of interlinked hypertext documents accessed via the Interne

4

Quiz: Which % of world governments have a Web site?

98%

A great first step …….

Objectives

• Improve impact of investments• Reach citizens more easily (G2C)• Reach businesses more easily(G2B)• Improve inter-agencies

communications (G2B)• Providing services to more people,

organizations (e-inclusion)• Involving more people, organizations

in government activities, capturing feedback, etc (e-participation)

e-Government

Using the Web and ICT to serve consistencies better

Governments move to digital age!

6

Introduction Open Data and Open Government Data

This Presentation .....Today

7

Governmental Linked Data & The

Semantic Web

Summary

One-stop shop portals not entirely

successful

- People typically don’t use official websites- Not necessarily user-oriented,

interesting- Expensive

e-Government:Challenges

The simplistic assumption that e-governance is all about technology, and notreform, is one of the main reasons why many an e-government project fails. Onlycountries strong in governance and committed to reform can hope to succeed intheir e-government efforts. - K. Ashok Vardhan Shetty, 2003

Source: http://www.thehindubusinessline.com/2003/11/15/stories/2003111500050800.htm

8

Definition

WHAT IS OPEN GOVERNMENT DATA?

“Open”

material (data) is open if it can be freely used, reused and redistributed by anyone

“Government data”

data and information produced or commissioned by government or government controlled entities.

Source: Open Knowledge Foundation, 2010

9

Government 2.0 is the DEMOCRATIZATION of government processes, services and data.

Open Government = Gov 2.0

• Gov 2.0 is an attempt to revolutionize government and the way that government does business

• Gov 2.0 allows for complete transparency, collaboration, participation, and innovation by incorporating emerging technologies.

• Gov 2.0 is a helpful and quick way to get in touch with the government and connect employees and programs

• Gov 2.0 gives users the choice to interact or collaborate in a social media dialogue as well as being in a virtual community

10

TRANSPARENCYbe able freely to access government data

and information and to share that information with other citizens.

RELEASING SOCIAL AND COMMERCIAL VALUE

the creation of innovative business and services that deliver social and commercial

value

PARTICIPATORY GOVERNANCEmaking a full “read/write” society, not just about knowing what is happening in the governance process but being able to

contribute to it.

WHY OPEN GOVERNMENT DATA?

11

“Information maintained by the

Federal Government is a national asset.”

President Obama January 21, 2009

Transparency and Open Government

12

Data.gov

• The first phase of Data.gov features downloadable federal data sets organized by category and federal organization.

• Data sets are available for download in XML, CSV, and shape file formats.

Launched on May 21, 2009, Data.gov allows citizens to participate by leveraging federal data sets to build applications, conduct analysis, and perform research.

13

Data.gov.uk

Establishment of the Public Sector Transparency Board chaired by Francis Maude, Minister for the Cabinet Office

The Board will be responsible for setting open data standards across the public sector, publishing further datasets on the basis of public demand

Prime Minister, David Cameron, writes to all government departments, 31 May 2010: instructing them to free up more datasets as part of Transparency Agenda

14

http://www.practicalparticipation.co.uk/odi/wp-content/uploads/2010/06/Open-Data-Impacts-Timeline-Draft-0.1.png15

http://datos.fundacionctic.org/sandbox/catalog/map

The State of Government Open DataPublic Sector Dataset

data.gov

datasf.org

data.edmonton.ca

data.gov.uk

data.london.gov.uk

digitaliser.dk

geodata.gov.gr

data.suomi.fi

gov.opendata.at

data.reegle.info

opengovdata.ru

16

ApplicationsCase Studies

17

Postcode Newspaper Where Does My Money Go World Events Visualiser Guardian Data Store

1. Complete: All public data is made available. Public data is data that is not subject to valid privacy, security or privilege limitations.

2. Primary: As collected at the source, with the highest possible level of granularity, not aggregate or modified, not via form-based queries.

3. Timely: Made available as quickly as possible and necessary.

4. Accessible: Available to widest range of users for widest range of purposes.

5. Non-discriminatory: Available to anyone, with no requirement of registration

6. Machine-processable: Structured to allow automated processing.

7. Non-proprietary: Available in an open, standard, format over which no entity has exclusive control.

8. License-free: Not subject to copyright, patent, trademark or trade secret regulation. Reasonable privacy, security and privilege restrictions are allowed.

Open Government Data 8 Principles

Source:http://www.opengovdata.org/home/8principles

A work is open if its manner of distribution satisfies the following conditions:

18

Introduction Open Data and Open Government Data

This Presentation .....Today

19

Governmental Linked Data & The

Semantic Web

Summary

Semantic WebMachine-understandable Information: a web of data, in some ways like a global database.

“I have a dream for the Web [in which computers] become capable of analyzing all the data on the Web – the content, links, and transactions between people and computers. A ‘Semantic Web’, which should make this possible, has yet to emerge, but when it does, the day-to-day mechanisms of trade, bureaucracy and our daily lives will be handled by machines talking to machines. The ‘intelligent agents’ people have touted for ages will finally materialize.”– Tim Berners-Lee, 1999

20

HTTP

World Wide Web

URI HTML

21

.. a reference in a hypertext

document to another document or other resource

An essential concept

Link

22

Data on the Web is

broken.

23

How many different types of links on the web...

document

We are already in these links...

connectsconnects document

services connectsconnects services

people connectsconnects people

24

All data including documents, services, people ...

DATA DATAlinkslinks

The Semantic Web: Web of Data

25

Linked Data != the Semantic Web

웹 2.0시맨틱 웹

소셜 웹웹 3.0

메타 웹

26

• Use URIs as names for things• Use HTTP URIs so that people can look up those names• When someone looks up a URI, provide useful information, using the standards• Include links to other URIs so that they can discover more things

Linked Data

27

HTTP

Principle

URI RDF

Web of Data

28

Step 1: Understand the principles

Five Steps to publish linked dataA quick overview

Step 2: Understand

your data

• What are the key things present in your data?(People, Places, Events, Books, Films, Photos, etc.)

• What vocabularies can be used to describe these?(FOAF, SIOC, Dublin Core, SKOS, etc)

29

Step 3: Choosing Cool URIs

• use HTTP URIs http://example.com/thing Thing http://example.com/thing.rdf RDF data http://example.com/thing.html HTML page

• dereferenceable URI (hash or slash)

Step 1: Understand the principles

Five Steps to publish linked dataA quick overview

Step 2: Understand

your data

• What are the key things present in your data?(People, Places, Events, Books, Films, Photos, etc.)

• What vocabularies can be used to describe these?(FOAF, SIOC, Dublin Core, SKOS, etc)

30

Step 3: Choosing Cool URIs

• use HTTP URIs http://example.com/thing Thing http://example.com/thing.rdf RDF data http://example.com/thing.html HTML page

• dereferenceable URI (hash or slash)

Step 4: Setup infrastructure

Five Steps to publish linked dataA quick overview

31

a mechanism defined in the HTTP specification that makes it possible to serve different versions of a document (or more generally, a resource) at the same URI, so that user agents can specify which version fit their capabilities the best.

- Test your content negotiation (install the LiveHTTPHeaders and

Modify Headers extentions for Firefox)

Step 5: Link to other available data sets

Five Steps to publish linked dataA quick overview

32

Linking methods - Linking Algorithms, String Matching, Common Key Matching, Property-based Matching

Popular predicates for Linking - owl:sameAs - foaf:homepage and foaf:page - foaf:topic and foaf:primaryTopic - foaf:based_near - foaf:maker - rdfs:seeAlso

2006

2007

200833

Source: http://richard.cyganiak.de/2007/10/lod/lod-datasets_2010-09-22_colored.png

34

Linking Open Data (LOD) Constellation UMBEL(Upper Mapping and Binding Exchange Layer)

A lightweight, subject concept reference structure for the Web

35

A vocabulary onion, building on FOAF, SKOS, SIOC, SIOC Types, DC

36Source: John Breslin, http://www.slideshare.net/Cloud/the-future-of-social-networks-on-the-internet-the-need-for-semantics

37

Disconnected sites on the Social Web / Web 2.0 can be linked using Semantic Web vocabularies

37Source: John Breslin, http://www.slideshare.net/Cloud/the-social-semantic-web

ApplicationsCase Studies

38

DBPedia BBC New York Times Musicbrainz

Quiz: Why We should care about the Semantic Web?

Links at a semantic level

Integration

A second step …….

• As ‘raw’ as possible before analysis• XML, CSV/TXT, RSS, Keyhole Markup Language

(KML/KMZ), ESRI Shapefile• Avoid datasets in the following formats: PDF and HTML

(e.g., HTML tables containing data)

• Machine readable• Preference for structured datasets• Data that can be used for multiple purposes• Data that is largely free from interpretation and value

judgments (observational, unbiased data)• Datasets that can be mashed-up with others (brought

into context using lightweight web programming techniques and technologies)

Machine readable formats

However, the Semantic Web can add more valuesRaw Data is useful

40

Open Data starts with making available the data that you already have, in whatever format.

• Equal access for all• Licensing, legal issues• Transparency• Changing the way government works

Open Data vs Linked DataA quick overview

Open Data

Linked Data • URIs• HTTPs• RDF vocabularies• Standards

41

Linked Government DataCase Studies

42

UK Data-Gov Wiki Ordnace Survey U.S. Census

5Stars

plan for open government data

Put your data on the Web

Make it available as machine readable

Use open, standard formats

Use a open data format – URLs, descriptions

Link your data to other people’s data

★★

★

★★★

★★★★

★★★★★

43

Introduction Open Data and Open Government Data

This Presentation .....Today

44

Governmental Linked Data & The

Semantic Web

Summary

Data.gov, along with a number of other data-related sites of the government such as USAspending.gov and Apps.gov, are slated to be shut down due to budget cuts. The current annual budget of $37 million will be reduced to $2 million. – (Guardian April 11)

Reality Check

Data.gov in crisis

45

Difficult

Loss of licensing revenueLoss of controlLegal challengesUnwelcomed exposureProcedural changesPrivacyNational securityComplexityInvestmentQuality and AuthenticityCorruption, falsification of dataCustomer service

Requires

Authority, Public Administration Readiness, and Civic Interest and Readiness

Reality Check

Concerned and Hurdles

46

RebuildFireout

“We won’t get there tomorrow, but maybe the day after” – Rufus Pollock

How to Start

Low-hanging fruit, Less conversational data and quick wins.

Expand, with more…..

DataServicesEfficiencyCosts savingTransparencyParticipationInclusion

47

The Web is not “Technology”. It is “humanity connected by technology”

Open Government Data is cost-effective tool for governments to improve service to citizens, civil society and business.

Linked Data and open data are often used interchangeably, but they are not the same thing.

Linked Data is data that is structured in such a way that data sets can be combined to create something greater than the sum of its parts.

Linked government data will interconnect different datasets across local governments, organizations, and nations.

Web, Data, and the Semantic WebSummary

48

For more information contact Haklae Kim via

haklae.kim@gmail.comTwitter: haklaekim

Or read up on the sonagi blog at:

http://blogweb.co.kr