data in switzerland: bfs at okcon 2013
TRANSCRIPT
![Page 1: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/1.jpg)
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Semantic Data!Linked Data Platform@ FSO
Adrian Gschwend (Alain Nadeau)September 2013, OKCon Geneva
![Page 2: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/2.jpg)
2 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Swiss Federal Statistical Office FSO
• Runs and co-ordinates Switzerland’s entire public statistic system
• Produces and disseminates key statistical information in• Demographics, Economy, Society, Spatial planning,
Environment• Complex analysis, interpretation and monitoring of its data
http://www.bfs.admin.ch/bfs/portal/en/index.html
![Page 3: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/3.jpg)
3 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Semantic Data!
• OpenData policy since foundation in 1860, public mandate• More than 50’000 files available as of today• 2 or 3 star format according to Tim Berners-Lee
• CSV, PX, PDF, printed books• FSO follows developments in data dissemination
• Berners-Lee 5-star• Semantic data are the future of open data
• FSO mandates Berner Fachhochschule (BFH) to pilot a study: How can existing statistical data (Census 2011) be transformed into semantic data and linked with other semantic data
http://lod-cloud.net/versions/2011-09-19/lod-cloud_colored.html
![Page 4: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/4.jpg)
4 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
We are not alone
• Wikipedia / DBpedia / Wikidata• Facebook Graph Search• Google Knowledge Graph (Freebase)• JSON-LD & RDFa (microformats)• Linked Data Cloud
Trend: Structured, graph based data!
![Page 5: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/5.jpg)
5 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Linked Data Platform for BFS
• We know our data best• Tabular publication lacks clear semantics• You might interpret a relation differently• Goal: Increase machine readability, clear vocabulary• Standard: Statistical Data and Metadata Exchange (SDMX)
http://sdmx.org/
![Page 6: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/6.jpg)
6 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Technology Stack
• Standardized graph query language: SPARQL• Ask ad-hoc questions without the performance hit
• Output formats: CVS/TSV, JSON, XML & RDF• Direct access via HTTP (data and queries)
![Page 7: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/7.jpg)
7 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
RDF
• W3C standard• Resource Description Framework• Provides various serializations (JSON, XML, Turtle etc.)• Supports internationalization by design (i18n)• Technical base for SPARQL• Federation (no need for one big DB)• In your namespace• Logic languages on top of it (RDFS, OWL)• Support in most popular programming languages
![Page 8: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/8.jpg)
8 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Prototype with FSO data
• Public SPARQL endpoint• Sample apps/visualization• Own namespace (data.admin.ch)
• Unique identifiers for every piece of data • Direct access to HTTP URIs in various
RDF formats (dereferencing)• Sample integration from different data
source (DBpedia, Google Maps)
http://www.gemeindezukunft.ch/acms/projekte/opendata/
![Page 9: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/9.jpg)
9 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Sample Applications
![Page 10: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/10.jpg)
10 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
![Page 11: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/11.jpg)
11 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
HTML view
![Page 12: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/12.jpg)
12 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Turtle Serialization
curl -H "Accept: text/turtle" http://data.admin.ch/bfs/municipality/12099
![Page 13: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/13.jpg)
13 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Turtle output
![Page 14: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/14.jpg)
14 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Same for JSON
Curl -H "Accept: application/rdf+json" http://data.admin.ch/bfs/municipality/12099
![Page 15: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/15.jpg)
15 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
JSON output
![Page 16: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/16.jpg)
16 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
JSON-LD for „classical“ web coders
curl -H "Accept: application/ld-json" http://data.admin.ch/bfs/municipality/12099
Work in progress, not implemented yet on public endpoint!
![Page 17: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/17.jpg)
17 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
JSON-LD output
![Page 18: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/18.jpg)
18 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Ask ad-hoc questions
![Page 19: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/19.jpg)
19 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Get answers your way
![Page 20: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/20.jpg)
20 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Visualize things your way
![Page 21: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/21.jpg)
21 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
![Page 22: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/22.jpg)
22 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
What you get
• The data is the API• Metadata comes with the data
• Standardized vocabulary• Standardized query language• Become your own Data Analyst and Data Scientist• Reduces ETL pain of other formats• Federation (see DBpedia integration)• You choose your output format• Built on HTTP stack (web native!)• Advanced: Schemas, RDFS & OWL
• Ask me for demos
![Page 23: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/23.jpg)
23 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
What you pay for
• Steeper learning curve• Data owner has more work to do upfront• You need to get rid of some old concepts in your head
But it‘s worth it!
![Page 24: Data in Switzerland: BFS at OKCon 2013](https://reader036.vdocument.in/reader036/viewer/2022062418/556860c6d8b42a203d8b4978/html5/thumbnails/24.jpg)
24 Semantic data!| OKCon September 2013Gschwend/Nadeau
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Outlook
• Stable namespace ?• More datasets ?• A productive, redundant platform ?• More government divisions on board?
Talk to us for questions / remarks / participation!