open data
DESCRIPTION
EU Russia Innovation Forum 2011 May 24, 2011TRANSCRIPT
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
The Vision of Revolution 2020
24.5.2011
From Closed Systems to Open Data and Information
Harri Luuppala, Owner
Open Invest Oy
V 1.2
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
My relevant background
● Born 1958, Vammala, Finland● Last 20y Tieto Corp.
● Telecom, Banking, Insurance, Media, Manufacturing● Biz in Nordics, Baltics, UK, US, China, Portugal,...● Founder of Mobile Phone SW RD Biz incl.
Outsourcing biz (Nokia, Nokia Siemens Networks)
● Before Tieto● Instrumentarium● Valmet / Metso
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
From Closed Systems to Open Data and Information
Playground Open Data &Information
Vision 2020
Demand
A BriefHistory
Supply
Some Stories
All technologyis available.
But are we ready?
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Part 1Playground
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
You need to understand my reasonings – so be patient!
● Markets with Asymmetric Information● Information Theory● From Open Source to Open Data● Disruptive Ideas and Ability to Vision● We need a solution for Asymmetric Information!● WEB 2.0 is coming – are you ready?
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Markets with Asymmetric Information
● Akerlof, Spence, Stigliz, Nobel Prize 2001
● Realistic assumtion of Asymmetric Information (AI): Agents on one side of the market have much better information than those on the other side.● Akerlof: ”lemons paper” = study of used car markets
Sociology, Social antropology … → Economic Theory of AI
● Spence: – Market Signaling i.e education is signaling of productivity on labor markets
– New theory of Industrial Organisation
● Stiglitz:– Insurance company as the uninformed party gets information through
screening of customers i.e. risk classes
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Information TheoryChannel theory
Maximum mutual information/Channel capacity:
Coding theory, two aspects namely:
Data compression (or, source coding)Error correction (or, channel coding)
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Distruptive Ideas1. The World first major competition won by a voluntary SMS campain started by Finnish youths!
Won for Finns enabled by the SMS campaign
May 9, 2005, as a commentary outlet and alternative to news websites like the Drudge Report.[3] On February 7, 2011, AOL acquired The Huffington Post for US$315 million making Arianna Huffington editor-in-chief of The Huffington Post Media Group
2. Huffington Post guessed in Jan 2011 and NOW WE KNOW, there is a TREND!
The Revolution enabled byFacebook
3. Vision 2020Solution for Asymmetric Infor-mation by Open Data
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
We need a solution for Asymmetric Information!
Huffington Post May 22, 2011
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Web 2.0 is coming – are you ready?
Tommi Mikkonen, Antero Taivalsaari
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Finnish Road to Open IT A Brief History
● Finnish Goverment decided 1989 to use only Open Systems. Project (1987-1989) was called T-90 or Toimisto-90 ● At that time Denmark and Sweden did similar decisions. The standard was
a guide for buyers:
– Buy Unix and later on Posix compatible (i.e. OS/2) for Servers...
– Relational Databases (Oracle got a strong position in Finland)
– Open Standards for documents/data● ISO 8859/1 character set preferred
● Government and Industry moved to Unix based servers 1986-2006. ● Peak was 1993-2000 – the depression 1993 and Euro+Y2K before 2000
pushed organisations to Unix (and OS/2) based Open Systems
● Today trend is to Linux based systems
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Part 2Open Data and Information
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
From Open Source to Open Data
● Open Source ● SW: Kermit → LibreOffice
● Open Systems ● OS: Unix → Linux (Unix = many unixes)
● Open Standards ● DeJure (OSI, IEEE, Oasis,...)
– ISO i.e. OSI, IEEE i.e. Posix, Oasis i.e. ODF
● DeFacto (Linux, ...)
– Finnish Linus Torvalds had no money to buy IEEE Posix std → he used instead Open Solaris (Sun) as the base for Linux
● Open Interfaces (API, M2M, A2A, HCI,..)● Data Catalog, Interface(s), Metadata, Version and Lifecycle mgmt
● Open Data (vs Closed Data)● Public or Private
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Open Data
● Open science data● No common agreed definition
● The International Council of Scientific Unions (now the International Council for Science) established several World Data Centers to
– minimize the risk of data loss and
– to maximize data accessibility,
– further recommending in 1955 that data be made available in machine-readable form
● Creators of data often do not consider the need to state the conditions of ownership, licensing and re-use. ● However the lack of a license makes it difficult to determine the status of a data
set and may restrict the use of data offered in an Open spirit.
● Because of this uncertainty it is also possible for public or private organizations such as IEEE to aggregate said data, protect it with copyright and then resell it.
--> OPEN ≠ FREE
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
History of Public Open Data- a Finnish point of view
FI 1989 Open Systems (Unix, RDBMS,...)FI 1994 Collect data once only (STP)FI 2008 Somus (Social media R&D)FI 2009 eAMSUS 2009 Open GovernmentUK 2009 Digital BritainFI 2009 Public eServices & eAdministrationFI 2009 Apps for Democracy Finland FI 2010 Public Open Data GuideFI 2011 The State owned Broadcasting
Company YLE decided to Open Data
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
EU PSI Directive (2003)
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Open Data in Finland:data.suomi.fi
Public Open Data, Finland
Data Catalog = All public open data is listed here
http://www.facebook.com/group.php?gid=102381085627
Public Open Data – the guide published in Feb 2010
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Gov Open DataUnfortunately Gov pages only in Finnish (May 2011)
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Apps for Democracy FinlandWinner 2009
Brances and Leafs:Budget and Spending
Roots:Income
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Apps for Democracy Finland Prize
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Finnish Government has a well defined architecture to serve
● FI State Treasury: http://www.netra.fi
All data could beavaillable from thesame service-point
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Government Archive Standard: Sähke2
Will lead from imitation of static paper document to a dynamic decision support system
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Open Data - SUPRISECase 1 - Climategate
Climate scientists and organisations pledged to restore public confidence in the research process by improving data management and opening up access to data
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Open Data - RESPONSIBILITYCase 2 – Finnish Hunters + FB
Register of Hunting CardsRegister of Hunting Cards
+ = ?Official testOfficial test
ApprovalApproval
Hunting card – license to kill.Possible owner of a legal gun.
Hunting card – license to kill.Possible owner of a legal gun.
License to stealLicense to steal
This issue (hunting card + fb) is raised by Ilkka Lehtinen / COSS
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Open Data – EARLY BIRDCase 3 – Proposal Phase
Proposal from Ministry ofTransportation andCommunication 2011
Availability and reusability of Public data
Right to use and mainly free of charge
Common Metadata and Data Catalog
Networking and reward to open public data
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
KAMU
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Vaalilupausarkisto(Promised by politicians)
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Journey Planner
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
TilannehuoneSituation Room
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Boost innovationsFrom single sheet to complex ideas
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Boost innovationsFrom single sheet to complex ideas
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Identified challanges for Government of Finland
● External● Demand from EU, cizisens and other learers of information society (UK,
Sweden, US...) to Open Data
● Licenses/agreements to reuse data as Open Data
● Internal● Pricing models – high prices → low usage → few users → few innovations /
benefits for society
● Uncompatible systems → unnecessary costs → higher prices and poor information i.e. Healtcare
● Missing definitions / agreements for ownership and copyrights of government data
● Missing open infrastructure of information i.e. Data Catalogs → diffuclt to find Data Sets
● Poor technical structure for reuse of data
● Missing culture/attitude/reward and target setting models to open data
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Part 3Vision 2020
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
WEB 2020
Tommi Mikkonen, Antero Taivalsaari
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Idea of Pöyry
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Mashup w/ Qt
Tommi Mikkonen
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Vision 2020
OpenStreetMap.org
Database
Metadata
Mashup
Location People Job
Data Catalog =Interface to Russia
Data Catalog
Open Data+
Mashup =
Innovations
Information
Knowledge
Wisdom
Data
Solutions for Asymmetric Information!
SignalingScreening
Maximum mutualInformation/Channel capacity
(c) 2011 Luuppala, Kamppuri
(c) 2011 Harri Luuppala, Heikki Kamppuri
All trademarks, images, and other referenced materials are the property of their respective owners
Thank you!