transparency in the digital age: the status of u.s. open government

43
By J.H. Snider, Ph.D. President iSolon.org Email: [email protected] Presented at “2010 FOI Summit: Protecting the Public’s Right to Oversee its Government” May 8, 2010 Hyatt Arlington Hotel, Arlington, VA Transparency in the Digital Age: The Status of U.S. Open Government

Upload: braden

Post on 23-Mar-2016

37 views

Category:

Documents


0 download

DESCRIPTION

Transparency in the Digital Age: The Status of U.S. Open Government. By J.H. Snider, Ph.D. President iSolon.org Email: [email protected] Presented at “2010 FOI Summit: Protecting the Public’s Right to Oversee its Government” May 8, 2010 Hyatt Arlington Hotel, Arlington, VA. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Transparency in the Digital Age:  The Status of U.S. Open Government

B yJ. H . S n i d e r, P h . D.

P r e s i d e n tiS o lo n .o r g

E m a i l : c o n t a c t @ i s o l o n . o r g

P r e s e n t e d a t“ 2 0 1 0 F O I S u m m i t :

P r o t e c t i ng t h e P u b l i c ’ s R ig h t t o O ve r s e e i t s G o ve r n m e n t ”Ma y 8 , 2 0 1 0

H ya t t A r l i n g t o n H o t e l , A r l i ng t o n , VA

Transparency in the Digital Age: The Status of U.S. Open Government

Page 2: Transparency in the Digital Age:  The Status of U.S. Open Government

Overview: The Status of U.S. Open Government

IntroductionThe Federal GovernmentThe Open Government CommunityA Vision for the Future (involving some blood,

sweat, and tears)

Page 3: Transparency in the Digital Age:  The Status of U.S. Open Government

Introduction

The merits of a glass half-full vs. half-empty critique

On the relationship between open government and technology

Page 4: Transparency in the Digital Age:  The Status of U.S. Open Government

The Federal Government

Making what’s already public more accessible Example: The Open Government Directive The weaknesses of a “high-value dataset” benchmark The advantages of a “principal-agent” benchmark

Changing what’s public (garbage in, garbage out) Information generated with the rulemaking process Information generated with legislative procedure

Page 5: Transparency in the Digital Age:  The Status of U.S. Open Government

The Open Government Community

The glass half-fullThe glass half-empty (four provocations)

Inside vs. outside lobbying strategy Advocacy vs. academic contributions Short vs. long term thinking Low vs. high industry cartelization

Page 6: Transparency in the Digital Age:  The Status of U.S. Open Government

A Vision for the Future

A different approach built on standards setting.An approach built on semantic web technologiesPrivate good case study:

Google’s product reviewsPublic good case study #1:

XBRL (automating financial reporting)Public Good Case Study #2:

BiasML (automating conflict-of-interest reporting)

Page 7: Transparency in the Digital Age:  The Status of U.S. Open Government

Human Vs. Machine-Readable

Web

Metadata

The Tree, The House,. The Door, Shirt, Pants, The

Cat, The Dog

Ontology

The Door is a part of The House

Page 8: Transparency in the Digital Age:  The Status of U.S. Open Government

Human Vs. Machine-Readable

Web

Metadata

FTC (Organization)600 Penn. Ave.

(Street)Washington (City)

DC (State)20580 (Zip Code)

Address Ontology

OrganizationStreetCityState

Zip Code

Structured Text

Page 9: Transparency in the Digital Age:  The Status of U.S. Open Government

The Hierarchy

Ontology

Metadata

Data

Page 10: Transparency in the Digital Age:  The Status of U.S. Open Government

Ontologies Turn the Web into a Giant Database

Ontology

Web Page

Database

Database

Web Page

Page 12: Transparency in the Digital Age:  The Status of U.S. Open Government

Private Good Case Study: Google’s Product Reviews

Old Snippet Format

New Snippet Format

Page 13: Transparency in the Digital Age:  The Status of U.S. Open Government

Product Reviews with Map Functionality

Page 14: Transparency in the Digital Age:  The Status of U.S. Open Government

Product Review Ontology (it’s simple)

Page 15: Transparency in the Digital Age:  The Status of U.S. Open Government

The Code (again, it’s simple)

Page 16: Transparency in the Digital Age:  The Status of U.S. Open Government

Financial Ontology (XBRL)

Page 17: Transparency in the Digital Age:  The Status of U.S. Open Government

XBRL: From Idea to Implementation

1998: W3C publishes guidelines for XML, which makes it possible to attach “tags” to each piece of information in a document; Charles Hoffman comes up with the idea for XBRL.

1999: American Institute of Certified Public Accountants (AICPA) endorses developing XBRL.

2000: AICPA releases first draft of XBRL.2002: FDIC endorses XBRL.2004: Chinese stock exchanges adopt XBRL.2005: FDIC adopts XBRL; SEC endorses XBRL.2008: U.S. GAAP published in XBRL.2009: SEC adopts XBRL for largest companies, beginning

four year rollout.Source: Karen Kernan, “The Story of Our New Language,” AICPA, 2009.

Page 18: Transparency in the Digital Age:  The Status of U.S. Open Government

Conflict-of-Interest (or Bias) Ontology

Page 19: Transparency in the Digital Age:  The Status of U.S. Open Government

Why a Conflict-of-Interest Ontology is Important

Progress progress depends on the division of labor and increasingly efficient trust mechanisms

Conflict-of-interest disclosure has become increasingly important in economics and politics Approximately 1/3rd of Americans work in a licensed

or certified occupation, with many having fiduciary obligations

Politicians and public officials all have fiduciary obligations.

Page 20: Transparency in the Digital Age:  The Status of U.S. Open Government

Structure of a Bias Ontology (it’s elegant!)

Four Key Elements of a Principal-Agent Claim1. Principal2. Agent3. Agent’s Covered Interests4. Agent’s Covered Actions

Page 21: Transparency in the Digital Age:  The Status of U.S. Open Government

Simple Example: Earmarks

For U.S. Senator Richard Shelby, the largest earmark recipient for fiscal year 2009

Source: Center for Responsive Politics, downloaded February 23, 2010

Covered Action

Covered Interests

Agent

Linkage of Covered

Interests and Covered Actions

Page 22: Transparency in the Digital Age:  The Status of U.S. Open Government

Benefits

Economies of scale in application marketsMore efficient data entry and integrationMore efficient semantic searchMore efficient and effective economic and

political markets More efficient and effective information

intermediaries (citizen and professional journalists). More efficient and effective direct consumers of

information.

Page 23: Transparency in the Digital Age:  The Status of U.S. Open Government

Critique of Current Linkage Mechanisms

Highly labor intensive; low degree of automation

Limited to relatively high value, high profile, and simple cases (such as earmarks)

Inflexible, poorly integrated data analysis

Page 24: Transparency in the Digital Age:  The Status of U.S. Open Government

Sophisticated Example: Budgets

For a state or large city, 100 million percent gain in efficiency over manual covered-interest/covered-action linking methods.

Ability to see new types of relationships never before practical to investigate.

Page 25: Transparency in the Digital Age:  The Status of U.S. Open Government

More Efficient Semantic Search

One simple query can substitute for thousands of queries over space and time

Boolean Search ExampleAgencyClaim(Arkansas Governor) and CoveredAction(Budget) and CoveredActionDates(July 1, 2009 to July 1, 2010) andCoveredInterest(All) andCoveredInterestDates(January 1, 2006 to Present)

Page 26: Transparency in the Digital Age:  The Status of U.S. Open Government

Example: Budgets (no bias ontology)

Expenditures for the State of Arkansas across all state agencies, fiscal year 2010

Page 27: Transparency in the Digital Age:  The Status of U.S. Open Government

Example: Budgets (with bias ontology)

Expenditures for the State of Arkansas across all state agencies, fiscal year 2010

Drill Down Covered

Interests Alert

Contributions

$87,300

$131,600

$400

Covered Interests

Covered Actions

Page 28: Transparency in the Digital Age:  The Status of U.S. Open Government

Example: Budgets (drill down view)

DTA – Transportation, Department of, fiscal year 2010

Drill Down

Contributions

$87,300

$87,300

Page 29: Transparency in the Digital Age:  The Status of U.S. Open Government

Elected Officials and Voters

Page 30: Transparency in the Digital Age:  The Status of U.S. Open Government

Doctors and Patients

Page 31: Transparency in the Digital Age:  The Status of U.S. Open Government

Publishers and Authors

Page 32: Transparency in the Digital Age:  The Status of U.S. Open Government

Brokers and Clients

Page 33: Transparency in the Digital Age:  The Status of U.S. Open Government

Disc Jockeys and Listeners (payola)

Page 34: Transparency in the Digital Age:  The Status of U.S. Open Government

TV News and Viewers (product placement)

Page 35: Transparency in the Digital Age:  The Status of U.S. Open Government

Movies and Viewers (product placement)

Page 36: Transparency in the Digital Age:  The Status of U.S. Open Government

Bloggers and Readers

Page 37: Transparency in the Digital Age:  The Status of U.S. Open Government

Highlights

Conflict of interest displayed within the review

Reader chooses how the conflict of interest is displayed, e.g., with a highlight, footnote mark, underline, or box

Reader chooses what is a material conflict of interest for display.

Covered Interests

Alert

Page 38: Transparency in the Digital Age:  The Status of U.S. Open Government

Summary

Product Review

OntologyFinancial Ontology

ProposedBias

OntologyComplexity Simple Complex MediumPrivate vs. GovernmentStandard Setter

PrivatePrivate-

Government Partnership

Private-Government Partnership

Government Incentive

N.A. High Varies by Application

PrivateIncentive

High High Varies by Application

Extensible No Yes Yes

Page 39: Transparency in the Digital Age:  The Status of U.S. Open Government

Problems with the Market Solution

The Public Goods Problem Standards development is expensive and participants have free

riding incentives. Ontology use has significant network effects/positive externalities.

The Google Problem Google cannot develop and endorse every potentially useful

ontology. Most industries don’t have a single competitor with 70%+ market

share.The Conflict of Interest Problem

Private entities may not want to endorse ontologies that reduce their market power.

Private entities may lack the means to enforce the use of ontologies.

Page 40: Transparency in the Digital Age:  The Status of U.S. Open Government

Major Public Policy Issue:Degree of Ontology Database Integration

MaximumPrivate-Government Partnership

ExamplesXBRL, Bias Ontology

MediumGovernmentwide

ExampleTerrorist Ontology

MinimumSpecific Government

ExampleLegislative Ontology

Page 41: Transparency in the Digital Age:  The Status of U.S. Open Government

Conclusion

Caveat: automation will be imperfectImplementation timeframe: it will be longImplications for the open government and

media reform communities: standards setting will have to become part of the public policy agenda

Page 42: Transparency in the Digital Age:  The Status of U.S. Open Government

For more information,go to www.isolon.org

If you are interested in joining a standards group to develop a conflict-of-interest

ontology, please email [email protected].

Page 43: Transparency in the Digital Age:  The Status of U.S. Open Government