open data in san francisco - slac conferences, workshops ...€¦ · open data in san francisco joy...
TRANSCRIPT
![Page 1: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/1.jpg)
Open Data in San Francisco
Joy Bonaguro Chief Data Officer
City and County of San Francisco XLDB 2015, May 20, 2015
![Page 2: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/2.jpg)
Phases of Open Data Phase 1: The Executive Edict
Phase 2: The Publishing Scramble
Phase 3: The Period of Stagnation
Phase 4: The Resource Reckoning
Phase 5: The Integration of the Initiative
![Page 3: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/3.jpg)
CENTRAL HYPOTHESIS: DataSF can help solve our internal data sharing challenges
![Page 4: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/4.jpg)
How to Broaden the Value of Open
Data?
![Page 5: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/5.jpg)
Knowledge
Ability Access
© Emw / Wikimedia Commons / CC-BY-SA-3.0
![Page 6: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/6.jpg)
Knowledge, mural by Robert Lewis Reid. Second Floor, North Corridor. Library of Congress Thomas Jefferson Building, Washington, D.C.
IGNORANCE IS THE CVRSE OF
GOD
KNOWLEDGE IS THE WING
WHEREWITH WE FLY TO
HEAVEN.
![Page 7: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/7.jpg)
“Within six months, each
Department shall publish on
DataSF a catalogue of
their Department's
data that can be made
public, including both raw
datasets and APIs”
![Page 8: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/8.jpg)
![Page 9: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/9.jpg)
![Page 10: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/10.jpg)
![Page 11: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/11.jpg)
![Page 12: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/12.jpg)
http://irisclasson.com/2013/03/14/stupid-question-163-what-is-dogfooding/istock_000015884355small/
![Page 13: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/13.jpg)
Knowledge
Ability Access
© Emw / Wikimedia Commons / CC-BY-SA-3.0
![Page 14: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/14.jpg)
![Page 15: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/15.jpg)
Hey! You got this data?
Maybe…
Can I have it?
Hello????
Here it is…
Thanks! Some ?s…
Question death spiral
Task: Update Data
Task: Obtain Data
See previous
![Page 16: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/16.jpg)
Publication Automation
![Page 17: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/17.jpg)
![Page 18: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/18.jpg)
The Balancing Act
Privacy Transparency & Open Data
![Page 19: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/19.jpg)
HIPAA
FERPA HMIS Rule 603
Child & Welfare
CMIA
SB1386
42 CFR 2
Health & Safety Code
Welfare & Institutions Code
AD Ch 20, 16, 12m….
Health Code
Penal Code
Police Code
Business & Tax Code
![Page 20: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/20.jpg)
Data Inventory and Raw Classification
Raw Classification Description
Public This data could be publicly disseminated without any concerns
Protected This data is protected by law or regulation and can only be shared or accessed internally and per organizational procedures; OR this information includes individually identified information
Sensitive In its raw form, this data poses security concerns, could be misused to target individuals or poses other concerns.
![Page 21: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/21.jpg)
Survey of Applicable Laws
Raw Classification Description
Public This data could be publicly disseminated without any concerns
Protected This data is protected by law or regulation and can only be shared or accessed internally and per organizational procedures; OR this information includes individually identified information
Sensitive In its raw form, this data poses security concerns, could be misused to target individuals or poses other concerns.
![Page 22: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/22.jpg)
More Process & Control Points
Fast releases Thorough process
![Page 23: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/23.jpg)
Defining your methods
Standard Methods
Consistent technical implementation
![Page 24: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/24.jpg)
Plug and play regardless of
backend Probabilistic matching with
expert curation Role based access control
down to the column level Legally aware
Joy’s
Holiday
Wishlist
(cheap too, please!!
;-)
![Page 25: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/25.jpg)
![Page 26: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/26.jpg)
![Page 27: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/27.jpg)
Knowledge
Ability
Access
© Emw / Wikimedia Commons / CC-BY-SA-3.0
![Page 28: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/28.jpg)
Within an EcoSystem of Shared Data and Technology
1. Increase individual skills & capacity
2. Support analytics in departments
3. Foster a data-enabled policy environment
Which leads to… Increased use of data in decision-
making
![Page 29: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/29.jpg)
![Page 30: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/30.jpg)
Schedule friendly
Free ;-) Demand driven
![Page 31: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/31.jpg)
What…does the city do about affordable housing?
Where…do you go for reliable data about
affordable housing?
The answers are the problem…
not sure
X and Y and Z and Q and…
Not possible!
The solution…Housing Data Hub Single place: • Housing overview • Description of policies and
programs • Supporting data & viz
![Page 32: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/32.jpg)
housing.datasf.org
![Page 33: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/33.jpg)
enduring sources of truth
&
unbroken data lineages
![Page 34: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/34.jpg)
Strategic releases help
democratize how
governments disseminate their data
for a local audience that may be focused on issues
(not just apps).
![Page 35: Open Data in San Francisco - SLAC Conferences, Workshops ...€¦ · Open Data in San Francisco Joy Bonaguro Chief Data Officer City and County of San Francisco XLDB 2015, May 20,](https://reader034.vdocument.in/reader034/viewer/2022050422/5f910fc9f514c805f4525042/html5/thumbnails/35.jpg)
THANK YOU @datasf | datasf.org |datasf.org/blog
Questions?