algorithmic accountability reporting | journalism interactive 2014
DESCRIPTION
Talk on "Algorithmic Accountability Reporting" by Nicholas Diakopoulos, a computer scientist, Tow Fellow at the Columbia University Journalism School and incoming member of the faculty at the Philip Merrill College of Journalism.TRANSCRIPT
Algorithmic Accountability Reporting: On the
Investigation of Black Boxes
Nicholas Diakopoulos, Ph.D.Columbia University Journalism School
(soon to be University of Maryland College of Journalism)
@ndiakopoulos – http://www.nickdiakopoulos.com
We should interrogate the architecture of cyberspace as we interrogate the code of Congress.
-- Lawrence Lessig, Code is Law, 2000
“
$$$ $$$ $$$ $$$
$$$ $$$ $$$ $$$
Algorithms Are Everywhere
Algorithmic Obfuscation
Algorithms are opaque
Technical complexity is a barrier
Algorithmic Accountability
How can we characterize the bias or power of an algorithm?
When might algorithms be wronging us, or making consequential decisions?
What role might journalists play in holding algorithmic power to account?
Algorithmic Power: Decisions
1 2 3Prioritization
Classification
Association
Filtering
Transparency
Voluntary incentives for self-disclosure about algorithms
Trade secretsIncluding FOIA exception
Gaming / manipulationGoodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”
Cognitive complexityTransparency information needs to be accessible and understandable
Adversarial Investigation
Reverse Engineering“the process of extracting the knowledge or design blueprints from anything man-made”
Systematic examination to unearth a model of how system works
Uncover unintended side-effects as a result of implementation
Surmise design objectives and intents
Output
Input-Output of an Algorithm
Input
geocookies prices
Staples.com
WSJ Price Discrimination
Jennifer Valentino-DeVries, Jeremy Singer-Vine, and Ashkan Soltani. Websites Vary Prices, Deals Based on Users’ Information. Wall Street Journal. Dec, 2012.
Price discriminationDo different people pay different prices depending on their geography or browser history? Yes!
Discriminatory / Unfair
Mistake that denies a service
Censorship
Breaks law or social norm
False Prediction
Other Stories from Algorithms?
Teaching journalists to do algorithmic accountability It’s messy and hard!
Legal issuesEULAs, DMCA, Computer Fraud and Abuse Act
Ethical implications of publishing more infoGaming, individual privacy
Transparency policyWhat factors to expose, frequency, format of disclosure
Algorithms in the newsroomPublic editor of future as algorithmic ombudsman?
What’s Next?
Thanks! Questions?
Nick DiakopoulosTwitter: @ndiakopoulosEmail: [email protected]: http://www.nickdiakopoulos.com
More InfoAlgorithmic Accountability Reporting: On the Investigation of Black Boxes. Tow Center. Feb. 2014. http://towcenter.org/algorithmic-accountability-2/
Algorithms In Media: Search
Search Engine Autocomplete
Google Autocomplete FAQ:“we exclude a narrow class of search queries related to pornography, violence, hate speech, and copyright infringement.”
Editorial CriteriaBoundaries of censorship, differences among search engines, mistakes?
Algorithms In Media: Trends
Implications for formation of publics?
How are trends defined and measured? What might be missed as a result?
Algorithms In Media: Filtering