data apis and working with json data visualization outline · data apis and working with json data...
TRANSCRIPT
![Page 1: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/1.jpg)
Outline● Data APIs and working with JSON● Data Cleaning with Open Refine● Data Visualization
![Page 2: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/2.jpg)
API ChallengesApplication Programming Interfaces (APIs) give access to data -- but they’re generally designed more for application development than research or journalistic purposes.
Examples:
● Pulling someone’s Instagram followers for use in your app.● Pulling the current weather for use in your app.
![Page 3: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/3.jpg)
APIsAPIs typically just return data in JSON format when you access a URL. So,
https://www.metaweather.com/api/location/2357536/
gives me the weather for Austin (which has id 2357536).
![Page 4: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/4.jpg)
![Page 5: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/5.jpg)
APIshttps://venmo.com/api/v5/public?limit=1000000
![Page 6: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/6.jpg)
APIs: Challenges● Finding a useful data API for a data journalism project can be hard.
![Page 7: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/7.jpg)
![Page 8: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/8.jpg)
APIs: Challenges● JSON can be hard to work with in large part because it can contain complex
relationships.
![Page 9: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/9.jpg)
![Page 10: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/10.jpg)
![Page 11: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/11.jpg)
APIs: Challenges● JSON can be hard to work with in large part because it can contain complex
relationships.
https://api.fda.gov/drug/event.json?search=patient.reaction.reactionmeddrapt:%22fatigue%22&limit=1
![Page 12: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/12.jpg)
APIs: Challenges● JSON can be hard to work with in large part because it can contain complex
relationships.
Convert JSON to table: https://konklone.io/json/
![Page 13: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/13.jpg)
APIs: Challenges● Lots of social media APIs return text or images, which are very difficult to
work with using the techniques we tend to teach data journalists. ● Many of the more interesting APIs require access keys or don’t work using the
URL formats we looked at earlier.
![Page 14: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/14.jpg)
API Activity● Find an interesting API from https://github.com/toddmotto/public-apis● Figure out how to access data and examine what you get.
![Page 15: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/15.jpg)
Cleaning DataMessy data might result from:
● Human error● Inconsistent terminology● Inconvenient categories● Data spread over multiple files
![Page 16: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/16.jpg)
Cleaning DataCleaning data often takes around 80% of the total project time.
![Page 17: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/17.jpg)
Cleaning DataOpenRefine is a free and useful tool that’s also easy to teach with.
Activity: Clean some Texas Department of Criminal Justice data.
https://bit.ly/2k5okRn
![Page 18: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/18.jpg)
Visualization ResourcesTableau
● Free for students and labs (but then pretty expensive)● Very easy to use and produces high quality, interactive products● Used in a variety of professional settings
![Page 19: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/19.jpg)
Visualization ResourcesJavaScript libraries (e.g., Google charts, Plotly)
● Require minimal coding● Used in professional settings● Often limited in style and options
![Page 20: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/20.jpg)
![Page 21: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/21.jpg)
Visualization ResourcesJavaScript libraries (D3)
● Require advanced, idiosyncratic coding● Allows many more choices
![Page 22: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/22.jpg)
![Page 23: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/23.jpg)
Visual LiteracyCommunication students come in with very little experience interpreting graphs or other forms of visual evidence.
![Page 24: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/24.jpg)
![Page 25: Data APIs and working with JSON Data Visualization Outline · Data APIs and working with JSON Data Cleaning with Open Refine Data Visualization. API Challenges Application Programming](https://reader035.vdocument.in/reader035/viewer/2022070802/5f02c2c17e708231d405e0d2/html5/thumbnails/25.jpg)
Visual Literacy● Nathan Yau, Data Points.● Data + Design. https://infoactive.co/data-design