open edudatawrangling
DESCRIPTION
TRANSCRIPT
![Page 1: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/1.jpg)
Working with #opendata
Tony Hirst@psychemedia
![Page 2: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/2.jpg)
DATAU
SERS
EducatorsLearners
PlannersMarketers
PolicymakersResearchers
PressNGOs
“DEVELOPERS”
![Page 3: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/3.jpg)
A tools and issues
based view
![Page 4: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/4.jpg)
DATA
TOOLS
USERS
PROBLEMS
![Page 5: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/5.jpg)
Access/obtain data
Make sense of data
Ask specific questions of data
Communicate in a data-centric way
![Page 6: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/6.jpg)
Load dataClean data
Merge/enrich data
![Page 7: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/7.jpg)
DATA
Issues
TOOLS
![Page 8: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/8.jpg)
DATA
OtherTOOLS
Issues
TOOLS
![Page 9: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/9.jpg)
A barrier to access (for the tool user) is
data format
![Page 10: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/10.jpg)
![Page 11: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/11.jpg)
![Page 12: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/12.jpg)
JSON XMLCSVXLS
TSV
.dbHTML
PDF DOCTXT
![Page 13: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/13.jpg)
GLUE LOGIC(Glue code)
![Page 14: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/14.jpg)
=importHTML(URL, “table”, N)
HTML
QUERYABLE DATA
![Page 15: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/15.jpg)
=importHTML(URL, “table”, N)
HTML
INTERACTIVEDASHBOARD
Google Charts
![Page 16: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/16.jpg)
![Page 17: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/17.jpg)
![Page 18: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/18.jpg)
![Page 19: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/19.jpg)
![Page 20: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/20.jpg)
![Page 21: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/21.jpg)
![Page 22: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/22.jpg)
![Page 23: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/23.jpg)
A barrier to access (for the tool user) is
data shape
nother
![Page 24: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/24.jpg)
![Page 25: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/25.jpg)
![Page 26: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/26.jpg)
![Page 27: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/27.jpg)
![Page 28: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/28.jpg)
![Page 29: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/29.jpg)
![Page 30: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/30.jpg)
![Page 31: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/31.jpg)
![Page 32: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/32.jpg)
A barrier to access (for the tool user) is
data cleanliness
nother
Yet
![Page 33: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/33.jpg)
![Page 34: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/34.jpg)
![Page 35: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/35.jpg)
Clear to read?
![Page 36: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/36.jpg)
![Page 37: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/37.jpg)
![Page 38: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/38.jpg)
![Page 39: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/39.jpg)
![Page 40: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/40.jpg)
![Page 41: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/41.jpg)
![Page 42: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/42.jpg)
![Page 43: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/43.jpg)
![Page 44: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/44.jpg)
Questions of identity
![Page 45: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/45.jpg)
The Open UniversityOpen University
OUOpen Uni
Open University, UK
NORMALISATION/RECONCILIATION
![Page 46: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/46.jpg)
![Page 47: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/47.jpg)
Reconciliation to a canonical name
and/or to a unique identifier
![Page 48: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/48.jpg)
![Page 49: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/49.jpg)
![Page 50: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/50.jpg)
![Page 51: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/51.jpg)
![Page 52: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/52.jpg)
![Page 53: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/53.jpg)
![Page 54: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/54.jpg)
![Page 55: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/55.jpg)
![Page 56: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/56.jpg)
A stumbling block (for the data user) is data enrichment
![Page 57: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/57.jpg)
![Page 58: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/58.jpg)
![Page 59: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/59.jpg)
![Page 60: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/60.jpg)
![Page 61: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/61.jpg)
![Page 62: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/62.jpg)
![Page 63: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/63.jpg)
![Page 64: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/64.jpg)
A stumbling block (for the data user) is joining datasets
nother
![Page 65: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/65.jpg)
A stumbling block (for the data user) is joining partially
matched data
huge
![Page 66: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/66.jpg)
Rolling your own interactive data
exploration tools
![Page 67: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/67.jpg)
Google Visualisation
API
![Page 68: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/68.jpg)
![Page 69: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/69.jpg)
![Page 70: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/70.jpg)
![Page 71: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/71.jpg)
googleVis (R)
![Page 72: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/72.jpg)
![Page 73: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/73.jpg)
R Shiny Apps
![Page 74: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/74.jpg)
![Page 75: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/75.jpg)
![Page 76: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/76.jpg)
ui.R server.R
![Page 77: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/77.jpg)
![Page 78: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/78.jpg)
![Page 79: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/79.jpg)
![Page 80: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/80.jpg)
![Page 81: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/81.jpg)
![Page 82: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/82.jpg)
![Page 83: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/83.jpg)
RCharts
![Page 84: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/84.jpg)
![Page 85: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/85.jpg)
![Page 86: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/86.jpg)
![Page 87: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/87.jpg)
Many chart tools do the work for
you if the data is in the right shape
![Page 88: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/88.jpg)
DATA
TOOLS
USERS PROBLEMS
![Page 89: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/89.jpg)
![Page 90: Open edudatawrangling](https://reader033.vdocument.in/reader033/viewer/2022051819/54c67d584a7959725e8b4593/html5/thumbnails/90.jpg)
blog.ouseful.info
@psychemedia