data science in dft tom ewing dept for transport · pdf file · 2017-08-10data...
TRANSCRIPT
![Page 1: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/1.jpg)
Data Science in DfT Tom EwingPrincipal Data ScientistDept for Transport
![Page 2: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/2.jpg)
About me
● Joined Government in 1996
● Became a Statistician in 2008
● Became a Data Scientist in 2015
● First 18 months as a data scientist: ○ Engaging○ Traction○ Prototypes
● Last 6 months as a data scientist:○ Team Building○ Development○ Delivery
![Page 3: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/3.jpg)
Applying Data Science to Policy
● Public Consultations
● Cycling & Walking Investment Strategy (CWIS).
● Five Questions to the Public
● 4000 responses
● Variety of Media
![Page 4: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/4.jpg)
Processing and Analysing the Results...
● Majority manually processed
● Time Consuming + Boring + Not digital
● No tools for analysis
● Contracting responsibility out
![Page 5: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/5.jpg)
Applying Data Science
● Focus on ‘pain points’:○ Collation○ Analysis
● Our solution:○ Opens emails and extracts the content and metadata○ Opens any attachments:
■ MS Word (.doc , .docx)■ PDF (.pdf)■ Image (.jpeg , .png , .tiff , .bmp ….)
○ Extracts the data○ Saves everything into an Excel Spreadsheet○ Builds and visualises an LDA topic model
![Page 6: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/6.jpg)
Data Science to the Rescue! Part 1 (Automation)
● Focus on ‘pain points’:○ Collation○ Analysis
● Our solution:○ Opens emails and extracts the content and metadata○ Opens any attachments:
■ MS Word (.doc , .docx)■ PDF (.pdf)■ Image (.jpeg , .png , .tiff , .bmp ….)
○ Extracts the data○ Saves everything into an Excel Spreadsheet○ Builds and visualises an LDA topic model
Prototype Demo:
https://goo.gl/9jsr7z
![Page 7: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/7.jpg)
Alpha Demo: http://51.140.61.200:3838/janus/janus-
public/shiny-dashboard/
![Page 9: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/9.jpg)
Innovation
● Digital Tools & Methodologies
● IMCreate / Hacktrain
● Internal Hackathon: DfT Hackclub
● DfT Hacks!
![Page 11: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/11.jpg)
The Future...
● Recruiting & Expanding our team
● New Strategy: ‘The Data Science Vision’
● Data Science ‘Hub’
● New Projects (Aviation, Maritime, Rail, Mobile Phone Data etc.)
● DfT Hacks 2.0
![Page 12: Data Science in DfT Tom Ewing Dept for Transport · PDF file · 2017-08-10Data Science in DfT Tom Ewing Principal Data Scientist Dept for Transport. About me ... MS Word (.doc , .docx)](https://reader031.vdocument.in/reader031/viewer/2022022504/5ab7647c7f8b9ad3038b8c06/html5/thumbnails/12.jpg)
Questions?
https://www.facebook.com/tom.ewing1
TomEwing1979
http://www.github.com/Tommo565