the age of data driven science and engineering

© 2015 Persontyle Ltd.

The Age of Data Driven Science and Engineering

Ali SyedPersontyle Data Science Centre of Excellence Founder and Chief Data Scientist [email protected]

CoSy Seminar – 13 Oct 2015

Center for Interdisciplinary Mathematics

Uppsala University


Next 50mins….


Together we will explore…

what's happening to the world we live in,

what is all this fuss about the digital world and datafication,

why we all need to rethink and reimagine how we define and perceive academic disciplines,

emergence of data driven sciences and engineering,

explore why talent is the most important ingredient,

how EDSA is addressing the skills shortage and mass-scale upskilling challenge.


My Safe Harbour Statement!


"Any sufficiently advanced technology is indistinguishable from magic.“

Arthur C. Clarke


It seems unbelievable at first.


Amazing view of Manhattan, New York, in 1944.


Disney Research has developed the technology foraugmented reality coloring books...


DIGITIZATION

9 BillionInternet Devices

in 2012

50 BillionBy 2020

DATA

90% Created withinLast Two Years

50X GrowthBy 2020

MOBILITY

6 BillionMobile

Subscribers

87%of World’s Population

Mobile Data

Growing 78% CAGR

CLOUD

90%of new software

delivery for Public Cloud

Public IT cloud services will

grow to $107B in 2017

This changes the way the world works…


A continuously transforming wold.


Experience the digitization…


THE SECOND MACHINE AGE WILL HAVE GREATER IMPACT THAN EVEN THE FIRST INDUSTRIAL REVOLUTION.

A n d r e w M c A f e e a n d E r i k B r y n j o l f s s o n


“The AIs are going to take our jobs! No. They are going to transform us and our society.”Tim O'ReillyFounder and CEO, O'Reilly


All actions, interactions and behaviours both of humans and machines are stored and transmitted across

networks to keep the engines of the digital age running.


Explosion of the data…


The amount and complexity of data produced in science, business, and everyday human activity are increasing at staggering rates.


e.g. supply chain data landscape


Source: Mamatha Upadhyaya, Capgemini


Industry analysts, consultants, pundits and gurus urging the “data-naïve” to wise up to the potential of “Big Data”.


“Big data is here to stay, as it should be. But let’s be realistic: It’s an important resource

for anyone analysing data, not a silver bullet.”

GARY MARCUS & ERNEST DAVIS


Data science is an emerging and multidisciplinary way of applying our

curiosity, intuition and scientific methods to create value from

data that solves our most difficult problems.


Data science is not just a rebranding of statistics or machine learning

but rather a field unto itself.

Doing Data ScienceRachel Schutt and Cathy O'Neill.


Data science “Taking a hunch you have about the world and pursuing it in a

structural, mathematical way to understand something new

about the world.”

Hilary Mason


STATISTICS

MACHINE LEARNING

SOFTWARE ENGINEERING

DOMAIN EXPERTISE

DATABASE DESIGN & DEVELOPMENT

MATHEMATICS


DATA SCIENCESTATISTICS

MACHINE LEARNING

SOFTWARE ENGINEERING

DOMAIN EXPERTISE

DATA ENGINEERING

MATHEMATICS


SOCIOLOGY

PSYCHOLOGY

ORGANIZATION BEHAVIOUR

HUMAN COMPUTER INTERACTION

PROGRAMMING

STRATEGY & PERFORMANCE MANAGEMENT


GAMIFICATIONSOCIOLOGY

PSYCHOLOGY

ORGANIZATION BEHAVIOUR

HUMAN COMPUTER INTERACTION

PROGRAMMING

STRATEGY & PERFORMANCE MANAGEMENT


FUTURE????

I DON’T KNOW

I DON’T KNOW

I DON’T KNOW

I DON’T KNOW

I DON’T KNOW

I DON’T KNOW


“Our age reveres the specialist but humans are natural polymaths, at our best when

we turn our minds to many things”Robert Twigger


https://xkcd.com/755/

Unusual collaborations can often lead to….


“‘Data Scientist’ is a Data Analyst who lives in California”

"A data scientist is someone who is better at statistics than any software engineer and

better at software engineering than any statistician."

“A data scientist is a business analyst who lives in New York.”

"A data scientist is a statistician who lives in San Francisco."

"Data Science is statistics on a Mac."

Data science an uninspiring ho-hum?

https://twitter.com/nivertech/status/180109930139893761











One of the difficult aspects of cultivating an data driven culture is that there is a lot of noise on the topic.


Many organizations believe in the power and potential of data science but are challenged in establishing a sustainable data science capability.


Source: Balázs Kéglhttps://medium.com/@balazskegl/the-data-science-ecosystem-678459ba6013


“Distinguishing the signal from the noise requires both scientific knowledge and self-knowledge: the serenity to accept the things we cannot predict, the courage to predict the things we can, and the wisdom to know the

difference.”Nate Silver


Lot of tools for managing and reproducing complex data projects.


Typical Data Science Process

Define Objective

Extract and Analyze data

Pre-processing

Feature and Target

construction

Feature selection

Model training

Model scoring

Evaluation

Train/ Test split


Data Science is all about

building teams and culture.


“Data by itself is meaningless. It’s the skill of the data scientist that makes the difference.”

Dr. Josh Sullivan

Demand for analytics skills outstrips supply in all sectors.

“A lot more data than qualified talent. Finding talent in big data is very difficult. Retaining talent in big

data is even harder. “

Dr. Usama Fayyad

“There is a storm approaching on the Big Data talent front”

Tom Davenport


A growing divide between those that realise the potential of that data, and those with the technical skills to process, analyse and predict from it.

It is also estimated that there will be a 160% increase in demand for Big Data specialists between 2013-2020 to 346,000 new jobs.

Big Data has the potential to directly contribute €206 billion to the EU economy by 2020.

over the past 5 years the demand for Big Data staff in the UK alone had risen tenfold and currently 77% of Big Data roles are hard to fill.


Unfortunately the space is filled with a lot of charlatans masquerading as experts.


This project has received funding from theEuropean Union's Horizon 2020research and innovation programmeunder grant agreement No 643937

www.edsa-project.eu

http://edsa-project.eu/



ENABLING DATA DRIVEN DIGITAL EUROPE

Data is at the centre of the future knowledge economy and society


“NOT EVERYONE NEEDS TO BE A DATA SCIENTIST, BUT NEARLY EVERYONE WILL NEED TO LEARN

TO UTILIZE THE DATA TO MAKE MORE DATA-DRIVEN DECISIONS.”

Dr. Jeffrey CammUC Center for Business Analytic

University of Cincinnati


A well-balanced European consortium containing 9 partners from 6 European countries (UK, Germany, Sweden, Slovenia, The Netherlands and France).

Partners represent Universities (OU, KTH, SOUTHAMPTON, TU/e), Research institutions (FRAUNHOFER, JSI) SMEs (ODI, IDEXLAB SAS, Persontyle)

The EDSA consortium

www.edsa-project.eu

http://edsa-project.eu/resources/dashboard/


European Data Science Academy (EDSA) will establish a virtuous learning production cycle for Data Science, and will:

1. Analyse the sector specific skillsets for data analysts across Europe’s main industrial sectors;

2. Develop modular and adaptable curricula to meet these Data Science needs; and

3. Deliver training supported by multiplatform and multilingual learning resources based on these curricula.


Initial Version of Module

Final Module: eBook & Course

Webinar –Final Recording

Webinar –First Recording

Collection ofModule Materials Slides – First Version

Slides – Final Version

Stakeholder CommunitiesIndustrial Advisory Board

Demand AnalysisReflection

Module DisseminationOnline & F2F

Learnin

g An

alytics

CurriculaEDSA Analytics

Dashboard

Reconfiguring & Repurposing

LearnersLearning Delivery

EDSA Design and Delivery Approach


EDSA Initial Curriculum

Source: http://www.exploringdatascience.com/


Delivery Channels - Rich Interactive OERs


Delivery Channels - VideoLectures.NET

Content

Events : 950Authors: 13, 000Lectures: 17, 600Videos: 20, 000Organisations: 7000Categories : 600Comments: 8500

Website

Video views: 6.5 millionPage views: 29 millionSigned in users: 25, 000Average time: 36 minAttachments: 620, 000Files: 1,5 million8 servers New Visitor: 60.83%Licenses: Creative Commons

Users

Top countries: United States, India, Slovenia, UK, Germany, China, Canada

Tutorials: 350Keynote: 800Interviews:250


Delivery Channels - iTunes U

Mooc Illustration: Adam Simpson

Delivery Channels - MOOCs


Help to shape the future of data science training in Europe.


We need your data.

Help us provide the EU data science community with relevant information about the field from the inside. The more voices we can incorporate into this project, the more detail we can provide, detecting patterns and separating noise from the signals and vice versa.

Please take 10-15 minutes to fill out the demand survey.

TAKE THE SURVEY

http://edsa-project.eu/resources/dashboard/




"LISTENING TO THE DATA - DOING EXPERIMENTS, ANALYZING THE RESULTS, DIGGING DEEPER, FOLLOWING UP

ON SURPRISES - IS THE PATH TO SUCCESS."

PROF. PEDRO DOMINGOS


ALI SYED @aaalee

[email protected]

JOIN THE CONVERSATION:@persontyle@schooltds

WWW.PERSONTYLE.COM

the age of data driven science and engineering

Data & Analytics