nick de wolf dataviz 2020hdilab.com/wp-content/uploads/2020/03/datavis_wolf.pdf · 2020. 3. 22. ·...

Big Data: Collection and applicationsDataViz 2020Nick de Wolf

Mission and scope

CBDS applies state of the art techniques and methods on new and combined data sources to deliver faster, cheaper and more detailed statistics on societal facts and challenges

Data access Ethics en privacy

Research Smartstatistics

Product developmentHealth, labour market, energy transition, mobility, safety, housing market and Economic indicators

Training

Regional

National

International

Big Data

Team

Survey

Big Data

VisualisationAdmin Data

Software

3

1. Multi-disciplinarity

44

1. Multi-disciplinarity

Big Data

Team

Survey

Big Data

Visualisation

Adminis

trative

R and BD software

Smart Services

Data Scouting

Data Mining

Text Mining

ML-DL

2. Ecosystem

3. Techniques to share data: PPDS

7

4. Datascouting CBDS

Source Data Applications

Cargonaut Aerial cargo in NL Economy and trade

Coosto Social media posts Desire to move, social tension

Enelogic/Liander Smart meter data (testset) Energy consumption

Tennet Quantity of current Energy consumption

KNMI Solar radiation data Solar power production

Tomtom Floating Car Data Traffic intensity

T-mobile Signalling data Movement/displacements

5. Relevance: Urban Data Centres

6. Research: combining sources

9

7. Communication

- When possible: Interactive visualisations- Visualisation techniques such as:

○ heatmaps, dotmaps, choropleths○ bar-/line-/scatter-plots

Projects

11

Safety: cybercrime

13

Housing market● Many options to visualize

instead of bar-plots and donut/pie plots.

● Example of visualizing houses being sold in various areas of the Netherlands○ 4 largest cities○ Market shrinkage areas○ Remainder

14

Housing market

● Scaling matters

Housing market: Moving behaviour

Safety: social tension indicator

− Use social media to detect feelings of tension and unrest on a daily basis.

● https://dashboards.cbs.nl/v2/experimenteel_SocialeSpanningen/

Labourmarket: skills

Economy: small innovative companies

Economy: small innovative companies

Population

Estimating number of people using anonimised cellphone data

20

Energy: Solar panels

● Registered solar panels over time● Registers are not always complete

Energy: Solar panels (Deep Solaris)

6

Energy: Solar panels (Deep Solaris)

● Use Satellite images to detect them automatically using Deep learning.

Distance to schools

● Distance from home to elementary school

● Comparisons between bicycle and car

● Different ways to visualize

Distance to schools

Distance to schools● https://research.cbs.nl/colordotmap/leerlingmobiliteit/

Even more (interactive) examples

The previous examples are a small sample of the projects we do at CBDS, more can be found at:

− https://www.cbs.nl/nl-nl/onze-diensten/innovatie− https://www.cbs.nl/en-gb/our-services/innovation (not all

articles are in english, so this is a less complete list)