data visualization on the tech side
DESCRIPTION
Trending tools and languages for data visualization makers, but also ideas to get more inspiration.TRANSCRIPT
DATA VISUALIZATION ON THETECH SIDE
#dbtalks
languages - tools - ideas
Mathieu ELIEData Visualization Freelance
@mathieuelhttp://www.mathieu-elie.net
#dbtalks
DATA VISUALIZATION
#dbtalks
Infinite number of tools, because dataviz domain is infinite.
From data art, system administration, led walls to business intelligence.
Lets see some trending tools, and explore some ideas !
CHAPTERS
#dbtalks
- d3.js the web standard, not so alone
- ELK stack, system and BI dataviz super fast
- WebGL, 3d dataviz entry point
- R, explore data like a data scientist boss !
- 3d printing, dataviz in real life
- processing - meet the data art
- open refine, import csv, enrich, export
D3.JS
#dbtalks
THINK D3 AS:
- a javascript library with helpers
- dom, array, scales, color swatches etc...
- a dom manipulation library
- a low level lib: make a bart chart maybe painfull at the beginning
- but you can make really advanced visualization, with full control
D3.JS / EXAMPLES
#dbtalks
D3.JS / EXAMPLES
#dbtalks
D3.JS / EXAMPLES
#dbtalks
D3.JS / EXAMPLES
#dbtalks
D3.JS
#dbtalks
As you can see, every examples are made of
graphic svg primitives like square, path and so on.
Possibilities are infinite and can be stuning but quite lot of work.
D3.JS
#dbtalks
d3 is a great tools for dataviz experts, or those who want to lear basics.
For your own need you can use more high level tools like d3 wrapper lib, or lib focused on specific viz (bar chart, map etc..).
WEBGL
#dbtalks
Low level 3d API in browser (HTML5).
three.js : the perfect lib to go on.
Not really the job of d3.
WEBGL : EXAMPLES
#dbtalks
WEBGL : EXAMPLES
#dbtalks
WEBGL : EXAMPLES
#dbtalks
WEBGL : EXAMPLES
#dbtalks
WEBGL : EXAMPLES
#dbtalks
WEBGL
#dbtalks
Many possibilities.
3d and data works together too.
so dont miss WebGL for your dataviz projects
ELK STACK
#dbtalks
ELK STACK
#dbtalks
- logstash -> elasticsearch -> kibana
- extra cheap dataviz and stuning
- but ! you can query es too -> d3.js
- elasticsearch + aggregations framework
ajax call -> amazing stats to d3.js !- explore timeline data quickly: very handy
R
#dbtalksouch ! ready to console ??
R
#dbtalks
- explore large sets of data- load csv and so on
- explore data, aggregate, apply stats, find max, min, percentiles, and so on..
- produce graphs
- R is not for producing dataviz
- it is the perfect tool to explore your data
R GRAPH EXAMPLE
#dbtalks
OPEN REFINE
#dbtalks
- when you have large / inconsistent csv
- explore, correct, enrich
- export templates: json / es / php, anything text based !!!
OPEN REFINE
#dbtalks
OPEN REFINE
#dbtalks
- ok for non programmers
- not similar to R: has its own advantage
- open source / free : run in browser
- export templates are really amazing , endless possibilities
- any time you have csv, think «open refine»
PROCESSING
#dbtalks
- not a dataviz standard tool but...
- great community including data art
- so i think you should care....
- .... and open your mind !
PROCESSING : EXAMPLE
#dbtalks
#dbtalks
PROCESSING : EXAMPLE
PROCESSING
#dbtalks
- community give more insights on the visual part of your dataviz
- imagine some part of this graph are drived by data:
- length of some path ?
- brightness of some points ?
- add maybe 3d or geo located data ?
3D PRINTING
#dbtalks
so ? why not 3d print data ?
- print bars / histogram 3d- print curves: think about lines chart in 3d- and many possibilities...
3D PRINTING EXAMPLE
#dbtalksObama 3d voice print
USE CASE : LASTFM HISTORY
#dbtalkshttp://www.mathieu-elie.net
USE CASE : LASTFM HISTORY
#dbtalks
1 ) grab lastfm api data from ruby
2 ) store in csv
3 ) import in open refine
4 ) export to elasticseach
5 ) call elasticsearch with ajax
6 ) display data with d3.js
#dbtalks
QUESTIONS ?HELP ?
Mathieu ELIEData Visualization Freelance
@mathieuelhttp://www.mathieu-elie.net