new 01 introduction - 36-721 statistical graphics and visualization · 2015. 10. 28. · 01...

49
01 Introduction 36-721 Statistical Graphics and Visualization Jerzy Wieczorek 9/1/15

Upload: others

Post on 17-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

01 Introduction36-721 Statistical Graphics and Visualization

Jerzy Wieczorek

9/1/15

Page 2: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Examples and context

What good is data visualization?

What can we aspire to?

How do statistical graphics fit in with other flavors of visualizationand information design?

Page 3: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Statistical graphicsEDA

Bass 2

Bass 1

Tenor 2

Tenor 1

Alto 2

Alto 1

Soprano 2

Soprano 1

60 65 70 75

Height (inches)

Page 4: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Statistical graphics

Regression diagnostics

●●●●●●●●●●●●●●●●●

●●●●

●●●●●

●●

●●

0 5 10 15 20 25 30

020406080

100120

x

y

●●●

●●●

●●

●●●

●●●

●●●●

●●●●

●●

0 5 10 15 20 25 30

−10−5

05

101520

xR

esid

uals

Page 5: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Statistical graphics

Classifier diagnosticsCook & Swayne, Interactive and Dynamic Graphics for DataAnalysis, With R and Ggobi

Page 6: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Scientific visualization

Ware, Information Visualization

Page 7: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Statistical graphics and scientific visualization

I See a huge dataset all at onceI Find interesting features at different scalesI Notice data anomaliesI Propose scientific hypotheses

Page 8: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Infographics & data journalismStatic infographic by Alberto Cairo

Page 9: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Infographics & data journalism

Interactive graphic by New York Times

Page 13: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Information design, visual explanation

Wayfinding

Page 14: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Information design, visual explanation

Instruction

Page 15: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Information design, visual explanation

Visualizing algorithms

Page 16: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Course info

How is the class organized? How is it graded?

Page 17: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

How would you organize this course?

What topics to cover? How to group them?

Page 18: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

How I’ve organized this course

Course objectives (see Syllabus) are based on frameworks andprinciples

In class we will

I Look at graphicsI Discuss whether they workI Propose reasons why they (don’t) workI Compare to frameworks/principles in the literatureI Critique graphs and make new ones using our principlesI Learn software tools as needed for implementation

Page 19: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Assessments

Each assessment (homework, critique, project) targets one of thelearning objectives. No points—just a rubric for each assignment.

Final grade depends on which assignments you completed and howwell (see Syllabus).

You can revise and resubmit. But first submissions must be on timeand show sincere effort! (to keep grading manageable for us)

Page 20: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Syllabus

I Office hours and due datesI ObjectivesI Texts and softwareI AssessmentsI AdministriviaI Schedule

Be sure to note:

I Passing grade for CMU graduate students is B- or above.I R software is required for Statistics MSPs.

Page 21: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Schedule of topics

What will we study?

Page 22: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Readability and best practices

Armenian National Statistical Service and my own remake

Page 23: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Human visual perceptionCleveland and McGill (1984)

Page 24: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

The Grammar of Graphics

IBM’s VizJSON, R’s ggplot2, SPSS’s GPL and VisualizationDesigner, Tableau. . .

Page 25: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Graphic design

Page 26: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Interaction design

Page 27: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

The dataviz research literature

Correll and Gleicher (2014)

Page 28: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Communicating statistical ideasSampling variation, via New York Times

Page 29: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Graphics for statistical analysis

Page 30: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Maps and cartography

Map projections, choropleths, cartograms

Page 31: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Trees and networks

Hiveplot network diagrams

Page 32: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

TBD—ideas

I Vector fieldsI Data sonificationI D3.js practiceI Chart zooI Table designI History of visualizationI Your topic here?

Page 33: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Historical classics

So you can nod and say, “Oh yeah, I know that one”

Page 36: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Nightingale

Polar area diagram, 1858

Page 37: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Minard

Napoleon’s march, 1869

Page 38: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Statistical Atlas of the United States

Statistical Atlases by the U.S. Census Bureau, 1870-1890,including ranks of city populations 1790-1890

Page 41: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Anscombe

Page 44: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Classic books

I Bertin, Semiology of GraphicsI Cleveland, The Elements of Graphing Data and Visualizing

DataI Wilkinson, The Grammar of GraphicsI Tufte, The Visual Display of Quantitative Information and

Envisioning InformationI Wainer, Visual Revelations and others

Page 45: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Next time

What to prepare? What’ll we cover?

Page 46: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Prepare for next time

I Install and test-drive your statistical graphics softwareI Look at HW1 (data + rubric), let me know if unclearI Readings: Cairo Ch 1-4; Donahue p. 1-23I Blogs to follow

I Nathan YauI Alberto CairoI Robert KosaraI Kaiser FungI Di Cook

Page 47: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Next time we’ll cover

I Best practices for most common 1D/2D charts and tablesI Image formats, resolution, saving plotsI A few handy tricks (logs, loess, jitter)I R users: bring laptops to follow along

Page 48: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Software installation

Let’s get everything installed and debugged to prepare for futureclasses.

Page 49: New 01 Introduction - 36-721 Statistical Graphics and Visualization · 2015. 10. 28. · 01 Introduction - 36-721 Statistical Graphics and Visualization Author: Jerzy Wieczorek Created

Software installation

I Who’ll use R? What else will be used?I R users: install and test-drive

I R and RStudioI ggplot2, knitr, shiny packages

I Tableau users: install student licenseI www.tableau.com/academic/students

I Also considerI D3.jsI Inkscape