introduction to data visualization
DESCRIPTION
Introduction to Data Visualization. CS 4390/5390 Fall 2014 Shirley Moore, Instructor svmoore.pbworks.com August 25, 2014. The Industrial Revolution of Big Data (Joe Hellerstein , 2008). Image credit: http ://www.uberb2b.com/b4b-presents-the-first-industry-4-0-mini-conference/. - PowerPoint PPT PresentationTRANSCRIPT
1
Introduction to Data Visualization
CS 4390/5390 Fall 2014Shirley Moore, Instructor
svmoore.pbworks.com
August 25, 2014
2
The Industrial Revolution of Big Data (Joe Hellerstein, 2008)
Image credit: http://www.uberb2b.com/b4b-presents-the-first-industry-4-0-mini-conference/
3
How much data is out there?
4
Image credit: http://www.opentracker.net/solutions/big-data-analytics
5
The ability to take data – to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it – that’s going to be a hugely important skill in the next decades…
Because now we really do have essentially free and ubiquitous data. So the complementary scarce factor is the ability to understand that data and extract value from it.
Hal Varian, Google’s Chief Economist The McKinsey Quarterly, Jan 2009
6
Data-Intensive ScienceImage credit: Synergistic Challenges in Data-Intensive Science and Exascale Computing, DOE
ASCAC Data Subcommittee Report, March 2013, available on science.energy.gov
7
Computing with Big Data
Slide courtesy of Kathy Yelick
8
Sources of Big Scientific Data
9
How much scientific data?
• ATLAS and CMS experiments at the Large Hadron Collider enerate data at rates of petabytes per second running round the clock for a large fraction of the year.
• Climate simulations generating several petabytes of data per year.
• Computational biology and genomics producing extreme volumes of data for – biophysical simulations of cellular environments– cracking the code of the genome across species– correlating observational ecology and models of population
dynamics– reverse engineering the brain
10
CERN Large Hadron ColliderImage credit: wiki.creativecommons.org/Case_Studies/CERN
11
Higgs Boson Particle
Simulated data modeled forthe CMS particle detectoron the Large Hadron Collider(LHC) at CERN.
Here, following a collision of two protons, a Higgs boson is produced that decays intotwo jets of hadrons and twoelectrons.
Image credit:http://www.tacc.utexas.edu/news/feature-stories/2011/testing-technicolor-physics
12
Data Collection Growth
13
Why Use Visualization?
1. Cognition is limited.2. Memory is limited.
14
Selective Attention
• The Door Studyhttps://www.youtube.com/watch?v=FWSxSQsspiQ• The Invisible Gorillawww.invisiblegorilla.com • Mueller and Krummenacher,
“Visual search and selective attention”, Visual Cognition 14: 389-410, 2006.
15
Working Memory Capacity
• Test your working memory capacity– http://www.gocognitive.net/demo/working-memory-capacity
• The Magical Number Seven Plus or Minus Two– George Miller,
“The magical number seven, plus or minus two: Some limits on our capacity for processing information”, The Psychological Review 63: 81-97, 1956.
16
Visualization Works By
• Using perception to point out interesting things
• Using pictures to enhance working memory
17
How Many Letter V’s
MTHIVLWYADCEQGHKILKMTWYNARDCAIREQGHLVKMFPSTWYARNGFPSVCEILQGKMFPSNDRCEQDIFPSGHLMFHKMVPSTWYACEQTWRN
18
How Many Letter V’s
MTHIVLWYADCEQGHKILKMTWYNARDCAIREQGHLVKMFPSTWYARNGFPSVCEILQGKMFPSNDRCEQDIFPSGHLMFHKMVPSTWYACEQTWRN
19
Which Number Appears Most Often?
15 19 60 33 11 75 57 34 79 58 51 9273 22 13 71 60 22 72 10 68 73 18 5565 46 29
20
Which Number Appears Most Often? (cont.)
60 73 22 46 92 97 10 58 4657 17 83 26 99 33 88 92 60 91 29 57 96 12 47
21
Class Exercise 1
• Can you devise a visualization that makes this task easier?
22
Definition of Visualization
• http://www.merriam-webster.com/dictionary/visualization 1. formation of mental visual images2. the act or process of interpreting in visual terms or of
putting into visible form
“Computer-based visualization systems provide visual representations of datasets intended to help people carry out some task more effectively.” --Tamara Munzner
23
Class Exercise 2
• How does triglyceride level vary by age and income level?
TRIGLYCERIDE LEVEL
• Can you devise a visualization that enables seeing the answer at a glance?
Males Females
Income Under 65 65 or Over Under 65 65 or Over
0-$24,999 250 200 275 450
$25,000+ 320 150 400 200
24
Purposes of Visualization
• Answer questions• Generate hypotheses• Make decisions• See data in context• Expand memory• Support computational analysis• Find patterns• Tell a story• Inspire
25
Visualization Critique
• What is the purpose of the visualization?• What techniques are used? • Are the techniques used effectively?• Does the visualization focus our attention on
important aspects of the data?• Does the visualization accomplish its purpose?• How could the visualization be improved?
26
Exemplar
• Hans Rosling TED Talk– https://www.youtube.com/watch?v=usdJgEwMinM
• Homework assignment #1– Write a critique of a visualization from this video– Bring to class to share on Wednesday, Sept 3
27
Course Logistics
• Course website: http://svmoore.pbworks.com/ (click on Data Visualization)• Instructor: Shirley Moore– Office: CCSB 3.0422– Office hours: MW 3:00-4:00pm, others by appointment
• Teaching assistant: Henry Moncada– Office: CCSB 3.1202H– Office hours:
28
Grading
• Grades will be posted on Blackboard• Approximate breakdown– 35% homework and lab assignments– 15% class preparation and participation– 25% course exam– 25% project
29
Textbooks
• Visualization Design and Analysis: Abstractions, Principles, and Methods by Tamara Munzner, AK Peters 2014 (to appear). Draft available at http://www.cs.ubc.ca/~tmm/courses/533/book/vispmp-draft.pdf
• Visual Thinking for Design by Colin Ware, Morgan Kaufman, 2008.
• Visualizing Data: Exploring and Explaining Data with the Processing Environment, by Ben Fry, O’Reilly, 2007.
• The ParaView Tutorial, Version 4.1, by Kenneth Moreland, Sandia National Lab, 2013. http://www.paraview.org/Wiki/The_ParaView_Tutorial
30
Software
• Processing– processing.org– Programming language and development environment for
information visualization applications– Download and install on your laptop
• ParaView– www.paraview.org– Open-source data analysis and visualization application– Developed to analyze extremely large datasets using
distributed computing resources• Others to be determined
31
Course Project
• Implementation of a visualization for a significant dataset– You may choose your own dataset or use one
provided by the instructor• Report describing background and design
decisions• Presentation during last week of class or final
exam period (or special poster/demo session?)• Work individually or in teams of up to three
32
Connections to Other Courses
• CPS 5310 Simulation and Modeling• CS 5334 Parallel & Concurrent Programming• CS 4342 Database Management• CS 4390/5339 Web-based Systems• CS 4317/5317 Human-Computer Interaction• CS 3370 Computer Graphics• Graphic Design • Psychology
33
Why Take This Course
• Build more complex and insightful visualizations than your current skills and tools allow
• Learn how to effectively communication information about complex data to others
• Ask questions about, explore, and understand data for your job or research
• The set of people who need to be able to visualize data is growing beyond experts in visualization.
34
Opportunity: Vizzies Visualization Challenge
• http://www.nsf.gov/news/special_reports/scivis/• Sponsored by National Science Foundation and Popular Science• Deadline September 30, 2014• Cash prizes• Categories
– Photography– Illustration– Posters and graphics– Games and apps– Videos
• Extra credit and/or use as basis for project for this class
35
Preparation for Next Class
• Read Munzner Chapter 1• Readings on Visualization Techniques• Download Processing software and install on
your computer (see me if you don’t have a computer you can use for this)– Will start using Processing second week of class– Will also get Processing installed on lab computers
• Start on Homework Assignment 1