uncertainty visualization - innovis · uncertainty into visualizations? uncertainty as metadata •...
TRANSCRIPT
Uncertainty Visualization InfoVis ~ Winter 2008 ~ Torre Zuk
What Uncertainty?• Uncertainty in measurements or data from
precision– E.g. 50 kg +/- 0.5kg
• Uncertainty in measurements or data from temporal changes– E.g. Shares of RIMM 120.12
• Uncertainty in confidence– E.g. What should I have for lunch?
• …
Uncertainty Typology
source independenceInterrelatednessamount of judgment includedSubjectivityassessment of info sourceCredibilitytemporal gaps from info collectionCurrency/Timingconduit through which info passedLineageextent to which info components agreeConsistencyextent to which info is comprehensiveCompletenessexactness of measurementPrecisiondifference between observation & realityAccuracy/Error
Thomson et al. A typology for visualizing uncertainty. In Proc. SPIE & IS&T Conf. Electronic Imaging, Vol. 5669: Visualization and Data Analysis 2005, pages 146–157, 2005
Uncertainty Visualizations
• Visualizing Data Uncertainty
Uncertainty Visualizations
• Visualizing Uncertainty for Tasks/Decisions
National Oceanic and Atmospheric Administration National Weather Service
Visualizing Uncertainty
• Uncertainty is relevant to comprehension and decision-making but may be left out
• Interpretation may be difficult enough without extra cognitive load
What are the best ways to integrate uncertainty into visualizations?
Uncertainty as Metadata
• Example A • Example B
• same base data• variation in metadata
Metadata and Representations
• Example A [Nirvana] • Example B [Paul Anka]
• Variables [Krygier 1994]: loudness, pitch, register, timbre, duration, rate of change, order, attack/decay
• audience• …
Uncertainty Visualization Pipeline
A. T. Pang, C. M. Wittenbrink, and S. K. Lodha, “Approaches to uncertainty visualization,” The Visual Computer 13(8), pp. 370–390, 1997
Analysis of Uncertainty Visualization
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic approach – Semiotic: icon, index, symbol– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
Analysis for Order
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic approach– Semiotic: icon, index, symbol– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
Approaches to uncertainty visualization [Pang et al. 1996]
Categorizations• datum values
– scalar, vector, tensor, multivariate• location of the datum
– 0D, 1D, 2D, 3D, time, …• visualization axes mapping
– experiential or abstract• extent of both location and value
– discrete or continuous
Approaches to uncertainty visualization [Pang et al. 1996]
• Uncertainty encoding– add glyphs– add geometry– modify geometry– modify attributes – animation – sonification– psychovisual
Representations for Uncertainty
• Vector fields
C. M. Wittenbrink, A. T. Pang, and S. K. Lodha, “Glyphs for visualizing uncertainty in vector fields,”IEEE TVCG 2(3), pp. 266–279, 1996.
Representations for Uncertainty
Zuk et al., Visualizing temporal uncertainty in 3D virtual reconstructions. VAST 2005.
• Temporal uncertainty in Archaeology
Analysis for Fun & Profit
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic– Semiotic– Perceptual & Cognitive Theory (InfoVis)– Human factors and task constraints
Representations for Uncertainty• MacEachren’s Focus Variables [1992]
– edge crispness (blur)– fill crispness (blur)– resolution– fog (transparency)
• MacEachren’s Clarity Variables (revision) [1995]– crispness– resolution– transparency
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
• Why these variables?– Icon, index, symbol
Representations for Uncertainty
• Virtual reconstructions
T. Strothotte, M. Puhle, M. Masuch, B. Freudenberg, S. Kreiker, and B. Ludowici, “Visualizing Uncertainty in Virtual Reconstructions,” in Proceedings of Electronic Imaging & the Visual Arts, EVA Europe ’99, VASARI, GFaI, (Berlin), 1999.
• Molecular positional uncertainty
P. Rheingans and S. Joshi. Visualization of molecules with positional uncertainty. Data Visualization ’99, pages 299–306. Springer-Verlag Wien, 1999.
Representations for Uncertainty
Analysis for Design
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic– Semiotic– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
Heuristic Evaluation• Evaluated 8 existing uncertainty visualizations • Amalgamated infovis theory to develop 12 general
heuristics
Zuk and Carpendale, Theoretical Analysis of Uncertainty Visualizations. SPIE VDA 2005.
Local contrast affects color & gray perception
Color perception varies with size of colored item
BertinQuantitative assessment requires position or size variation
Bertin & WarePreattentive benefits increase with field of viewWareConsider people with color blindnessWareLocal contrast affects color & gray perceptionWare & BertinColor perception varies with size of colored itemBertin & WareDon’t expect a reading order from colorTufte & WareIntegrate text wherever relevantWareConsider Gestalt LawsTufteRemove the extraneous (ink)Tufte & WareProvide multiple levels of detailTuftePut the most data in the least spaceTufte & BertinPreserve data to graphic dimensionalityBertin & WareEnsure visual variable has sufficient lengthSourceHeuristic
Heuristic Evaluation
Representations for Uncertainty
• Medical segmented surfaces
G. Grigoryan and P. Rheingans, “Point-based probabilistic surfaces to show surface uncertainty,” IEEE TVCG 10(5), pp. 564–573, 2004..
Representations for Uncertainty
• Procedural rendering
Andrej Cedilnik and Penny Rheingans. Procedural rendering of uncertainty information.In T. Ertl, B. Hamann, and A. Varshney, editors, Proceedings Visualization 2000..
Analysis for Cognitive Support
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic– Semiotic– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
• Experiment – Reasoning under uncertainty
Cognition and Uncertainty
y = 0.07x + 0.21R2 = 0.6662
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 3 4 5 6 7 8 9 10
outliers
• Experiment I – Observations by Person I
y = 0.07x + 0.2101R2 = 0.6667
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 3 4 5 6 7 8 9 10
oversampling
• Experiment I – Observations by Person II
• From only the options below person II (data above) is most likely: HCI student InfoVis student non-technical InfoVis student Graphics student
y = 0.07x + 0.2101R2 = 0.6667
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 3 4 5 6 7 8 9 10
B C
Judgment Question
Types of Heuristics and Biases
• Associations– affect, availability, recency bias, …
• Ignorance of Rules– representativeness, statistics, ...
• Application of Rules– automation bias, adjustment and anchoring, …
Visualizing Reasoning under Uncertainty• People have reasoning heuristics and biases
[Tversky and Kahneman]
• Supporting the decision may be as important as seeing the data uncertainty
Zuk and Carpendale, Vis. Uncertainty in Reasoning, Smart Graphics 2007.
Task & Cognitive Constraints:Supporting Evidence-based Diagnosis
© 2007 W21C
Collaboration with W. Ghali and B. Baylis, UofC Medicine
• Uncertainty in test data, test implications, strategies, diagnosis, …
Supporting Evidence-based Diagnosis
Bayes Theorem
A Bab
( | ) ( )( | )( | ) ( ) ( | ) ( )
P B A P AP A BP B A P A P B A P A
=+ ¬ ¬
Supporting Evidence-based DiagnosisObservational Study
• Understand the problem domain• Assess existing support at W21C
© 2007 C. Tang
Supporting Evidence-based DiagnosisAnalysis & Design
• Task model with uncertainty
• Design recommendations for new support• Participatory design
Supporting Evidence-based DiagnosisTest Results: multiple representations
)()|()()|()()|()|(
DPDTPDPDTPDPDTPTDP
¬¬+=
++
++
GeneralizationsDirectives for Uncertainty Visualization
1. Provide support for cognitive task simplification.2. Support emphasis and de-emphasis of uncertainty
information.3. Support viewing of uncertainty as metadata and as
separate data.4. Allow the user to select realizations of interest.5. Mitigate cognitive heuristics and biases with reasoning
support.6. Provide interaction to assist knowledge creation.7. Assess the implications of incorrectly interpreting the
uncertainty.
Zuk, Visualizing Uncertainty, PhD Thesis. 2008.
Acknowledgements