using a cognitive analysis grid to inform information systems design
TRANSCRIPT
![Page 1: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/1.jpg)
© 2015 Tech3Lab 1
Using a Cognitive Analysis Grid to Inform Information Systems Design
LAURENCE DUMONT, GABRIELLE CHÉNIER-LEDUC, ÉLAINE DE GUISE, ANA ORTIZ DE GUINEA, SYLVAIN SÉNÉCAL AND PIERRE-MAJORIQUE LÉGER
Gmunden Retreat on NeuroIS 2015
June 2nd 2015, Gmunden, Austria
![Page 2: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/2.jpg)
© 2015 Tech3Lab 2
![Page 3: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/3.jpg)
© 2015 Tech3Lab 3
John is an IS user
![Page 4: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/4.jpg)
© 2015 Tech3Lab 4
John lives in a wonderful world
![Page 5: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/5.jpg)
© 2015 Tech3Lab 5
Everyone is John
![Page 6: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/6.jpg)
© 2015 Tech3Lab 6
John has a brain
![Page 7: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/7.jpg)
© 2015 Tech3Lab 7
All Johns have the same cognitive abilities
![Page 8: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/8.jpg)
© 2015 Tech3Lab 8
John lives in the IS literature
![Page 9: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/9.jpg)
© 2015 Tech3Lab 9
John is doing an IS task
![Page 10: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/10.jpg)
© 2015 Tech3Lab 10
![Page 11: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/11.jpg)
© 2015 Tech3Lab 11
Constant Linear Averaged Normal
![Page 12: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/12.jpg)
© 2015 Tech3Lab 12
John lives in the real world
![Page 13: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/13.jpg)
© 2015 Tech3Lab 13
Learning
Automaticity and habits
EmotionsDisorder
Diversity
Unconscious
![Page 14: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/14.jpg)
© 2015 Tech3Lab 14
![Page 15: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/15.jpg)
© 2015 Tech3Lab 15
We are all different John
![Page 16: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/16.jpg)
© 2015 Tech3Lab 16
Objective : Provide a pilot study of the cognitive analysis grid with in a task that involves multiple steps
![Page 17: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/17.jpg)
© 2015 Tech3Lab 17
Protocol on how to use the CA grid : 1. Evaluating the cognitive demand
of the interface 2. Evaluating the users’ baseline
cognitive capacities. 3. Evaluating the users’ cognitive
performance in the task.
![Page 18: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/18.jpg)
© 2015 Tech3Lab 18
The CA Grid (Revised)
![Page 19: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/19.jpg)
© 2015 Tech3Lab 19
Journal of the International Neuropsychological Society (2014), 20, 11–19.Copyright E INS. Published by Cambridge University Press, 2013.doi:10.1017/S1355617713001094
SPECIAL SERIES
NIH EXAMINER: Conceptualization and Development ofan Executive Function Battery
Joel H. Kramer,1 Dan Mungas,2 Katherine L. Possin,1 Katherine P. Rankin,1 Adam L. Boxer,1
Howard J. Rosen,1 Alan Bostrom,1 Lena Sinha,1 Ashley Berhel,1 AND Mary Widmeyer3
1Department of Neurology, University of California, San Francisco, California2Department of Neurology, University of California, Davis, California3Rosalind Franklin University of Medicine and Science, Chicago, Illinois
(RECEIVED March 18, 2013; FINAL REVISION August 23, 2013; ACCEPTED August 30, 2013; FIRST PUBLISHED ONLINE October 8, 2013)
Abstract
Executive functioning is widely targeted when human cognition is assessed, but there is little consensus on howit should be operationalized and measured. Recognizing the difficulties associated with establishing standard operationaldefinitions of executive functioning, the National Institute of Neurological Disorders and Stroke entered into a contractwith the University of California-San Francisco to develop psychometrically robust executive measurement tools thatwould be accepted by the neurology clinical trials and clinical research communities. This effort, entitled ExecutiveAbilities: Measures and Instruments for Neurobehavioral Evaluation and Research (EXAMINER), resulted in a seriesof tasks targeting working memory, inhibition, set shifting, fluency, insight, planning, social cognition and behavior.We describe battery conceptualization and development, data collection, scale construction based on item responsetheory, and lay the foundation for studying the battery’s utility and validity for specific assessment and research goals.(JINS, 2014, 20, 11–19)
Keywords: working memory, cognitive control, fluency, planning, social cognition, item response theory
INTRODUCTION
Executive deficits are reported in numerous neurobehavioralconditions, and may be the primary locus of cognitiveimpairment in attention-deficit/hyperactivity disorder (Barkley,2010), behavioral variant frontotemporal dementia (Booneet al., 1999; Hutchinson & Mathias, 2007; Slachevsky et al.,2004), subcortical ischemic vascular disease (Moorhouseet al., 2010; Reed et al., 2004), traumatic brain injury(Caeyenberghs et al., 2012; Levin & Hanten, 2005; Stuss,2011), multiple sclerosis (Arnett et al., 1997; Chiaravalloti &DeLuca, 2003; Foong et al., 1997), Huntington’s disease(Aron et al., 2003; Paulsen, 2011), progressive supranuclearpalsy (Gerstenecker, Mast, Duff, Ferman, & Litvan, 2013),Parkinson’s disease (Ravizza & Ciranni, 2002), andeven normal aging (Amieva, Phillips, & Della Sala, 2003;Buckner, 2004).
Neuroscientists and cognitive psychologists have begun toparse executive functioning into subcomponents and identify
relevant anatomical regions and networks. Clinical assess-ment of executive control, however, has fallen behind thesebasic science advances. This gap is particularly evident inclinical trials, where despite the importance of executiveabilities for daily living (Asimakopulos et al., 2012; Cahn-Weiner, Boyle, & Malloy, 2002), measures of executiveability are often omitted or underrepresented in clinical trialbatteries. When executive functioning is targeted in research,there is considerable variability in how it is operationallydefined. Tasks purportedly measuring fluency, workingmemory, concept formation, set shifting, inhibition, organiza-tion, abstract reasoning, and novel problem solving, eitherindividually or in various combinations, are all used asmarkers of executive functioning, with the implicit assumptionthat these tasks measure the same construct.
Recognizing the challenges associated with conceptualizingand measuring executive functioning, the National Institute ofNeurological Disorders and Stroke (NINDS) awarded acontract to the University of California-San Francisco(UCSF) to develop psychometrically robust executive mea-surement tools that would be accepted by the neurologyclinical trials and clinical research communities. Initial goals
Correspondence and reprint requests to: Joel H. Kramer, 675 NelsonRising Lane, Suite 190, MC 1207, San Francisco, CA 94158. E-mail:[email protected]
11
![Page 20: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/20.jpg)
© 2015 Tech3Lab 20
Examples of cognitive testsDomain : Working memory
N-Back task : Spatial working memory
Domain : Inhibition
Flanker task : Response inhibition and cognitive control
Domain : Set Shifting
Dimensional set shifting : Measurement of switching costs
![Page 21: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/21.jpg)
© 2015 Tech3Lab 21
Experimental task
![Page 22: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/22.jpg)
© 2015 Tech3Lab 22
Example of completed CA grid
![Page 23: Using A Cognitive Analysis Grid to Inform Information Systems Design](https://reader030.vdocument.in/reader030/viewer/2022032505/55c63463bb61eb95668b4632/html5/thumbnails/23.jpg)
© 2015 Tech3Lab 23