![Page 1: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/1.jpg)
Web Screen Presentation Using Blaise 5
Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat
Joelle Michaels, Energy Information Administration
1
![Page 2: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/2.jpg)
Agenda Challenges on the CBECS
Approaches to Meeting those Challenges
Look and Feel
Survey-Specific Issues
Next Steps
2
![Page 3: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/3.jpg)
CBECS • CBECS 2018 collects data on more than 8,000 commercial buildings in the United States
• Complex survey
• Building size
• Building use
• Energy use: electricity, gas, oil, steam, water
3
![Page 4: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/4.jpg)
CBECSData Collection
• CBECS has been collecting data since 1979
• Blaise in use for CAPI and CATI since 1999
• 2018: respondents choose web or CAPI
• Expected 40% web, 60% CAPI
• Transition to web means moving to Blaise 5
• Also means re-thinking key elements of the survey design and presentation
4
![Page 5: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/5.jpg)
Web Survey Challenges
The move to web data collection has meant two kinds of challenges:
1. Look and Feel
2. Survey-Specific Issues
5
![Page 6: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/6.jpg)
Approach EIA and Westat formed a “best practices” team to
• Identify issues presented by web data collection
• Review the literature
• Convene expert survey methodologists
• Prototype and test candidate solutions
• Review and recommend outcomes
6
![Page 7: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/7.jpg)
Challenge:
LookandFeel
Categorical Question
7
![Page 8: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/8.jpg)
Challenge:
LookandFeel
Continuous Question
8
![Page 9: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/9.jpg)
Challenge:
CBECS Design
Considerations moving from CAPI-only to multimode web and CAPI
• Show Cards
• Question-specific help
• Optional text and Probing
• Item Nonresponse
9
![Page 10: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/10.jpg)
Show Cards
• Previously hard copy
• Shorten
• Add to screen
10
![Page 11: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/11.jpg)
Show Cards
11
![Page 12: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/12.jpg)
Question-Specific Help
• In CAPI we used question-by-question help text
• CAPI interviewers pressed F1 for help
• Experimented with “tool tips” but did not work with mobile browsers
12
![Page 13: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/13.jpg)
Question-Specific Help
13
![Page 14: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/14.jpg)
Interviewer Instructions
Probing
• Interviewer instructions eliminated
• Probes converted to question text
14
![Page 15: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/15.jpg)
Interviewer Instructions
Probing
Probes are added to the
question text
15
![Page 16: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/16.jpg)
Item Non-Response
Accommodating DK and Ref was challenging
• Remove DK and Ref as responses
• Assume Empty = non-response
• New missing value: SK for “skipped”
16
![Page 17: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/17.jpg)
Item Non-Response
Leaving the field EMPTY
triggers a prompt
17
![Page 18: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/18.jpg)
Item Non-Response
Explicit Don’t Know
18
![Page 19: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/19.jpg)
Lessons Learned &Next Steps
• Managing Specifications
• Mobile
• Main study questionnaire
19
![Page 20: Web Screen Presentation Using Blaise 5 - Census.govWeb Screen Presentation Using Blaise 5 Michelle Amsbary, Rick Dulaney, Justin Kamens, Westat Joelle Michaels, Energy Information](https://reader034.vdocument.in/reader034/viewer/2022051921/600e98d8c73d4a4ce74e5654/html5/thumbnails/20.jpg)
Thank You
20
For more information