school health policies and programs study (shpps) data ...school health policies and programs study...
TRANSCRIPT
![Page 1: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/1.jpg)
Macro International Inc.
7315 Wisconsin Avenue, Suite 400W, Bethesda, MD 20814
(301) 657-3070 | www.orcmacro.com
School Health Policies and Programs Study
(SHPPS) Data Collection Management System
Ben Harper Tonja Kyle
![Page 2: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/2.jpg)
(SHPPS) Data Collection Management System
The data collection management system was used to support a collection with:
• 18,200 respondents
• 68 data collectors in the field
• 1,100 site visits
• 50 States
Planning efficiency was a top priority
Each data collector needed to visit:
• 2 schools each week
• 2 days at each school
• 9+ data collections per school
![Page 3: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/3.jpg)
(SHPPS) Data Collection Management System
Will Be Discussing:
• The data collection
• The system designed to support it
• Features developed to insure efficiency
• Lessons learned
![Page 4: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/4.jpg)
Study Overview
![Page 5: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/5.jpg)
(SHPPS) Data Collection Management System
Funded by the Centers for Disease Control and Prevention (CDC), Division of Adolescent and School Health (DASH)
Also funds/supports other surveillance studies:
• Youth Risk Behavior Survey (YRBS)
• State-level YRBS studies
![Page 6: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/6.jpg)
(SHPPS) Data Collection Management System
Assessed eight components of school health programs:
• Health education
• Physical education
• Health services
• Mental health and social services
• School policy and environment
• Food service
• Faculty and staff health promotion
• Family and community involvement
![Page 7: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/7.jpg)
(SHPPS) Data Collection Management System
History
• First conducted in 1994, the study is conducted every 6 years
• Interviews conducted at the elementary, middle/junior and senior high school levels
• District- and state-level interviews conducted using Computer Assisted Telephone Interviewing (CATI)
• School- and classroom-level data collected via Computer Assisted Personal Interviewing (CAPI)
• SHPPS 2006 targeted all 50 States and DC, 819 districts and 1,420 schools
![Page 8: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/8.jpg)
(SHPPS) Data Collection Management System
Study Challenges
• Recruit and track contacts and respondents
from 50 States, 819 districts and 1,420 schools
times 7
• Generate tailored letters with individualized cc:
lists and inserts for contacts and respondents
• Manage participation and respondent status
• Schedule 1,420 schools for data collection to
occur in a 12-week window
![Page 9: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/9.jpg)
(SHPPS) Data Collection Management System
Study Challenges (continued)
• Locate schools in the sample that are clustered together for a more timely and cost effective approach to data collection
• Randomly select courses and teachers from within each sampled school
• Manage 68 data collectors and their CAPI workstations
• Manage uploading of completed CAPI records
• Resolve data errors
![Page 10: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/10.jpg)
The Collection Management System
![Page 11: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/11.jpg)
Logical layout
QuickSAT
CAPI Tool
Macro
CATI System
Respondents
Contact Permission
Collection Contacts
State
Respondents
Contact Permission
Collection Contacts
District
Availability
Class Respondents
School Respondents
Contact Permission
Collection Contacts
School
Contact Management Letter Generation Reporting
Data Collector Assignment
Trip Planning
School Scheduling Nearest Neighbor
Calendar
SHPPS Collection Management System
![Page 12: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/12.jpg)
The SHPPS Management System
![Page 13: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/13.jpg)
The Collection Management System…
As Told by The Interface Designer
![Page 14: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/14.jpg)
SHPPS: Designing for the User You Know
Recruiters were well represented during the
design process.
Their workflow was well documented and
understood.
The Contacts database designed for them
performed well, and the design has been
carried forward into newer systems.
![Page 15: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/15.jpg)
School Information
![Page 16: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/16.jpg)
Collection Contacts
![Page 17: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/17.jpg)
Participation (State)
![Page 18: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/18.jpg)
Cc: Lists
![Page 19: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/19.jpg)
State/District/School Respondents
![Page 20: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/20.jpg)
SHPPS: Designing for the User You Don’t Know
Letters requesting participation in the data collection were sent to states, districts, schools, and participants.
Thousands of letters.
The letters merged information from the contact database for both their content and their cc: listings.
However, the workflow for letter generation was not entirely known at design time, and we never had the opportunity to speak to the users who would be performing that task.
![Page 21: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/21.jpg)
Letter Generation
![Page 22: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/22.jpg)
SHPPS: Taking Advantage of the technology
With data collectors traveling across the country it was important to align their schedules with the geography.
Schools that were ready for visits were placed on the calendar.
Groups of nearby schools could be put into a trip which could be assigned to a data collector.
What do you do when an isolated school needs to be visited? Look for other schools in the same county? The same State?
![Page 23: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/23.jpg)
Finding Nearby Schools
![Page 24: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/24.jpg)
SHPPS: Feature Rich Calendar
The Calendar interface combined the needs of the
school, the wishes of the data collector, and the
limitations of linear time into one interface.
The task it supported was very complex, so the
interface provided some tools to reduce
complexity.
With training the calendar was effective for its
intended task, and supported workflow that kept
the data collection moving forward.
![Page 25: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/25.jpg)
Calendar
![Page 26: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/26.jpg)
Adding Schools to the Calendar
![Page 27: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/27.jpg)
Visit Schedule
![Page 28: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/28.jpg)
SHPPS: “Problem Children”
If you think a design is trouble when you design it,
you’re probably right.
The system supported random sampling of Health
and PE instructors, classes and sections.
By answering a number of questions in a set order,
recruiters could be sure that the sample selected
was not biased.
Errors on the other hand, were not accounted for.
![Page 29: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/29.jpg)
Classroom Sampling (1/3)
![Page 30: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/30.jpg)
Classroom Sampling (2/3)
![Page 31: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/31.jpg)
Classroom Sampling (3/3)
![Page 32: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/32.jpg)
SHPPS: Monitoring Data Submission Integrity
Data collectors in the field submitted
records nightly, allowing for potential
errors.
A submission monitoring system flagged
potential trouble before data was added to
the database.
![Page 33: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/33.jpg)
Data Error Resolution
![Page 34: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/34.jpg)
Macro International Inc.
7315 Wisconsin Avenue, Suite 400W, Bethesda, MD 20814
(301) 657-3070 | www.orcmacro.com
(SHPPS) Data Collection Management System
Ben Harper - [email protected]
Tonja Kyle - [email protected]
Questions?
![Page 35: School Health Policies and Programs Study (SHPPS) Data ...School Health Policies and Programs Study (SHPPS) Data Collection Management System Ben Harper Tonja Kyle (SHPPS) Data Collection](https://reader033.vdocument.in/reader033/viewer/2022060401/5f0e30437e708231d43e089f/html5/thumbnails/35.jpg)
Presentation Supported by…
Macro International Establishment Survey Research Center
• A virtual clearinghouse for research on procedures and practices in conducting
surveys of establishments
• Based in Macro International’s Bethesda offices but drawing on expertise from a
number of University and Corporate entities
• Web-portal to provide links to:
existing research
conferences
collections of original research and white papers
Other data sources
www.ESRConline.com (Coming Summer 2007)