data collection and management: where the rubber hits the road
DESCRIPTION
Data Collection and Management: Where the Rubber Hits the Road. Karen L. Franck, PhD Extension Specialist. UT SNAP-Ed Program. 92 out of 95 counties funded 2008-2009 fiscal year 71,405 volunteer educators 7,234,830 indirect contacts 802,398 direct contacts. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/1.jpg)
Data Collection and Management: Where the Rubber Hits the Road
Karen L. Franck, PhDExtension Specialist
![Page 2: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/2.jpg)
UT SNAP-Ed Program
• 92 out of 95 counties funded• 2008-2009 fiscal year– 71,405 volunteer educators– 7,234,830 indirect contacts– 802,398 direct contacts
![Page 3: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/3.jpg)
System for University Planning Evaluation & Reporting (SUPER)
• Statewide database• Multiple functions• County Agent responsible for data entry
![Page 4: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/4.jpg)
Education & Administrative Reporting System
• Consistent reporting across states– # of participants– # contacts– Impacts– Demographics
![Page 5: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/5.jpg)
Dueling DatabasesRacial Groups for UT SUPER• White• Black or African American• American Indian or Alaskan
Native• Asian or other Pacific
Islander
• Hispanic
Racial Groups for USDA EARS
• White• Black or African American• American Indian or Alaska
Native• Asian• Native Hawaiian or Other
Pacific Islander
• All racial groups are classified as either non-Hispanic or Hispanic
![Page 6: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/6.jpg)
Before Collecting Data
• Data Collection PlanWHO, WHAT, WHERE, WHEN & HOWWHY should have been answered long
ago
![Page 7: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/7.jpg)
Training for Data Collection
• Need for consistent and accurate data• Address all procedures and special
instructions• Anticipate potential issues
![Page 8: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/8.jpg)
![Page 9: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/9.jpg)
Lessons Learned the Hard Way
• Nutrition education classes for adults implemented in 12 counties1 county received older version of surveys 3 month follow-up right at Christmas
• SNAP-Ed programming in local school systemProgram Assistant was not aware of need
for data collection until last day of school
![Page 10: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/10.jpg)
During Data Collection
• Ongoing training and support• Quality checks
Address major & minor issuesLook at data during collection
![Page 11: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/11.jpg)
More Hard Lessons
• Summer cooking camp for middle graders Introduced post-collection: “Make sure your scores have
improved!”
• No participant identification numbers on mailed follow-up surveys
• Over 75% of participants didn’t fill in last question• Transposed numbers
532 out of 412 participants reported eating more fruit
![Page 12: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/12.jpg)
After Data Collection
• Acknowledge issues and limitations resulting from data collection methods
• Learn from successes & mistakes!
![Page 13: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/13.jpg)
Final Hard Lessons
• 5 years of data sitting in a file cabinet
• Outcome indicators changed but same survey continued to be used
![Page 14: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/14.jpg)
Data Management Plan
• Maintain a raw data set• Backup data set• Guard confidentiality• Develop a codebook for all variables
(collected & created)
![Page 15: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/15.jpg)
Quality Checks
For all variables (collected & created)• Run frequencies• Crosstabs• Check the range• Have a plan for outliers• Missing value analyses
![Page 16: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/16.jpg)
Sources
Fink, A. (2003). The Survey Handbook. London: Thousand Oaks.
Schalock, R. L. (2001). Outcome-based Evaluation. New York: Kluwer Academic/Plenum Publishers.
The University of Texas-Houston Health Science Center School of Public Health and The Texas Department of Health. Practical Evaluation of Public Health Programs Workbook. Available at http://www2.cdc.gov/phtn/Pract-Eval/workbook.asp .
Wholey, J. S., Hatry, H. P., & Newcomer, K. E. Editors. (2004). Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass.
Townsend surveys and training tools: http://townsendlab.ucdavis.edu/
![Page 17: Data Collection and Management: Where the Rubber Hits the Road](https://reader036.vdocument.in/reader036/viewer/2022062410/56815b2f550346895dc8f7a6/html5/thumbnails/17.jpg)
THANK YOU
Karen L. Franck, PhDExtension Specialist
University of Tennessee ExtensionTennessee Nutrition & Consumer
Education Program865-974-7457