nm community survey
TRANSCRIPT
Pacific Institute for Research and Evaluation www.pire.org
NM Community Survey
Data Collection Training
February 9, 2021
1
Photo credit: TruScribe
You are experts in your own communities
Agenda
• Important Dates for your Calendar
• Why We Survey
• Changes to the Survey for FY 21
• Changes to the Data Collection Process for FY21
• Protocol Development
• Budget Reminders from OSAP
• Data Entry and Analysis
• Contact Us3
Important Dates for Your Calendar
February 16- First draft of data collection protocol
due to PIRE
February 17-22 - PIRE internal review of data
collection protocols. PIRE will work with sites
individually to prepare protocol for SEOW review
February 19-25 - SEOW reviews
February 26 - PIRE works with communities to
finalize protocols
March 1- Data collection may begin with approved
protocol and online survey goes live4
Important Dates for Your Calendar
• Mid-March TBD - Data Entry Training
• April 30 - Data collection ends
• May 7 - Data files (for paper surveys) are due
• June 1-15 - PIRE returns aggregated data files to
LEs
• Late June - PIRE returns R-reports (if resources
available)
• July 15 - All EOY reporting documents submitted
to OSAP
5
6
NEW MEXICO COMMUNITY SURVEY (NMCS)
WHY WE SURVEY
What is NMCS?
• Gathers state- and community-level data on ATOD and
prescription drug use
• Evaluates effectiveness of locally implemented
environmental strategies on intervening variables and
outcomes
• FY 2020-11,774 surveys; 75% online
7
How Will the Data be Used?
• Programs and communities to assess local needs and track
changes over time in key prevention areas
• OSAP to track changes in ATOD use & IVs over time at a state
level
• State agencies to improve & increase prevention services to all
New Mexicans
• SEOW (State Epi Outcomes Workgroup) to monitor and track
local progress
• PPC (Statewide Prevention Policy Consortium), & PDO
Advisory Board to encourage alignment of goals among state
agencies
• How do you use the data? 8
The NM Community Survey
• Sample: Adults 18 years and older living in
NM
• Goal = collect reasonably representative
sample of adults in the community
March 1-April 30, 2021 (9 weeks)
9
10
NEW MEXICO COMMUNITY SURVEY (NMCS)
CHANGES TO THE SURVEY FOR FY21
BIG, Ol’,
CAVEAT
11
The NM Community Survey-
Core + 10 Optional Modules
• Core (38)
• adverse childhood
experiences (ACEs)
(12)
• college community (1)
• community alcohol-
related harms (10)
• gambling (5)12
• marijuana (15)
• mental health (12)
• methamphetamine (7)
• additional opioid questions
(9)
• poly-substance use (6 for
PFS-20; 2 for all others)
• tobacco (7)
Changes to NMCS in FY21
Mostly online; online recruitment focus
expanded at state and program levels
• Core
•Mental Health
•Limited changes to Community, Marijuana,
and Meth Modules
•New PFS20 Module
13
The NM Community Survey- Core
• 38 questions (paper/offline Qualtrics
survey)
• Covers the following topics:
– Demographics
– Perception of ATOD within the community
– Alcohol consumption & access
– Prescription painkiller use & access
14
Online survey link = Core + 2 Poly-substance
use (30 day meth and polysub use)
Changes to the Core
Are you?
Do you think of yourself as?
What sex is listed on your original birth
certificate (sex assigned at birth)?
15
Changes to the Core
Do you identify as LGBTQ?
Which of the following best describes how
you think of yourself?
16
Changes to Mental Health
Anxiety
Poor physical or mental health keep you
from doing your usual activities, such as
self-care, work or recreation?
At any time in the past year, did you think
about killing yourself?
2 suicide questions17
Changes to Community Alcohol
Harms Related Module
In your opinion, when is it okay for someone
to provide alcohol to minors (i.e., under 21)
(not for religious purposes)?
Moved from Core to Community Module
18
Changes to Marijuana Module
Have you ever used marijuana?
Have you used marijuana in the past 12
months?
I support local law enforcement actions to
prevent driving under the influence of
marijuana.
19
Changes to Meth Module
Have you ever used methamphetamine?
Have you used methamphetamine in the
past 12 months?
20
Photo credit: Pixabay
Photo credit: Chris Yates
21
Take a Minute…
Questions?
22
NEW MEXICO COMMUNITY SURVEY (NMCS)
CHANGES TO DATA COLLECTION
PROCESS FY21
Data is collected online or in-person
New Mexican residents only
18 or older
1 submission per person
23
Minimum Requirements for In-Person
24
Recruitment Ideas
25
• Visual Media
• Direct Mail
• Social Media
• Partnerships
• Working with Municipalities/Local Systems
You can spend money on these things!
See protocol for full descriptions and
examples!
State-Wide Recruitment Efforts
• PIRE uses social media research and advertising to target
web-savvy participants in your communities.
• PIRE places and monitors Facebook & Instagram ads in
English and Spanish.
• Halfway through, we will begin zipcode targeting in areas
with low response rates
26
State-Wide
Visual Ad
27
Who Needs Posters?
Who needs fliers?
How many?
Write us in the chat!
Example of Social Media Ads
28
Example of a Community Ad
29
Example of a Very Effective Ad
30
Discussion
Photo credit: Burst
32
NEW MEXICO COMMUNITY SURVEY (NMCS)
PROTOCOL DEVELOPMENT
Protocol Overview
• Every community must submit a data collection
protocol to PIRE
• Must be approved prior to collecting any data
33
For those who have conducted the
survey in previous years…
• You must use the FY 21 form. It has changed A
LOT!
34
New to data collection? Welcome!
Email PIRE if you do not have access to your FY20 files.
Data Collection Protocol seeks to
Balance Multiple Needs
• Safe data collection practices
• Seeking “randomness”
• Representative
• Culturally appropriate
• Provides voice to difficult to reach populations
35
Who are You Sampling?
• NM residents
• 18 and over (oversample young adults)
• This includes:
– Spanish & English speaking
– Parents
– Elderly
– Undocumented & non U.S. Citizens
– College students
– All race/ethnicities
– Sexual & gender minorities 36
Choosing Optional Modules
• You may choose to add any of the additional
modules to paper/Qualtrics offline or on-line.
– Remember how much additional questions increase
the time to take the survey, and choose wisely.
• NOTE: You may also add additional questions
pertaining to your evaluation needs*
– Questions must be approved by PIRE/SEOW and
must include a statement that questions are directly
from the provider and not OSAP. (See protocol
document)37
Incentives for Participation
38
To participate in the drawing….
39
Incentives for Online Data Collection
• Online incentives are only available if the
participant takes the survey online
– No connection between your responses and your
information for the drawing.
– Only eligible to win the weekly incentive during the
week you completed the survey.
• Duplicate entries are not allowed. (We
remove duplicate entries from later drawings.)
40
Start Planning Now for Data
Collection
While waiting for feedback on your
protocol, start getting your recruitment into
place.
• You may need to get permission to recruit in many
places
41
Final Words on Data Collection
Protocol
• Remember that if you make a significant
change to your protocol after it has been
approved, such as adding a site or changing
an ad, you must let PIRE know.– PIRE’s IRB requires that we supervise data collection in
this way. If data collection occurs in other ways, it could
inadvertently incur a violation & all data collection must
stop for the entire state
42
Pacific Institute for Research and Evaluation www.pire.org
OSAP Budget Slides 2021
Budgeting for the data collection - from OSAP
• Same Process: Budget form is due Feb 19th
• to OSAP for review and approval
• I will do a walkthrough of those instructions separately from this training
• Any budget modifications must also be approved by OSAP
• Consider how and who completes data collection and data entry
• least expensive options preferable (e.g. volunteers)
• Actual cash incentives over $1 are no longer allowed, as per OSAP
Covid adjustments
• **Gift cards/incentives should be limited to
the number of paper surveys expected
and cannot be used for other coalition
purposes**
• Since Covid is making most of the data
collection online
– recruitment and promotion will be bigger
sections of your budget this year (printing and
media)
– For any in-person paper surveys, think about
An Important Word about Stipends &
Budgets – from OSAP
• Maximum stipend $2.50 gift card this year• Ask for in-kind/ donated/coupon incentives
– Pair with OSAP dollars only if no other options
• Good ballpark for stipends/incentives is $2, less is ideal!
• Focus on your elevator pitch
– On why data/ data collection is important
• Consider other options (e.g. Lottery style, raffle: donated
items/cards, store coupons, etc.)
Stipends (FKA: Incentives)
• You don’t have to provide a gift to participants, but highly recommended:
– Gift cards work great but you must track every bit of money that is given for auditing purposes.
– Water, candy bars, healthy snacks.
– Not substance abuse, mental health, prescription drug, or alcohol related gifts, even if it is promoting the prevention coalition.
– Consider tracking different incentives to study what works best.
• You may not collect any personal or identifying information on respondents
• Can you get donated gifts, e.g., coupons?
47
48
NEW MEXICO COMMUNITY SURVEY (NMCS)
EARLY LOOK AT DATA ENTRY AND ANALYSIS
Data Entry and Analysis
• We will provide a training on data entry in mid-
March only for communities collecting
paper/pencil
• PIRE provides cleaned data file with all your data
combined from the on-line surveys and any that
are gathered in other communities.
• Your local evaluator will help you to create any
graphs or tables and Community Survey Findings
Sheet. 49
Where else can NMCS information be found?
50
51
NEW MEXICO COMMUNITY SURVEY (NMCS)
CONTACT US
If you have questions in the field…
• Dave Currey 919-265-2622
• Ashley Simons-Rudolph - 919-622-5220
• Marissa Elias – 575-202-2232
• Kim Zamarin 505-907-0801
52