campus pulse: a new initiative to increase student survey response rates heather a. kelly assistant...
Post on 20-Dec-2015
213 views
TRANSCRIPT
CAMPUS PULSE:A New Initiative to Increase
Student Survey Response Rates Heather A. Kelly
Assistant Director
Allison M. WaltersInstitutional Research Analyst
University of DelawareOffice of Institutional Research and Planning
Presented at the 2007 Annual AIR Forum Kansas City, MO
June 6, 2007
UD At A Glance
• Doctoral/Research Extensive
• Primarily traditional, residential 4-yr institution
• Fall 2006 EnrollmentUndergraduates: 15,849Graduates: 3,446Professional & Continuing Studies: 1,085TOTAL: 20,380
Past Surveys
• IR typically surveys undergraduates each spring
• Alternate between ACT Survey of Student Opinions, NSSE, or homegrown survey
Examples of Declining Response Rates
ACT Survey of Student Opinions 1995: 27% 1998: 26% 2002: 21% 2006: 16%
NSSE 2001: 44% 2005: 32%
Declining Response RatesWhat are students telling us?
Reasons Complete• Desire to help UD• Related to students’
interests• Results could impact
personal experience• Required minimal effort• Had free time• Approached in-person• Instant incentive
Reasons Do Not Complete• Survey of no interest• Annoyed by
many/multiple requests• Too complicated• Too much time/effort to
complete• Frustrated not seeing
any changes or being notified of results
What to do next???
Introducing the Campus Pulse Initiative
Hot Button Issues
Trabant Student Center• Buses• Campus Life• Class Schedule• Dining• Diversity• Financial Aid• Gym/Athletic Facilities• Safety/Security
Perkins Student Center• Advising• Class Schedule• Course Materials• Dining• Diversity• Parking
Web Survey Administration
Strengths• Time, costs, resources
relatively low• Common data entry
errors eliminated• Data collection process
easily tracked• Immediate access to data
a reality• Interactive process
between survey administrator and respondent
Weaknesses• Issue of anonymity and
loss of confidentiality• Bias due to access• Survey viewed on
different web browsers• Needs to have paper
option available, if requested
• Database has capacity restraints for open-ended comments
Strengths > Weaknesses
Tools to Develop Surveys
• Remark Web Survey
http://www.principia.com
• TargetX
http://www.targetx.com
Pilot Surveys
• Advising
• Diversity
• Safety/Security
Advising
• Newark campus undergraduates: 15,028• Sample size: 5,002 (33%)• Viewed link: 2,810 (56%)• Interacted: 663 (13%)• Follow-up: 4,328• Viewed link: 1,993 (46%)• Interacted: 316 (7%)• OVERALL RESPONSE RATE: 17%
Advising Respondents
Count Valid Percent
Freshman 232 28%Sophomore 203 24%Junior 177 21%Senior 218 26%
Male 245 29%Female 582 70%
Full-time 796 96%Part-time 33 4%
Transfer 89 11%
Black Non-Hispanic 40 5%Asian 31 4%Hispanic 30 4%White Non-Hispanic 704 85%American Indian/Alaska Native 1 0.10%Native Hawaiian/Other Pacific Islander 1 0.10%Other 18 2%
Advising Results
I know how to contact my assigned advisor.
Count Valid PercentStrongly agree 554 67%Somewhat agree 170 20%Neutral 40 5%Somewhat disagree 35 4%Strongly disagree 29 4%
Gaining access to see my advisor is easy for me to accomplish.
Count Valid PercentStrongly agree 327 39%Somewhat agree 240 29%Neutral 96 12%Somewhat disagree 86 10%Strongly disagree 78 9%
I receive sufficient personal attention from my advisor.
Count Valid PercentStrongly agree 224 27%Somewhat agree 185 22%Neutral 152 18%Somewhat disagree 102 12%Strongly disagree 162 20%
My advisor is up-to-date on changes in academic requirements and provides me with accurate information.
Count Valid PercentStrongly agree 249 30%Somewhat agree 181 22%Neutral 170 20%Somewhat disagree 87 11%Strongly disagree 135 16%
Advising Results Continued
On average, how many times per semester do you meet with your advisor?
Count Valid PercentNever 205 25%Once 391 47%Twice 153 18%Three times 50 6%Four times 15 2%More than five times 14 2%
On average, how many times per semester do you correspond with your advisor via email?
Count Valid PercentNever 223 27%Once 228 27%Twice 147 18%Three times 114 14%Four times 51 6%More than five times 58 7%
Advising Results Continued
In my experience with registering for classes, I generally find that the courses that are required for my major are easy to obtain.
Count Valid PercentStrongly agree 178 21%Somewhat agree 350 42%Neutral 128 15%Somewhat disagree 129 16%Strongly disagree 45 5%
Have you ever used a pink permission slip to obtain instructor special permission to add a course for which you were not able to register online?
Count Valid PercentYes 223 27%No 607 73%
If yes, for what reason?
Count Valid PercentMajor requirement 131 16%Degree requirement 62 8%Elective 37 14%
Diversity• Newark campus undergrads/grads minus
advising sample: 13,289• Sample size: 4,424 (33%)• Viewed link: 2,201 (50%)• Interacted: 638 (15%)• Follow-up: 3,775• Viewed link: 1,536 (41%)• Interacted: 290 (8%)• OVERALL RESPONSE RATE: 18%
Diversity Respondents
Count Valid Percent
Freshman 148 19%Sophomore 119 15%Junior 124 16%Senior 140 18%Graduate 245 32%
Male 282 36%Female 493 63%Transgender 2 0.3%
Full-time 718 92%Part-time 60 8%
Transfer 70 9%
Live on-campus 312 40%
Black Non-Hispanic 49 6%Asian 84 11%Hispanic 35 5%White Non-Hispanic 564 73%American Indian/Alaska Native 0 0.0%Native Hawaiian/Other Pacific Islander 2 0.3%Non-Resident Alien 19 2%Other 21 3%
Disability 18 2%
Bisexual 16 2%Gay 13 2%Heterosexual 731 94%Lesbian 4 0.5%Transsexual 2 0.3%
Diversity Results
The University is committed to diversity.
Count Valid PercentStrongly agree 137 18%Somewhat agree 316 41%Neutral 186 24%Somewhat disagree 108 14%Strongly disagree 26 3%
The student population at the University of Delaware should be more diverse.
Count Valid PercentStrongly agree 259 33%Somewhat agree 176 23%Neutral 217 28%Somewhat disagree 94 12%Strongly disagree 28 4%
People with disabilities are provided with opportunities to be involved with the campus community.
Count Valid PercentStrongly agree 153 20%Somewhat agree 242 31%Neutral 312 40%Somewhat disagree 52 7%Strongly disagree 11 1%
Women are encouraged as much as men to participate in class discussions.
Count Valid PercentStrongly agree 460 59%Somewhat agree 199 26%Neutral 84 11%Somewhat disagree 24 3%Strongly disagree 3 0.4%
Diversity Results Continued
Extra-curricular activities reflect the diverse student body.
Count Valid PercentStrongly agree 219 28%Somewhat agree 256 33%Neutral 189 24%Somewhat disagree 79 10%Strongly disagree 23 3%
Courses are taught from a culturally diverse perspective.
Count Valid PercentStrongly agree 138 18%Somewhat agree 291 37%Neutral 218 28%Somewhat disagree 91 12%Strongly disagree 28 4%
I am treated with dignity and respect by faculty.
Count Valid PercentStrongly agree 442 57%Somewhat agree 254 33%Neutral 50 6%Somewhat disagree 19 2%Strongly disagree 7 0.9%
Diversity Results Continued
There is zero tolerance for bias-related acts or acts of intolerance at the University of Delaware.
Count Valid PercentStrongly agree 272 35%Somewhat agree 217 28%Neutral 184 24%Somewhat disagree 68 9%Strongly disagree 32 4%
There are clear procedures for addressing hate crimes.
Count Valid PercentStrongly agree 213 27%Somewhat agree 214 28%Neutral 211 27%Somewhat disagree 89 11%Strongly disagree 40 5%
The University's campus climate is welcoming.
Count Valid PercentStrongly agree 307 40%Somewhat agree 330 42%Neutral 87 11% Somewhat disagree 43 6%Strongly disagree 10 1%
Safety• Newark campus undergrads/grads minus
advising and diversity samples: 8,811• Sample Size: 2,940 (33%)• Viewed link: 1,466 (50%)• Interacted: 438 (15%)• Follow-up: 2,491• Viewed link: 1,016 (41%)• Interacted: 189 (8%)• OVERALL RESPONSE RATE: 19%
Safety Respondents
Count Valid Percent
Freshman 120 21%Sophomore 109 19%Junior 104 18%Senior 91 16%Graduate 145 26%
Male 174 31%Female 392 69%
Full-time 533 94%Part-time 33 6%
Live on-campus 256 45%
Black Non-Hispanic 19 3%Asian 37 7%Hispanic 23 4%White Non-Hispanic 466 82%American Indian/Alaska Native 1 0.2%Native Hawaiian/Other Pacific Islander 2 0.4%Non-Resident Alien 6 1%Other 10 2%
Safety Results
Safety is an issue on this campus.
Count Valid PercentStrongly agree 201 35%Somewhat agree 244 43%Neutral 70 12%Somewhat disagree 45 8%Strongly disagree 5 0.9%
The University makes sufficient effort to ensure that students are safe.
Count Valid PercentStrongly agree 96 17%Somewhat agree 272 48%Neutral 105 19%Somewhat disagree 64 11%Strongly disagree 27 5%
How safe do you feel when you are on campus during the day?
Count Valid PercentExtremely safe 391 69%Somewhat safe 134 24%Neither safe or unsafe 30 5%Somewhat unsafe 11 2%Extremely unsafe 0 0%
How safe do you feel when you are on campus at night?
Count Valid PercentExtremely safe 39 7%Somewhat safe 187 33%Neither safe or unsafe 84 15%Somewhat unsafe 196 34%Extremely unsafe 61 11%
Safety Results Continued
Sufficient blue lights are located throughout campus?
Count Valid PercentStrongly agree 91 16%Somewhat agree 246 43%Neutral 126 22%Somewhat disagree 84 15%Strongly disagree 19 3%
Are you aware of the Campus Escort Service?
Count Valid PercentYes 496 87%No 66 12%
On average, how many times per semester do you utilize the Campus Escort Service?
Count Valid PercentNever 371 65%Once 61 11%Twice 42 7%Three times 33 6%Four times 18 3%More than five times 40 7%
Safety Results Continued
Have you ever reported a crime to Public Safety?
Count Valid PercentYes 63 11%No 505 89%
If yes, how responsive was Public Safety?
Count Valid PercentExtremely responsive 28 5%Somewhat responsive 27 5%Neutral 90 16%Somewhat unresponsive 10 2%Extremely unresponsive 6 1%
Have you ever reported a crime to the Newark Police Department?
Count Valid PercentYes 85 15%No 471 83%
If yes, how responsive was the Newark Police Department?
Count Valid PercentExtremely responsive 40 7%Somewhat responsive 23 4%Neutral 59 10%Somewhat unresponsive 11 2%Extremely unresponsive 8 1%
Incentives???
• Advising78% provided email addresses
• Diversity71% provided email addresses
• Safety77% provided email addresses
Additional Survey Topics
• Registration
• Curriculum/Pedagogy/Course Delivery
