student satisfaction report: pacific oaks college office of institutional research tcs education...

Student Satisfaction Report:Pacific Oaks College

Office of Institutional ResearchTCS Education System

August 7, 2014

Table of Contents

Background 3Executive Summary 5

OIR Recommendations 8Detailed Findings 9

2

BackgroundThis report presents findings of statistical analyses of data from the Pacific Oaks Student Satisfaction Survey over the time period from 2012 to 2014.

Data were analyzed using SPSS, Version 20.0.

Items in this survey primarily use five-point scales. Average item ratings of 4.0 or higher are often used as a benchmark to guide interpretation of findings.

In this report, when the word “significant” is used, that means that a difference is statistically significant, i.e. a statistical significance test has been conducted.

3

Background

4

Survey Year

Modality Number of Survey Invitations Number of Survey Responses

Response Rate

Survey Start Date

Survey End Date

2012 Pasadena 644 214 33.2% April 09 April 18

Online 123 75 60.9% April 09 April 18

Sites NA NA NA NA NA

Total 767 289 37.6% April 09 April 18

2013 Pasadena 602 207 34.4% April 05 April 29

Online 214 101 47.2% April 05 April 29

Sites 168 47 28.0% April 05 April 29

Total 984 355 36.1% April 05 April 29

2014 Pasadena 463 160 34.6% May 19 June 16

Online 286 98* 34.3% May 19 June 16

Sites 151 64 42.4% May 19 June 16

Total 900 322 35.8% May 19 June 16

* 92 Students enrolled in the Summer 2014 term.

Executive SummaryStudent Satisfaction and Loyalty by Modality - Among students enrolled in Online programs and in non-Pasadena ground locations, there were no statistically significant mean differences on measures of student satisfaction and loyalty by survey administration year.- Among students enrolled in programs at the Pasadena campus there were statistically significant mean differences on the following measures of student satisfaction and loyalty between the 2014 survey administration year and earlier administration years:•How satisfied are you with your overall academic experience at PO?•Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“•My overall experience at PO has met my expectations

Student Satisfaction and Loyalty by School - Within the School of Cultural and Family Psychology and the School of Human Development, there were no statistically significant mean differences on measures of student satisfaction and loyalty by survey administration year.- Among students in programs of the School of Education there were statistically significant mean decreases between the 2013 and 2014 survey administration years on the following items:•How satisfied are you with your overall academic experience at PO?•Please rate your level of agreement with the statement, "I would recommend PO to friends / family …”•My overall experience at PO has met my expectations.

LMS Platform - Within the Pasadena and Online modalities, there were statistically significant decreases in student satisfaction between 2012 and 2013 (eCollege) and 2014 (Canvas) with the LMS platform in use on the following survey items:•eCollege / Canvas courses are easy to navigate and use•eCollege / Canvas courses are conducted effectively by PO instructors

5

Executive SummaryPasadena Campus – In addition to the previously described statistically significant decreases when comparing the 2014 survey administration year to the 2013 and 2012 years, the Pasadena campus experienced statistically significant decreases on the following items also:•Staff's response to concerns I've expressed•If I have questions I know which staff members to contact•Process of registering for courses•Courses are available to fit my schedule•Accessibility to academic advising•Overall quality of academic advising•Overall experience of the practicum process•Registrar's Office - Communication•Business Office – Communication and Hours of Operation

Promotion of Diversity – Between the 2012 and 2014 survey administration years, the Pasadena campus experienced statistically significant declines in mean student agreement that the following aspects of diversity are promoted at Pacific Oaks College:•Faculty and staff create safe environments …•Course content is balanced and inclusive …•Developmental education is practiced by accommodating different learning styles …•Inclusive classroom and co-curricular environments promote mutual respect …•I feel actively engaged in the learning process

6

Executive SummaryAttainment of Professional Skills - Between 2012 and 2014 the Pasadena campus experienced statistically significant declines in mean student agreement that Pacific Oaks College has helped them attain the following skill areas:•Multicultural competence•Professional practice skills•Ability to behave in a professional manner

Interest Levels in Possible New Services for Students - Across all possible new services and across all modalities, there have been no statistically significant changes in student interest level over the time period from 2012 to 2014.

7

OIR RecommendationsPasadena Campus – Mean ratings on key measures of student satisfaction and loyalty, as well as other satisfaction survey items, have shown statistically significant decreases between 2014 and earlier administrations of the annual student satisfaction survey.

Recommendation: Leadership of PO should conduct research at the Pasadena campus to determine the causes of these declines, and then develop and implement strategies to improve levels of student satisfaction and loyalty at the Pasadena campus.

LMS Platform – The rollout of Canvas in 2014 as the Learning Management System at Pacific Oaks College saw statistically significant declines in satisfaction among both Pasadena and Online students when compared to eCollege.

Recommendation: Leadership of PO should conduct research at both the Pasadena and Online campuses to determine what factors are causing these declines from a student perspective. Once these factors have been identified, PO should develop and implement strategies to improve student satisfaction levels with

Canvas.

Potential New Services to Offer to Students – Across modalities across the time period from 2012 to 2014 there have been no statistically significant changes in student interest levels in any potential new service tested.

Recommendation: Leadership of PO should conduct research at both the Pasadena and Online campuses to determine what additional services students perceive would be most useful to them in terms of facilitating their academic success. PO should take these findings, validate them with quantitative research, and then develop and implement these new services, in keeping with budget constraints.

Additional Research - Leadership of PO, in collaboration with OIR, should conduct statistical analysis to identify drives of student satisfaction, especially for among students at the Pasadena campus. Results of this analysis can also be used to identify survey items for possible deletion.

8

Measures of Satisfaction and LoyaltyMeasures of Satisfaction and Loyalty ¹

Pasadena Online Sites

2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean n Mean n Mean n Mean n Mean n Mean n Mean n Mean n

How satisfied are you with your overall academic experience at PO?

4.34(c)

208 4.35(c)

200 4.06(a)(b)

156 4.27 73 4.47 98

4.33 85 4.33 43 4.31 58

Please rate your level of agreement with the statement, "I made the right choice byenrolling at PO.“

4.49(c)

201 4.44 198 4.25(a)

152 4.56 71 4.60 98

4.46 84 4.37 43 4.25 55

1 Items use five-point scales

The Pasadena campus experienced a statistically significant decline in mean student satisfaction with their overall academic experience at Pacific Oaks in 2014 compared to 2013 and 2012.

The Pasadena campus experienced a statistically significant decline in mean student agreement that they made the right choice by enrolling at Pacific Oaks when comparing 2014 to 2012.

For students enrolled in online programs or in non-Pasadena ground programs, there were no statistically significant mean differences on these two items by survey administration year.

9

Measures of Satisfaction and LoyaltyMeasures of Satisfaction and Loyalty ¹


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Please rate your level of agreement with the statement, "I would recommend PO to friends / family …”

4.44 201 4.33 198 4.24 152 4.52 71 4.59 98 4.44 84

4.35 43

4.20 55

My overall experience at PO has met my expectations.

4.36(c)

200 4.29 197 4.09(a)

151 4.49 71 4.42 98 4.30 82

4.42 43

4.22 55


Within each modality there were no statistically significant mean differences in likelihood to recommend PO across the time period from 2012 to 2014.

Within the Pasadena modality, the mean rating of agreement that the student experience had met expectations in 2014 was statistically significantly lower than the mean rating in 2012.

10

Satisfaction and Loyalty by SchoolMeasures of Satisfaction and Loyalty ¹ Cultural and Family Psychology

2012(a)

2013(b)

2014(c)

Mean n Mean n Mean n

How satisfied are you with your overall academic experience at PO? 4.23 62 4.39 83 4.11 93

Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“

4.50 60 4.40 83 4.25 91


4.45 60 4.33 83 4.21 91

My overall experience at PO has met my expectations. 4.32 59 4.25 83 4.11 90


Among students in programs in the School of Cultural and Family Psychology there were no statistically significant mean differences on satisfaction and loyalty items over the time period from 2012 to 2014.

11

Satisfaction and Loyalty by SchoolMeasures of Satisfaction and Loyalty ¹ Education

2012(d)

2013(e)

2014(f)


How satisfied are you with your overall academic experience at PO? 4.00 30 4.38(f)

72 3.80(e)

45

Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“

4.28 29 4.42 72 4.12 43


4.24 29 4.43(f)

72 3.98(e)

43

My overall experience at PO has met my expectations. 4.07 29 4.36(f)

72 3.86(e)

42


Among students in programs of the School of Education there were statistically significant mean decreases between the 2013 and 2014 survey administration years on the following items:

•How satisfied are you with your overall academic experience at PO?•Please rate your level of agreement with the statement, "I would recommend PO to friends / family …”•My overall experience at PO has met my expectations.

12

Satisfaction and Loyalty by SchoolMeasures of Satisfaction and Loyalty ¹ Human Development

2012(g)

2013(h)

2014(i)


How satisfied are you with your overall academic experience at PO? 4.41 189 4.37 186 4.34 161

Please rate your level of agreement with the statement, "I made the right choice byenrolling at PO.“

4.55 183 4.54 184 4.40 157


4.50 183 4.44 184 4.42 157

My overall experience at PO has met my expectations. 4.47 183 4.38 183 4.30 156


Among students in programs in the School of Human Development there were no statistically significant mean differences on satisfaction and loyalty items over the time period from 2012 to 2014.

13

Satisfaction with Instruction and Course Work

In the PAST ACADEMIC YEAR, how satisfied have you been with the:¹


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean

n Mean n Mean n Mean n Mean n Mean n Mean n Mean n

Quality of instructionprovided by faculty

4.30 212 4.45 201 4.29 154 4.08 74 4.40 98 4.34 87 4.40 43 4.22 59

Consistency of instruction across faculty

4.03 208 4.09 199 3.87 151 3.75 72 4.04 95 3.77 87 4.12 41 3.74 58

Intellectual challenge of the course work

4.36 210 4.39 199 4.18 152 4.39 74 4.59 98 4.54 85 4.51 43 4.29 58

Quality of academic courses you've taken

4.39 211 4.43 200 4.21 154 4.36 73 4.59 98 4.45 86 4.47 43 4.43 58

Number of courses taught by my department's corefaculty

4.05 200 4.08 193 3.81 150 4.08 63 4.19 86 3.89 73 4.32 38 4.07 54


Within each modality there were no statistically significant differences in mean ratings of satisfaction with instruction and course work over the time period 2012 to 2014.

14

Satisfaction with Academic SupportIn the PAST ACADEMIC YEAR, how satisfied have you been with the:¹


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean


Staff's response to concerns I've expressed

4.06(c)

200 4.07(c)

194 3.70(a)(b)

149 4.18 73 4.25 91 4.12 85 4.21 42 3.96 56

Support received from my Student Advisor

NA NA NA NA NA NA NA NA NA NA NA NA 3.93 40 3.86 58

Support received from my Academic Advisor


Support received from the Financial Aid Office



Within the Pasadena modality, the mean rating of satisfaction with staff responses to concerns expressed by students for 2014 was significantly lower than mean ratings of satisfaction for 2013 and 2012.

15

Satisfaction with TechnologyIn the past academic year, how satisfied have you been with the: ¹


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean n Mean

n Mean n Mean n Mean n Mean n Mean n Mean n

Quality of the classroomfacilities

4.20 194 4.41 189 4.28 154 NA NA NA NA NA NA 4.20 41 4.11 54

Availability of technologicalresources

3.84(b)(c)

188 4.45(a)

184 4.34(a)

151 NA NA NA NA NA NA 3.90 40 3.96 53

Effective use of technology in courses

3.92(b)

199 4.27(a)

184 4.06 153 4.44 72 4.50 98 4.39 82 4.12 41 4.02 54


Among students enrolled at the Pasadena campus, mean ratings of satisfaction with the availability of technological resources in 2014 and 2013 were statistically significantly greater than 2012.

Among students enrolled at non-Pasadena ground sites and online, there were no statistically significant mean differences in satisfaction with instructional technology by survey administration year.

16

Satisfaction with Course RegistrationIn the past academic year, how satisfied have you been with the: 1


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Process of registering forcourses

3.92 207 4.15(c)

195 3.71(b)

152 4.36 69

4.58 89

4.42 77

4.40 40

4.32 50

Availability of courses to allow progress toward the completion of my degree

3.89 203 4.00 190 3.76 153 4.61 70

4.65 97

4.49 81

4.60 40

4.55 n

Availability of elective courses

3.71 177 3.84 175 3.66 131 4.16 51

4.40 70

4.09 57

4.29 31

4.00 31


At the Pasadena campus, mean student satisfaction with the process of registering for courses was statistically significantly lower in 2014 than in 2013.

Among students enrolled in online programs and at non-Pasadena ground sites, there were no statistically significant mean differences on survey items dealing with the course registration process by survey administration year.

17

Use of (School)HelpDeskHave you ever used the (school) HelpDesk (email or phone)?


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n

Yes 63.2 % 132 65.7 % 132 57.3 % 90 52.0 % 39 31.6 % 31

35.3 % 30

60.5 % 26

44.1 % 26

No 17.7 % 37 11.4 % 23 22.9 % 36 18.7 % 14 26.5 % 26

27.1 % 23

18.6 % 8 23.7 % 14

No, I’ve never had a need.

19.1 % 40 22.9 % 46 19.7 % 31 29.3 % 22 41.8 % 41

37.6 % 32

20.9 % 9 32.2 % 19

TOTAL 100.0 % 209 100.0 % 201 100.0 % 157 100.0 % 75 100.0 % 98

100.0 % 85

100.0 % 43

100.0 % 59

Within each modality, there were no statistically significant differences in School HelpDesk usage pattern by year across the time period of 2012 to 2014.

18

Satisfaction with (School) HelpDeskIn regards to your (school) HelpDesk experience, how satisfied have you been with the:1


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean n Mean


Time it took to resolve your issue

4.13 118 4.08 125 3.94 83 4.05 37 4.40 30 4.31 29 4.16 25 4.32 25

Availability of the HelpDesk staff

4.17 123 4.05 128 3.99 87 4.11 35 4.29 31 4.31 29 4.08 26 4.35 26


Within each modality, there were no statistically significant mean differences in school HelpDesk satisfaction by year across the time period of 2012 to 2014.

19

Academic AdvisingIn the PAST ACADEMIC YEAR, how satisfied have you been with the:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean


Accessibility to academic advising

3.88(c)

206 3.89(c)

199 3.55(a)(b)

154 NA NA NA NA NA NA 3.93 40 4.11 54

Accessibility to academic chair advising

NA NA NA NA NA NA 4.18 56 4.17 75 3.86 70 NA NA NA NA

Quality of New Student Orientation

3.84 164 4.03 157 3.91 127 3.87 63 4.04 84 3.84 73 3.85 41 4.08 53

Accessibility to student services advising


Overall quality of academic advising

3.85(c)

205 3.92(c)

195 3.52(a)(b)

153 4.04 70 4.28 97 4.08 83 4.10 42 4.24 55

Overall experience of the practicum process

3.97(c)

140 3.89(c)

141 3.48(a)(b)

102 NA NA NA NA NA NA 4.26 34 4.42 38

Overall quality of my academic program

4.31 204 4.31 196 4.08 153 4.41 71 4.60(f)

97 4.28(e)

82 4.33 43 4.39 57


In terms of academic advising, mean ratings by students at the Pasadena campus in 2014 were statistically significantly lower than mean ratings in 2013 and 2012 in the following areas:•Accessibility to academic advising•Overall quality of academic advising•Overall experience of the practicum process

20

Communication and Hours of Academic Support Departments

In the past academic year, how satisfied have you been with communication and hours of operation from the following departments:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Admissions

- Communication 4.09 200 4.07 192 3.89 144 4.41 70 4.28 96 4.26 80 3.98 41 3.96 56

- Hours of Operation

3.98 187 3.99 175 3.87 141 4.27 63 4.16 88 4.16 76 4.06 33 3.91 54

Registrar's Office

- Communication 4.13(c)

203 4.06(c)

198 3.80(a)(b)

149 4.03 67 4.12 95 4.12 81 3.95 42 3.82 56


3.99 189 3.97 181 3.81 144 4.08 62 4.09 88 4.06 77 4.06 34 3.92 53

Student Services (CARE)

- Communication 3.94 201 3.94 193 3.86 145 3.96 68 4.05 95 4.12 82 3.70 40 3.75 56


3.80 187 3.97 176 3.81 142 4.03 62 4.03 87 4.12 78 3.79 33 3.76 54


Within the Pasadena modality mean student satisfaction with Registrar Office communications in 2014 was statistically significantly lower when compared to 2013 and 2012.

21




2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean n Mean


Financial Aid

- Communication 3.61(b)

201 3.90(a)

196 3.90 147 3.86 69 4.02 95 4.10 81 3.95 42 3.96 57


3.73 186 3.94 181 3.85 143 3.95 62 3.98 86 4.13 77 4.15 34 3.93 54

Business Office

- Communication 3.80 196 3.89(c)

188 3.59(b)

143 NA NA NA NA NA NA 3.70 40 3.71 56


3.78 183 3.90(c)

172 3.61(b)

140 NA NA NA NA NA NA 3.88 33 3.76 54


Within the Pasadena modality mean student satisfaction with Business Office communication and hours of operation were statistically significantly lower when compared to 2013 average ratings.

22




2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Information Technology

- Communication 4.01 199 3.99 192 3.88 146 4.11 64 4.13 94 4.06 80 3.66 41 3.70 56


3.89 187 3.89 176 3.81 143 4.13 62 4.10 86 4.11 76 3.79 33 3.76 54

Library

- Communication NA NA NA NA NA NA NA NA NA NA NA NA 3.36(h)

42 3.77(g)

56



Student Accounts

- Communication NA NA NA NA NA NA 4.06 67 4.09 95 4.18 82 NA NA NA NA



1 Items use five-point scales 23

Library and Computer LabConsidering the past academic year, what is your level of agreement with the following statements:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Courses are available to fitmy schedule.

4.04(c)

202 3.97 198 3.70(a)

152 4.72 71 4.47 96 4.50 82 4.56 43 4.39 56

Library resources and services are appropriate for my needs.

3.82 202 3.72 198 3.87 152 3.99 71 3.89 96 3.93 82 3.72 43 3.84 56

The library’s hours of operation fit my schedule.

3.58 201 3.60 198 3.70 152 NA NA NA NA NA NA 3.52 42 3.55 56

The computer lab isappropriate for my needs.

4.01 201 4.06 198 4.06 151 NA NA NA NA NA NA 3.30 40 3.36 55

The computer lab's hours of operation fit my schedule.

3.95 200 4.08 197 4.06 151 NA NA NA NA NA NA 3.33 40 3.36 55

Areas for study are made available to me.

3.59 201 3.49 197 3.79 152 NA NA NA NA NA NA 3.58 40 3.56 55


Within the Pasadena modality the mean rating of agreement that courses are available to fit student schedules in 2014 was statistically significantly lower than the mean rating of agreement in 2012 .

24

Use of Smart ThinkingHave you ever used Smart Thinking?


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n

Yes NA NA

NA NA NA NA NA NA NA NA NA NA 7.0 % 3 8.9 % 5

No NA NA


I don’t know what Smart Thinking is

NA NA


TOTAL NA NA

NA NA NA NA NA NA NA NA NA NA 100.0 %

43 100.0 % 56Awareness of Smart Thinking increased among students at non-Pasadena ground sites between 2013 and 2014.

25

Use of ePortfolio / CanvasHave you used ePortfolio / Canvas at PO?


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n

Yes 71.9 % 146 86.9 % 172 94.7 % 144 NA NA NA NA NA NA 88.4 % 38 92.9 % 52

No 28.1 % 57 13.1 % 26 5.3 % 8 NA NA NA NA NA NA 11.6 % 5 7.1 % 4

TOTAL 100.0 % 203 100.0 % 198 100.0 % 152 NA NA NA NA NA NA 100.0 %

43 100.0 % 56Usage of a Learning Management System (LMS) – whether eCollege of Canvas - among Pasadena students has increased significantly over the time period from 2012 to 2014.

26

Use of ePortfolio / Canvas HelpDeskHave you ever used the ePortfolio / Canvas HelpDesk (email or phone)?


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n

Yes NA NA

NA NA NA NA 64.0 % 48 50.0 % 49 43.7 % 38 60.5 % 26 44.1 % 26

No NA NA

NA NA NA NA 13.3 % 10 19.4 % 19 23.0 % 20 18.6 % 8 23.7 % 14

No, I’ve never had a need.

NA NA

NA NA NA NA 22.7 % 17 30.6 % 30 33.3 % 29 20.9 % 9 32.2 % 19

TOTAL NA NA

NA NA NA NA 100.0 %

75 100.0 % 98 100.0 %

87 100.0 %

43 100.0 % 59

Within the Online and non-Pasadena ground site modalities, there were no statistically significant differences in usage pattern of the LMS platform HelpDesk (ePortfolio and Canvas).

27

Satisfaction with eCollege / CanvasConsidering your use of eCollege / Canvas within the past academic year, what is your level of agreement with the following statements:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


eCollege / Canvas courses are easy tonavigate and use

3.65(c)

144 3.72(c)

172 3.25(a)(b)

144 4.59(f)

71 4.46(f)

97 3.81(d)(e)

83

4.03 37

3.75 52

eCollege / Canvas courses areconducted effectively by PO instructors

3.68(c)

142 3.62(c)

171 2.97(a)(b)

143 4.01 71 4.15(f)

97 3.62(e)

84

3.84 37

3.56 52


Within the Pasadena and Online modalities, there were statistically significant decreases in student satisfaction between 2012 and 2013 (eCollege) and 2014 (Canvas) with the LMS platform in use.

28

Personal Life and Course WorkPersonal Life and Course Work


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


If I have questions I know which staff members to contact.

3.65 201 3.74(c)

198 3.37(b)

152 4.10(f)

71 3.95 98 3.71(d)

84 3.79 43

3.87 55

PO provides properchannels of communicationfor students.

3.64 200 3.62 198 3.38 152 4.13 71 3.97 98 3.82 83 3.65 43

3.80 54

As a student at PO, I am able to maintain a healthy balance between my personal life and my course work / training.

3.87 200 3.85 197 3.77 149 3.79 71 3.86 98 3.90 83 4.07 43

3.85 55


Within the Pasadena and Online modalities, there were statistically significant decreases in mean student ratings of knowing who to contact if they have questions when comparing 2014 to prior years (either 2012 or 2013).

29

Student SafetyConsidering the past academic year, what is your level of agreement with the following statements:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean n Mean


I am aware of (campus)Advisory / emergency action plans.

2.71 198 2.74 197

2.70 151 2.67 70 2.66 97 2.67 82 2.62 42 3.02 55

I feel safe and secure on campus.

3.83(b)(c)

197 4.18(a)

196

4.23(a)

150 NA NA NA NA NA NA 3.43(h)

42 3.84(g)

55

I feel the information I send and receive online is secure.

4.05 198 4.06 197

4.03 150 4.13 71 4.07 97 3.96 83 3.98 43 4.04 54


Within the Pasadena and non-Pasadena ground site modalities, students reported significantly greater mean levels of agreement that they feel safe and secure on campus when comparing 2014 ratings to prior year ratings (2012 for Pasadena and 2013 for non-Pasadena ground sites).

However, students indicated mean levels of agreement of generally less than 3.0 on a five-point scale in terms of awareness of advisory / emergency action plans.

30

Preparedness in Use of IntuitHow prepared do you feel about the online student account system, Intuit?


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean n Mean


3.91 200 3.93 197

3.71 150 3.92 71 4.12 98 3.98 84 3.84 43 3.87 55


Within each modality there were no statistically significant differences in mean perceived preparedness to use Intuit over the time period of 2012 through 2014.

31

Use Career ServicesHave you used Career Services?


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n

Yes 10.0 % 20 8.6 % 17 9.3 % 14 2.8 % 2 3.1 % 3 7.1 % 6 4.7 % 2 3.6 % 2

No 52.5 % 105 57.1 % 113 50.3 % 76 28.2 % 20

40.8 % 40 29.8 % 25 69.8 % 30

74.5 % 41

No, but I would like to

37.5 % 75 34.3 % 68 40.4 % 61 69.0 % 49

56.1 % 55 63.1 % 53 25.6 % 11

21.8 % 12

TOTAL 100.0 % 200 100.0 % 198 100.0 % 151 100.0 % 71

100.0 %

98 100.0 % 84 100.0 % 43

100.0 % 55Within each modality there were no statistically significant differences in usage patterns of Career Services over the time period of 2012 through 2014.

Large percentages of students in the online modality reported that while they had not used Career Services they would like to do so.

32

Satisfaction with Career ServicesHow satisfied are you with the following components of your Career Services experience:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

Mean

n Mean


Quality of Career Services

3.75 20 4.24 17 3.46 13 3.50 2 3.00 3 4.00 6 4.03 37 3.75 52

Availability of CareerServices

3.60 20 4.00 17 3.43 14 3.50 2 3.00 3 4.00 6 3.84 37 3.56 52


Within each modality there were no statistically significant differences in mean ratings of satisfaction with components of the student Career Services experience over the time period of 2012 through 2014.

33

Promotion of DiversityPlease rate your level of agreement with the following statements:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Faculty and staff create safe environments in which multiple voices and perspectives are shared and heard.

4.40(c)

200 4.34 197 4.12(a)

150 4.41 71 4.53 98

4.37 83

4.37 43 4.07 55

Course content is balanced and inclusive so that diverse perspectives are explored.

4.47(c)

200 4.39 196 4.19(a)

151 4.58 71 4.49 98

4.46 82

4.47 43 4.29 55


Within the Pasadena modality, average student ratings of agreement in 2014 were significantly lower than average student ratings of agreement in 2012 on the following items relating to the promotion of diversity at Pacific Oaks:

•Faculty and staff create safe environments in which multiple voices and perspectives are shared and heard.•Course content is balanced and inclusive so that diverse perspectives are explored.

34

Promotion of DiversityPlease rate your level of agreement with the following statements:


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Developmental education is practiced by accommodating different learning styles, cognitive abilities, and sociocultural influences in the classroom.

4.45(c)

200 4.34(c)

196 4.09(a)(b)

151 4.48 71 4.30 98

4.16 83 4.51(h)

43

4.16(g)

55

Inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence.

4.46(c)

199 4.42(c)

197 4.19(a)(b)

150 4.52 71 4.46 97

4.51 83 4.58 43

4.29 55

I feel actively engaged in the learning process.

4.57(c)

200 4.53(c)

197 4.29(a)(b)

147 4.44 71 4.54 96

4.43 82 4.63 43

4.40 55


Within the Pasadena modality, average student ratings of agreement in 2014 were significantly lower than average student ratings of agreement in 2012 on the following items relating to the promotion of diversity at Pacific Oaks:

•Developmental education is practiced by accommodating different learning styles …•Inclusive classroom and co-curricular environments promote mutual respect …•I feel actively engaged in the learning process.

35

Attainment of Professional SkillsMy experiences at PO have …


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


… advanced my multicultural competence.

4.56(c)

200 4.44 196 4.25(a)

150 4.54 71 4.42 98

4.37 82

4.42 43 4.33 55

… increased my awareness of writing as an important skill in my professional life.

4.42 200 4.27 196 4.20 150 4.48 71 4.29 98

4.26 82

4.56 43 4.29 55

… advanced my professional practice skills.

4.41(c)

199 4.35 196 4.18(a)

149 4.45 71 4.40 98

4.34 82

4.58 43 4.33 55

… prepared me to behave in a professional manner.

4.32(c)

197 4.27(c)

195 4.03(a)(b)

148 4.31 71 4.20 98

4.23 82

4.49 43 4.29 55

… improved my ability to apply theory and scholarship to practice issues.

4.39 196 4.35 195 4.18 149 4.55 71 4.33 95

4.30 82

4.50 42 4.31 54


Within the Pasadena modality, average student ratings of agreement in 2014 were significantly lower than average student ratings of agreement in 2012 on the role their experiences at Pacific Oaks played on the acquisition of the following professional skills:

•Multicultural competence•Professional practice skills•Ability to behave in a professional manner

36

Importance of Attributes to Overall Satisfaction



2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Access to academic support services such as those provided by C.A.R.E., the library, and individual faculty

6.08 214 6.17 207 6.08 160 6.11(f)

75 5.63 98

5.27(d)

92 5.65 43

5.48 64

Learning the most you can from every experience

6.68 214 6.17 207 6.08 160 6.72 75 6.62 98

6.53 92 6.63 43

6.66 64

The academic rigor of your degree program

6.47 214 6.50 207 6.47 160 6.41 75 6.35 98

6.32 92 6.35 43

6.41 64

The value that PO places on each individual student

6.67 214 6.64 207 6.49 160 6.67 75 6.59 98

6.48 92 6.58 43

6.55 64

Being at a college that shares your vision for society

6.61 214 6.62 207 6.52 160 6.60 75 6.60 98

6.46 92 6.56 43

6.50 64

Within the Online modality, the mean rating of the importance played by academic support services in contributing to student satisfaction was significantly lower in 2014 than in 2012.

¹ Scale = 7-point importance scale 37


Attribute Contributing to Overall Satisfaction


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)


Employment in a new career after graduation

6.32 214 6.36 207 6.59 160 5.68 75 6.07 98 5.98 92 5.79 43

5.75 64

Advancement in your current employment

6.12 214 6.08 207 5.91 160 5.80 75 6.21 98 6.22 92 6.37 43

6.22 64

Being able to take required courses in an online delivery mode

4.91 214 4.78 207 4.63 160 NA NA NA NA NA NA 4.77 43

4.64 64

Having face to face contact with Financial Aid Counselors

NA NA NA NA NA NA NA NA NA NA NA NA 5.30 43

4.84 64

Being able to take required courses at an instructionalsite/offsite cohort

NA NA NA NA NA NA NA NA NA NA NA NA 6.72 43

6.80 64

¹ Scale = 7-point importance scale 38

Interest Levels – Student ActivitiesStudent Activities


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n

Not at all Interested

26.5 % 52 22.8 % 44 17.2 % 26 55.7 % 39 40.8 % 40

37.0 % 30 34.9 % 15

42.6 % 23

Somewhat Interested

52.6 % 103 49.2 % 95 52.3 % 79 32.9 % 23 46.9 % 46

49.4 % 40 44.2 % 19

38.9 % 21

Very Interested

20.9 % 41 28.0 % 54 30.5 % 46 11.4 % 8 12.2 % 12

13.6 % 11 20.9 % 9 18.5 % 10

Total 100.0 % 196 100.0 % 193 100.0 % 151 100.0 % 70 100.0 % 98

100.0 % 81 100.0 % 43

100.0 % 54

Within each modality there have been no statistically significant changes in interest levels in student activities over the time period 2012 to 2014.

39

Interest Levels – Copy MachinesCopy Machines Pasadena Online Sites

2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n


24.0 % 47 17.2 % 33 14.7 % 22 NA NA NA NA NA NA 42.9 % 18

54.5 % 30

Somewhat Interested

30.1 % 59 28.1 % 54 34.7 % 52 NA NA NA NA NA NA 31.0 % 13

23.6 % 13

Very Interested 45.9 % 90 54.7 % 105 50.7 % 76 NA NA NA NA NA NA 26.2 % 11

21.8 % 12

Total 100.0 %

196 100.0 % 192 100.0 % 150 NA NA NA NA NA NA 100.0 % 42

100.0 % 55

Within the Pasadena and non-Pasadena modalities there have been no statistically significant changes in interest levels in copy machines over the time period 2012 to 2014.

40

Interest Levels – Writing ServicesWriting Assistance


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n


21.6 % 43 19.6 % 38 23.2 % 35 38.0 % 27

31.6 % 31 34.1 % 28 26.2 % 11 24.1 % 13

Somewhat Interested

35.2 % 70 30.9 % 60 32.5 % 49 45.1 % 32

43.9 % 43 40.0 % 33 47.6 % 20 38.9 % 21

Very Interested

43.2 % 86 49.5 % 96 44.4 % 67 16.9 % 12

24.5 % 24 25.6 % 21 26.2 % 11 37.0 % 20

Total 100.0 % 199 100.0 % 194

100.0 % 151 100.0 % 71

100.0 %

98 100.0 % 82 100.0 % 42 100.0 % 54

Within each modality there have been no statistically significant changes in interest levels in writing assistance over the time period 2012 to 2014.

41

Interest Levels – Daytime CoursesDaytime Courses


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n


40.6 % 78 33.3 % 64 30.2 % 45 NA NA NA NA NA NA 53.5 % 23 64.8 % 35

Somewhat Interested

24.5 % 47 24.0 % 46 29.5 % 44 NA NA NA NA NA NA 30.2 % 13 25.9 % 14

Very Interested

34.9 % 67 42.7 % 82 40.3 % 60 NA NA NA NA NA NA 16.3 % 7 9.3 % 5

Total 100.0 % 192 100.0 % 192 100.0 % 149 NA NA NA NA NA NA 100.0 %

43 100.0 %

54

Within the Pasadena and non-Pasadena modalities there have been no statistically significant changes in interest levels in daytime courses over the time period 2012 to 2014.

42

Interest Levels – Career AssistanceCareer Assistance


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n


NA NA


Somewhat Interested

NA NA


Very Interested NA NA


Total NA NA

NA NA NA NA NA NA NA NA NA NA 100.0 %

43 100.0 %

53

Within the non-Pasadena ground location modality there have been no statistically significant changes in interest levels in career assistance over the time period 2013 to 2014.

43

Interest Levels – Tutoring AssistanceTutoring Services


2012(a)

2013(b)

2014(c)

2012(d)

2013(e)

2014(f)

2013(g)

2014(h)

% n % n % n % n % n % n % n % n


NA NA

NA NA NA NA 65.7 % 46 50.5 % 49 43.9 % 36 NA NA NA NA

Somewhat Interested

NA NA


Very Interested NA NA


Total NA NA


Within the online modality there have been no statistically significant changes in interest levels in tutoring services over the time period 2012 to 2014.

44

student satisfaction report: pacific oaks college office of institutional research tcs education...

Documents

survey administration

following survey items

student satisfaction

significant decreases

significant mean differences

significant mean decreases

word significant

overall experience