volume’18,issue’3 · ii. student services(continued) ne# sp’13 ne# fl’13 ne# sp’14 ne#...
TRANSCRIPT
Volume 18, Issue 3 June 2015
Institutional Research Review E-‐Learning (NEMCC) Course Evaluation Results (Fall 2014 and Spring 2015)
The E-‐Learning Course Evaluation Survey evaluates effectiveness of distance learning instruction and the E-‐Learning Student Services Survey evaluates effectiveness of student support services. As continuation for the 2014-2015 year, these surveys were conducted through the Mississippi Community College Board (MCCB) Canvas server with notification being sent through a Canvas announcement to all MSVCC students to participate in the surveys. The data for NEMCC was extracted by MCCB and the evaluation results were reviewed for analysis by the NE Office of Planning & Research. The following are the results of the E-‐Learning Course Evaluations for Fall 2014 and Spring 2015 including longitudinal data results from Spring 2013 to Spring 2015. Also, listed below is comparative data of the overall results of the MSVCC Course Evaluation for Fall 2014 and Spring 2015. I. General Information Students were asked to respond regarding their experience with the online course. In the Spring of 2015, 79% responded this course was effective as an online course, 10% responded this course would be better in a traditional face-to-face setting, and 11% responded this course is appropriate in an online environment but would benefit from periodic face-to-face interaction.
II. Course Evaluation (consisted of 7 questions)
NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
1. This course is what you expected. Agree/Strongly Agree Disagree/Strongly Disagree
93% 7%
87% 11%
88% 10%
90% 8%
89% 10%
90% 9%
89% 9%
2. Course information including course goals/objectives, grading procedures, etc. was made available to me. Agree/Strongly Agree Disagree/Strongly Disagree
96% 3%
96% 4%
95% 4%
96% 4%
95% 4%
97% 3%
95% 3%
3. The course site was well organized and easy to navigate. Agree/Strongly Agree Disagree/Strongly Disagree
95% 4%
94% 5%
91% 8%
95% 5%
94% 5%
94% 4%
94% 5%
4. The course activities and assignments contributed to my learning. Agree/Strongly Agree Disagree/Strongly Disagree
95% 4%
95% 5%
93% 6%
94% 6%
94% 5%
93% 6%
94% 6%
5. The textbook supported the course presentations and was appropriate. Agree/Strongly Agree Disagree/Strongly Disagree
95% 4%
93% 6%
92% 6%
94% 4%
93% 4%
92% 5%
93% 5%
6. The supplemental materials (handouts, web links, study guide, demonstration materials) contributed to the learning experience. Agree/Strongly Agree Disagree/Strongly Disagree
93% 5%
92% 7%
92% 6%
93% 6%
91% 6%
92% 6%
92% 6%
7. Testing procedures were fair and supported the learning experience. Agree/Strongly Agree Disagree/Strongly Disagree
92% 6%
92% 6%
93% 6%
94% 5%
92% 6%
93% 6%
92% 6%
III. Interaction and Communication (consisted of 5 questions)
NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
1. I had adequate interaction with the instructor. Agree/Strongly Agree Disagree/Strongly Disagree
90% 8%
87% 10%
89% 10%
87% 9%
90% 8%
91% 7%
90% 7%
2. I had adequate interaction with other students. Agree/Strongly Agree Disagree/Strongly Disagree
74% 16%
70% 14%
72% 18%
78% 14%
72% 19%
83% 11%
83% 11%
3. Various opportunities for interaction were provided. Agree/Strongly Agree Disagree/Strongly Disagree
82% 11%
78% 13%
81% 14%
83% 12%
81% 13%
88% 8%
87% 8%
4. Class interactions enhanced the learning experience. Agree/Strongly Agree Disagree/Strongly Disagree
70% 14%
66% 16%
71% 15%
77% 13%
71% 16%
78% 12%
80% 11%
5. I felt actively engaged with my classmates and my instructor as a part of a learning community instead of being “on my own.”
Agree/Strongly Agree Disagree/Strongly Disagree
75% 16%
69% 18%
73% 19%
74% 17%
72% 18%
80% 13%
81% 12%
E-Learning (NEMCC) Student Services Survey Results (Fall 2014 and Spring 2015) The intent of this survey is to provide data from students who have taken e-‐learning (on-‐line) classes through Northeast Mississippi Community College as a host institution of the Mississippi Virtual Community College. Also, listed below is comparative data to the overall results of the MSVCC Student Services Survey. This survey instrument was developed to evaluate student services in the areas of student services, library resources and services, and technology.
As continuation for the 2014-2015 year, the MSVCC Student Services Survey was conducted through the MCCB’s Canvas server with notification being sent through a Canvas announcement to all MSVCC students. The data for NEMCC was extracted by MCCB with evaluation results reviewed for analysis by the NE Office of Planning & Research. The following are the results of the E-‐Learning Student Services Survey for Fall 2014 and Spring 2015 including longitudinal data results from Spring 2013 to Spring 2015. For Spring 2015, there were 228 out of 1688 (non-duplicated headcount), giving a response rate of 13.5% (Source: NEMCC Fact Sheet-E-Learning Student Profile Spring 2015).
I. General Information (Questions 1-11 summarized) 54% of the students responded to have taken three or more on-‐line courses
previous to the Spring 2015 semester, 22% responded to have not taken any previous online course, 16% responded to taking one, and 9% responded to taking two previously. 52% of the students who responded to the survey classified themselves as sophomores, 42% as freshman, 4% as dual enrolled – high school, and 2% classified themselves as not seeking a degree. 83% of the respondents were of white race/non-‐Hispanic, 15% were black, and 2% Hispanic. 83% were female and 17% were male. The average age was 25. 29% were married and 63% were single, 8% were divorced/separated. 81% identified themselves as an Academic (University Parallel) major, 14% as a Technical major, and 5% as a Career/Vocational major. In response to question 8, “What is your primary reason for taking online classes?” 46% responded online classes fit my job/work hours better, 17% responded family/home (including child care), 9% responded easy alternative to regular classes, 8% responded online experience was positive, 6% responded class was unavailable or a traditional section was not open, 3% responded transportation issues, 2% responded recommendation by my advisor, and 2% responded recommendation by my friend. In response to question 9, “If online courses were not available, would you have enrolled in regular classroom course?” 36% definitely would have taken a regular class, 30% probably would have taken a regular class, 25% probably would not have taken a regular class, and 9% definitely would not have taken a regular class. In response to question 10 “Based on your experience so far, how do you feel the quality of online instruction compares with traditional classroom instruction?” 47% responded instructional quality is about the same, 29% responded traditional classroom instruction is better, and 25% responded online instruction is better. In response to question 11 “Based on your experience so far, how do you feel the integrity of online instruction compares with traditional courses you have taken?” 71% responded integrity is about the same, 15% responded online instruction integrity is better, and 14% responded traditional classroom integrity is better.
IV. Instructor (consisted of 6 questions)
NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
1. The instructor conducted the course in a way that accomplished the stated course objectives.
Agree/Strongly Agree Disagree/Strongly Disagree
94% 6%
93% 6%
92% 6%
93% 5%
92% 8%
95% 4%
93% 5%
2. The instructor demonstrated a thorough knowledge of subject. Agree/Strongly Agree Disagree/Strongly Disagree
93% 5%
95% 3%
94% 4%
93% 6%
91% 6%
93% 4%
93% 5%
3. The instructor was effective in utilizing distance learning technology. Agree/Strongly Agree Disagree/Strongly Disagree
93% 6%
92% 7%
91% 7%
92% 7%
91% 6%
93% 6%
93% 6%
4. The instructor responded to request for assistance in a reasonable amount of time. Agree/Strongly Agree Disagree/Strongly Disagree
93% 4%
90% 7%
91% 6%
92% 4%
91% 6%
92% 5%
92% 5%
5. The instructor’s response to course activities, assignments and graded work was timely and appropriate.
Agree/Strongly Agree Disagree/Strongly Disagree
94% 5%
91% 7%
93% 6%
94% 3%
92% 6%
93% 5%
93% 5%
6. The instructor displayed professionalism and respect for students. Agree/Strongly Agree Disagree/Strongly Disagree
96% 2%
93% 5%
93% 4%
95% 2%
94% 4%
95% 3%
94% 3%
II. Student Services (consisted of 8 questions)
NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
1. General information regarding the college was accessible or was provided to me. Agree/Strongly Agree Disagree/Strongly Disagree
96% 3%
96% 3%
94% 3%
95% 3%
93% 4%
95% 3%
95% 3%
2. Registration for online courses was easy and adequately supported. Agree/Strongly Agree Disagree/Strongly Disagree
98% 2%
96% 3%
93% 5%
99% 0%
94% 3%
93% 4%
94% 4%
3. Information regarding college policies and procedures was made available to me. Agree/Strongly Agree Disagree/Strongly Disagree
97% 2%
97% 3%
95% 4%
97% 2%
94% 3%
95% 2%
95% 3%
4. Program and course advisement services were made available to assist me in course selection and placement.
Agree/Strongly Agree Disagree/Strongly Disagree
93% 2%
93% 5%
89% 7%
93% 3%
91% 5%
90% 5%
90% 4%
II. Student Services (Continued) NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
5. Please rate your satisfaction with communication with the following student services offices
a. Admission/Records Agree/Strongly Agree
Disagree/Strongly Disagree b. Counseling/Advising Agree/Strongly Agree Disagree/Strongly Disagree c. Financial Aid Agree/Strongly Agree Disagree/Strongly Disagree d. Business Services Agree/Strongly Agree Disagree/Strongly Disagree e. Housing Agree/Strongly Agree Disagree/Strongly Disagree f. Recruiting Agree/Strongly Agree Disagree/Strongly Disagree g. Bookstore Agree/Strongly Agree Disagree/Strongly Disagree h. eLearning/Distance Learning Agree/Strongly Agree Disagree/Strongly Disagree
92% 3%
85% 6%
83% 9%
83% 5%
47% 4%
46% 4%
88% 4%
92% 4%
92% 3%
88% 4%
84% 5%
83% 3%
47% 1%
49% 1%
88% 7%
93% 5%
91% 5%
86% 8%
79% 9%
79% 6%
54% 5%
51% 7%
83% 6%
91% 6%
87% 5%
89% 4%
81% 7%
89% 3%
48% 4%
49% 7%
88% 6%
89% 7%
88% 5%
85% 6%
81% 6%
84% 5%
51% 3%
51% 3%
84% 5%
89% 4%
85% 5%
80% 8%
75% 11%
75% 6%
44% 4%
48% 4%
85% 3%
87% 5%
96% 5%
82% 8%
78% 8%
76% 6%
48% 4%
51% 4%
85% 2%
87% 5%
6. The college provided adequate access to textbook services and course materials.
Agree/Strongly Agree Disagree/Strongly Disagree
90% 9%
89% 9%
87% 12%
91% 7%
91% 5%
89% 7%
91% 5%
7. The college provided adequate access to financial aid services. Agree/Strongly Agree Disagree/Strongly Disagree
87% 6%
87% 4%
86% 6%
85% 7%
84% 6%
82% 8%
84% 6%
8. Information regarding campus activities was accessible. Agree/Strongly Agree Disagree/Strongly Disagree
0% 0%
0% 0%
0% 0%
0% 0%
0% 0%
0% 0%
0% 0%
III. Library Resources/Services (consisted of 7 questions)
NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
1. The course(s) that I am currently taking requires library resources/research Yes No
48% 52%
49% 51%
44% 56%
39% 61%
52% 48%
42% 58%
45% 55%
2. For my online course assignments, I needed book and magazines, which were NOT online.
Yes No
28% 72%
29% 71%
34% 66%
33% 67%
32% 68%
31% 69%
31% 69%
3. If I needed resource books and magazines, which were NOT online, an alternate method for obtaining the resources was available.
Agree/Strongly Agree Disagree/Strongly Disagree
0% 75%
0% 71%
0% 76%
64% 36%
68% 32%
68% 32%
70% 30%
4. Instructions for using library resources were adequate and effective. Agree/Strongly Agree Disagree/Strongly Disagree
0% 82%
0% 79%
0% 84%
75% 25%
81% 19%
73% 27%
75% 25%
5. Instructions for using library resources were provided in the following ways: Online through MELO Handouts Faculty Instruction Librarian
23% 21% 20% 16%
22% 21% 21% 15%
21% 20% 21% 18%
28% 22% 20% 12%
25% 23% 22% 16%
22% 18% 19% 15%
24% 19% 21% 13%
6. Check the following electronic resources that you have used: MAGNOLIA Products (EBSCO host & others) MELO (MS Electronic Libraries Online) Online Library Catalogs Others
22% 25% 20% 15%
24% 25% 19% 14%
23% 24% 21% 16%
21% 25% 20% 14%
23% 26% 22% 16%
20% 19% 18% 15%
23% 20% 20% 14%
7. During this semester, I used library resources in the following ways: Online In Person Telephone Not at all
44% 26% 3% 28%
45% 24% 2% 29%
46% 24% 1% 29%
41% 20% 1% 37%
51% 28% 2% 18%
39% 23% 2% 36%
44% 24% 2% 30%
E-Learning Overall Retention and Success Rates (Spring 2010-Spring 2015)
• Retention Rate is based upon the number of students who completed the course compared to the number
of students who began the course.
• Success Rate is based upon students achieving a grade of D or above including the Audit grade of N compared to the total number of students enrolled.
Please note all traditional ratings only include the same classes that were offered via E-Learning method as well.
SP’10 FL’10 SP’11 FL’11 SP’12 FL’12 SP’13 FL’13 SP’14 FL’14 SP’15 EL Retention Rates 75.5% 75.8% 77.8% 80.6% 79.3% 79.2% 80.2% 82.6% 82.4% 82.3% 86.4%
TRAD Retention Rates 84.9% 86.1% 84.7% 85.1% 85.9% 85.0% 86.6% 86.9% 88.2% 86.6% 89.1%
EL Success Rates 64.0% 64.1% 63.9% 67.0% 63.2% 62.5% 66.6% 69.0% 71.5% 71.5% 70.4%
TRAD Success Rates 71.3% 72.0% 69.4% 71.7% 74.2% 73.2% 75.3% 76.7% 77.2% 75.0% 76.3%
*EL retention and EL success rates represent NE students only due to unavailability of class rosters from MSVCC. Observation from the analysis is that since Spring 2010 to Spring 2015, there has been a 10.9% increase in E-‐Learning Retention Rates compared to a 4.2% increase in Traditional Retention Rates. Regarding Success Rates, since Spring 2010 to Spring 2015, there has been a 6.4% increase in E-‐Learning classes compared to a 5.0% increase in Traditional classes.
If you have any questions, please feel free to contact our office
Angie Mason at ext. 7458 or Brad Holley at ext. 4084
IV. Technology (consisted of 5 questions)
NE SP’13
NE FL’13
NE SP’14
NE FL’14
NE SP’15
MSVCC FL’14
MSVCC SP’15
1. I understood that this course would be conducted completely online. Agree/Strongly Agree Disagree/Strongly Disagree
99% 1%
98% 1%
98% 0%
96% 1%
97% 1%
96% 1%
95% 1%
2. Prior to enrolling in an online course, I was made aware that I must have access to a reliable computer with consistent internet connectivity.
Agree/Strongly Agree Disagree/Strongly Disagree
99% 0%
98% 2%
98% 1%
97% 2%
96% 2%
95% 3%
95% 2%
3. I was appropriately prepared with the technical skills needed to be successful in an online course.
Agree/Strongly Agree Disagree/Strongly Disagree
96% 4%
96% 4%
94% 4%
96% 3%
93% 5%
93% 5%
93% 4%
4. Canvas functioned properly with minimal problems. Agree/Strongly Agree Disagree/Strongly Disagree
93% 6%
79% 19%
88% 4%
97% 2%
92% 5%
90% 7%
91% 6%
5. Technical support was adequate. Agree/Strongly Agree Disagree/Strongly Disagree
90% 4%
89% 5%
86% 4%
87% 6%
84% 7%
84% 5%
85% 4%