vss pre-conference on research & evaluation, 11/14/2009 evolving evaluation of a state virtual...
TRANSCRIPT
VSS Pre-Conference on Research & Evaluation, 11/14/2009
Evolving Evaluation of a State Virtual School
Tom Clark, PhD TA Consulting
ConsultingConsulting
2008-09 Evaluation Team
John Watson & Jennifer RyanEvergreen Consulting
Cathy CavanaughDrs. Cavanaugh/UF
Meredith DiPietroUNC-Charlotte
Tom ClarkTA Consulting
ConsultingConsulting
MoVIP in 2008-09
Year 2 MoVIP Management Approach DESE oversight Separate instructional management
vendors, K-5 & 6-12 in Y1/Y2 Bocavox SIS used across K-12
Year 2 Enrollments 15,810 enrollments in semester
classes 8,478 - Fall 2008 7,332 – Spring 2009
ConsultingConsulting
MoVIP in 2008-09
F-T P-T TOTAL
K-5: 372 399 771
6-12: 312 1784 2096
TOTAL 684 2183 2867
Unique Finally Enrolled Students
ConsultingConsulting
National SVS Enrollments, 2008-2009
Source: Keep Pace with Online Learning (in press)
ConsultingConsulting
MoVIP Evaluation Plan
1. Are Courses and Teaching High Quality?
2. Are Equal Access and Enhanced Options Being Provided?
3. Are Infrastructure and Support Services Effective?
4. Is Student and Program Success Being Ensured?
ConsultingConsulting
Course & Teaching Quality
Survey Item Parents6-12
Facili-tators
MoVIP offers high quality courses Spring 2009 Fall 2008 Spring 2008
91%91%90%
97%
100%
ConsultingConsulting
Course & Teaching Quality
Survey Item K-5 Student
s
6-12 Student
s
Courses Challenging Spring 2009 Spring 2008
85%86%
83%88%
Courses too Difficult Spring 2009 Spring 2008
13%12%
34%47%
ConsultingConsulting
Course & Teaching Quality
Survey Item 6-12 Student
s
Facili-tators
A Good Teacher Spring 2009 Spring 2008
94%91%
89%94%
Teacher Responds Spring 2009 Spring 2008
84%82%
84%78%
Teacher Helps Spring 2009 Spring 2008
88%78%
88%85%
ConsultingConsulting
Equal Access and Options 40+ presentations statewide by
MoVIP Director in Y2 Outreach to rural districts in Y2
School of Choice designation in Y2 High-enrolling urban districts (KC, STL)
Minority and low income students Elementary division more diverse Good FRL representation in secondary
236 classes available; 89% increase
ConsultingConsulting
Meeting Curricular Needs
Survey Item 6-12 Facilitator
s
MoVIP Benefits Students Spring 2009 Spring 2008
94%93%
MoVIP Benefits District Spring 2009 Spring 2008
91%88%
ConsultingConsulting
Technology & Support
Survey Item6-12Stu-
dents
6-12Parent
s
6-12 Facili-tators
Computer prob-lems don’t keep students from learning
Spring 2009 Spring 2008
66%62%
76% 65%60%
ConsultingConsulting
Student & Program Success Completion rates improving
Higher completions by grade level, other factors
State End of Course Tests English II –higher than state average Algebra I – NSD Biology –lower
State MAP Tests Statistical comparisons yielded some promising results NCLB subgroup means often higher than
state
ConsultingConsulting
Student & Program Success
Grade/Subject
White IEP FRL All Students
4th Gr.CA
NSD
Sign. Higher
Sign. Higher
NSD
4th Gr.Math
NSD
Sign. Higher
NSD
NSD
ConsultingConsulting
Student & Program SuccessThe wide range of data available
allowed analysis of success factors. Some early results:
Time spent in the LMS influenced learning outcomes
positively in 11 out of 15 high enrollment courses
Lack of economic disadvantage Influenced outcomes in 5 courses
Full-time status Influenced learning in 5 courses
ConsultingConsulting
Recommendations
Continue to review internal policies
Address legislative policy issues that may limit ability to meet mission
Build a positive school culture Build a leading PD system Share course review process
ConsultingConsulting
Recommendations
Improve rapport with facilitators Work with home study families Address special education
concerns Address common tech problems Monitor key learning indicators
ConsultingConsulting
Thank You!
Tom Clark, PhDTA Consulting
[email protected]: (217)585-1539
On behalf of TA Consulting and Associates