![Page 1: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/1.jpg)
Bill Randall Jonathon SweetinDiane Steinbeiser
NC3ADL Conference - November 15, 2010
![Page 2: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/2.jpg)
Learning Technology SystemsLibrary resources
Integrated Library System/Consortium of 46 college librariesCataloging services for 58 colleges
Distance Learning - Virtual Learning CommunityTechnology centerProfessional development centerQuality/assessment centerCourse & learning object development center
North Carolina Learning Object Repository LMS promotion & supportBroadband Data Network – 100Mbps base service$10.25 million budget & 10 staff members
![Page 3: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/3.jpg)
OverviewOSC Moodle Assessment Report Part II: A
Feasibility StudyFeasibility Study results & recommendationsDistance learning enrollments: past, present,
and (a projected) disruptive futureFunding support for two LMSs
![Page 4: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/4.jpg)
OSC Moodle Assessment Rpt. Part IIThe study focused on six components that
collectively defines "What is the best LMS solution for NC Community Colleges?" Interoperability and flexibility Cost effectivenessSupport and trainingEase of use Scalability, and Sustainability
![Page 5: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/5.jpg)
OSC Moodle Assessment Rpt. Part IIA three-part research methodology was used to
measure and evaluate these six components.1.LMS Compatibility and Interoperability Survey used
to gather information about the general benchmarking statistics of the LMSs in the system, the interoperability of the LMSs with 3rd party applications and services, and a short open-ended LMS needs assessment.
2.Migration/Upgrade Case Study Survey to gather information regarding NCCCS colleges' (a) migration from Blackboard to Moodle and (b) upgrade by Blackboard clients to ver.9.x.
3.Total LMS Vendor Cost Analysis to review the total cost of LMS ownership by the NCCCS and the individual colleges in regard to vendor LMS license fees, hosting fees and any other additional costs.
![Page 6: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/6.jpg)
Interoperability and FlexibilityInteroperability was defined as the ability of the
LMS to integrate with related peripheral applications and services. Integration with SIS (Datatel) most importantMost commonly installed third party LMS plug-ins
were anti-plagiarism, communication and assessment development tools.
Flexibility was defined as the ability to (1) easily move learning content in and out of the LMS and the ability to (2) customize applications to meet specific needs of the colleges or the System.Moodle is a more flexible LMS appearing to better
facilitate movement of learning content in and out of the LMS and more customizable than Blackboard.
![Page 7: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/7.jpg)
Cost EffectivenessCost effectiveness was defined as the total value
of return on investment of the LMS. Cost Included: License Fees, Vendor Hosting Fees, Additional Fees
![Page 8: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/8.jpg)
Support and TrainingSupport and training was defined as the ability of
the colleges and the System Office to be responsive to emerging technologies which enhance LMS utilization.The research revealed that 45 (77.5%) of NCCCS
colleges have fewer than three staff members to directly support their distance learning departments.
![Page 9: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/9.jpg)
Ease of UseEase of use was adequately addressed in the
OSC Moodle Assessment Report. Moodle and Blackboard were found to be
comparable. The real difference, however, was found in students' perception of their teachers’ comfort level with the application. There existed a significant correlation between student rankings of both Blackboard and Moodle with the perceived comfort level of instructors when using either LMS. Thus, student perceptions were influenced by instructor experience, training, and skills, regardless of LMS.
![Page 10: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/10.jpg)
ScalabilityScalability was defined as the ability of the
LMS to efficiently serve both large and small institutions with agile hardware/software solutions at the macro and micro levels. Findings revealed a trend for increased course
sizeNeed for massive increase in storage capacity
in next 3 yearsBoth Moodle and Blackboard are suited for
large and small installations.
![Page 11: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/11.jpg)
Storage Capacity questions revealed a
massive growth in the next three years.
Average sized LMS-based courses was 20 to
60 MB but revealed growing trend of
increased course size.
![Page 12: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/12.jpg)
SustainabilitySustainability was defined as the ability to
maintain a consistent level of learning infrastructure and support required to (1) meet the growing enrollment demands of students, (2) meet growing infrastructure needs, and (3) address limitations of funding, faculty needs, and support staff now and into the future.While researching the need to meet the
growing enrollment demands of students a startling discovery was made regarding enrollment growth.
![Page 13: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/13.jpg)
Current LMS capacity across NCCCS38,000 active courses on combined
Blackboard and Moodle serversOver 300,000 active students on combined
LMS servers2009 curriculum enrollments delivered via
LMS technology are 37.8% of total (DL + traditional enrollments). 2010 enrollment figures expected to increase 14%.
Enrollment growth projections are mathematically disruptive & suggest needed changes in support and decision making.
![Page 14: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/14.jpg)
Growth and ExpansionEnrollments, course size, numbers of courses, and use of LMS-related applications are growing
Interest in alternative or secondary LMS(s) is expanding
![Page 15: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/15.jpg)
![Page 16: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/16.jpg)
![Page 17: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/17.jpg)
LMS status
![Page 18: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/18.jpg)
LMS status…continued
![Page 19: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/19.jpg)
Vendor hosting
![Page 20: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/20.jpg)
Study RecommendationsRecommendation One: If the decision was only
based on cost, functionality, and ease of use, Moodle would be the best LMS for NCCCS. However, given the current funding and support situation across the System, and prevailing Blackboard culture at many institutions, a two-LMS Solution is recommended.
Recommendation Two: An individual or advisory team function to integrate cross-disciplinary interests to better plan, support, promote, and coordinate learning technology solutions for each college .
Recommendation Three: Adoption of Operational and Business Requirements by all NCCCS Institutions.
Recommendation Four: Continued Development and integration of cross-platform learning resources.
![Page 21: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/21.jpg)
Disruptive Enrollment WaveEfforts to identify capacities of LMS-related
resources and utilization leads to analysis of 12 years of distance learning curriculum enrollments available from NCCCS data warehouse annual reports
Extraordinary 12 year growth curve discovered
New question: How can we project future growth of LMS-centric enrollments?
![Page 22: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/22.jpg)
Distance Learning vs. Traditional Curriculum Enrollments 1998 - 2009
DL% of all enrollments
Traditional enrollments
Distance learning enrollments
Total Course enrollments
Year
1998 1.63 1,009,561 16,740 1,026,3011999 2.41 1,080,584 26,695 1,107,2792000 3.58 1,008,153 40,392 1,048,5452001 4.99 1,116,669 58,592 1,175,2612002 6.78 1,200,070 87,299 1,287,3692003 8.57 1,250,449 117,229 1,367,6782004 10.02 1,295,407 144,217 1,439,6242005 16.26 1,201,360 233,230 1,434,5902006 21.76 1,106,142 307,639 1,413,7812007 27.62 1,013,607 386,738 1,400,3452008 29.35 1,027,842 427,018 1,454,8602009 36.86 1,008,762 588,787 1,597,549
![Page 23: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/23.jpg)
Note on Enrollment Growth in “DL”Enrollment in the NCCCS is categorized in
eight instructional delivery methods - SREB & SACS compliant: Internet courses 100% onlineHybrid (online is primary delivery method – 51% online)Web-supported TelecourseTelewebTwo-way Video Digital media (catch all)Traditional (Face-to-Face)
Distance learning is the overall general term used in referring to any enrollment other than Traditional.
![Page 24: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/24.jpg)
Methods by LMS-centricity LMS-centric
Internet courses Hybrid Web-supported
Possibly LMS-centric Telecourse Teleweb Two-way Video Digital media
Non-LMS-centric Traditional Face-to-Face
Telecourse, teleweb, two-way video and digital media methods are include in the following data and may not be LMS centric. However, these delivery methodologies only account for 3% of total DL enrollment delivery. Thus, at least 97% of the following DL figures are LMS-centric and important to this study.
![Page 25: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/25.jpg)
Distance Learning Curriculum Enrollments 1998-2009 by Delivery MethodDelivery Method 1997-8 1998-9 1999-0 2000-1 2001-2 2002-3 2003-4 2004-5 2005-6 2006-7 2007-8 2008-9
Internet 8,039 18,330 33,901 59,316 90,326 119,096 138,565 166,197 200,746 245,642 310,058
Telecourse 15,047 16,234 16,928 18,685 16,718 15,133 13,595 8,663 6,192 5,186 4,571
Teleweb - 372 926 978 834 1,071 1,741 2,211 2,157 2,055 1,915
Two-way Video 3,609 5,456 6,837 8,320 9,351 8,917 8,681 7,476 8,516 8,300 10,058
Hybrid - - - - - - 16,221 30,116 46,404 67,409 94,239
Web-supported - - - - - - 54,327 92,689 122,208 98,028 167,501
Digital Media - - - - - - 100 287 515 398 445
All DL Methods 16,740 26,695 40,392 58,592 87,299 117,229 144,217 233,230 307,639 386,738 427,018 588,787
% Growth n/a 59.5% 51.3% 45.1% 49.0% 34.3% 23.0% 61.7% 31.9% 25.7% 10.4% 37.9%
Traditional 1,009,561 1,080,584 1,008,153 1,116,669 1,200,070 1,250,449 1,295,407 1,201,360 1,106,142 1,013,607 1,027,842 1,008,762
![Page 26: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/26.jpg)
Total Distance Learning &Traditional Course Enrollments by Reporting Year
![Page 27: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/27.jpg)
Exponential growth curve
![Page 28: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/28.jpg)
Will DL replace TR Enrollments?Clayton, Horn, and Johnson, in their 2008
book Disrupting Class, describe a mathematical expression that sets conditions in which a new technology/innovation can eventually replace an older technology/innovation.
These conditions form what is termed a “disruptive innovation.” One qualifying condition stipulates that when ratios of the new-technology-compared-with-the-old are plotted on a logarithmic scale (vertical axis), a straight line is created where the first four to five data points lie on the trend line.
![Page 29: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/29.jpg)
Figure 4.2 from Disrupting Class, p.99
![Page 30: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/30.jpg)
Pace of Substitution of DL to TR Enrollments
(Logarithmic Scale)
![Page 31: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/31.jpg)
Pace of Substitution of DL to TR Enrollments (Exponential Trend Line)
![Page 32: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/32.jpg)
Disruptive Innovation in NCCCS!The percentage ratio of DL to traditional course
enrollments plotted over 12 years establishes a growth curve that is compliant with disruptive innovation mathematical constructs identified in Disrupting Class by Christensen, Horn, and Johnston, McGraw Hill, 2008, p. 96 – 102.
The 2009 ratio of DL or LMS-based enrollments to total course (DL and traditional) enrollments was .6:1. However, enrollment projections based on the replacement curve indicate a 1:1 ratio of DL to total course enrollments forecast for 2010-2011, a 3:1 ratio forecast for 2014 and a 6:1 ratio for 2016.
![Page 33: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/33.jpg)
2010 2011 2012 2013 2014 2015 2016 2017
Traditional Enrollment
Distance Learning (LMS) Enrollment
1:1 ratio in 2010.52:1 ratio in 2012.53:1 ratio in 20144:1 ratio in 20155:1 ratio in 2015.56:1 ratio in 2016
![Page 34: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/34.jpg)
How do you know the predictions are accurate?It is all about the Math!These predictions have a .9918 R-Squared
value (correlation coefficient) - 1.0 being a prefect correlation.
Or 99.18 % chance that the correlation between
TR enrollments and DL enrollments is correct.
![Page 35: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/35.jpg)
What does this disruption mean?This projection of LMS-based instructional
delivery represents a formidable challenge to sustainability of LMS resources facing NC Community Colleges in the next 6.5 years.
Areas impacted: Instructional programs Professional development & staff support Student services IT & network administration Budget & procurement Strategic planning & decision-making Leadership
![Page 36: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/36.jpg)
The Next Big QuestionsDisruption is coming…and is likely to change
most everything we do!!Disruption will bring challenges in areas of
professional development, IT and DL support positions, funding, administration, planning, coordination, etc.
Can we manage this disruption?If so, how?
![Page 37: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/37.jpg)
Funding Two-LMSsDecision to financially support two-LMSs announced
at NCACCP Fall Retreat and ACCBO ConferenceOngoing discussions with OSBM & IT ProcurementLevel of financial support to be equalFTE-based support structure not yet determinedFuture Blackboard contract will be negotiated –
likely a multi-yearColleges will be surveyed to determine preferenceMoodle contract situation under advisement
![Page 38: Bill Randall Jonathon Sweetin Diane Steinbeiser](https://reader036.vdocument.in/reader036/viewer/2022070419/56815b1f550346895dc8d6b4/html5/thumbnails/38.jpg)
Discussion/Questions?Copy of the OCS Moodle Assessment Report
Parts I & II, the Feasibility Study are available here: http://oscmoodlereport.wordpress.com/
Bill [email protected]