![Page 1: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/1.jpg)
© 2009 NetSpot Pty Ltd
Piloting LMSenvironments in theHigher Education sectorMark Drechsler
Professional Services Manager
NetSpot Pty Ltd
![Page 2: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/2.jpg)
© 2009 NetSpot Pty Ltd
Today’s Presentation
• A bit about NetSpot
• Open Source pilot experiences in the last year
• Supporting the case for change
• Critical success factors for LMS pilots
![Page 3: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/3.jpg)
© 2009 NetSpot Pty Ltd
About NetSpot
![Page 4: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/4.jpg)
© 2009 NetSpot Pty Ltd
Sakai Commercial Affiliate
Mahara Partner
Moodle Partner
Wimba Authorised Reseller
Partner
![Page 5: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/5.jpg)
© 2009 NetSpot Pty Ltd
Pilot experiences in 2009
![Page 6: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/6.jpg)
© 2009 NetSpot Pty Ltd
2009: Increased interest in piloting Open Source learning technologies.
![Page 7: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/7.jpg)
© 2009 NetSpot Pty Ltd
What do we classify as a „Pilot‟?
“...small scale preliminary study conducted before the main research in order to check the feasibility or to improve the design of
the research”
- Wikipedia
![Page 8: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/8.jpg)
© 2009 NetSpot Pty Ltd
Different kinds of pilots
Evaluation focus
• to support LMS selection process
Pre-implementation focus
• to help plan production deployment
![Page 9: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/9.jpg)
© 2009 NetSpot Pty Ltd
Integration
Content migration
Technical evaluation
Hosting environment
Stakeholders
Support
Functional evaluation
Pilotconsiderations
![Page 10: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/10.jpg)
© 2009 NetSpot Pty Ltd
Common trade off
Increased:
• Scope
• Stakeholder participation
• Integration
• Configuration
• t, $
• Evaluation data
![Page 11: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/11.jpg)
© 2009 NetSpot Pty Ltd
Open Source vs Proprietary:
The flexibility of Open Source means that far more options are available for a pilot
![Page 12: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/12.jpg)
© 2009 NetSpot Pty Ltd
A note on Sakai
In our experience, some technical configuration effort is required to showcase its true potential
![Page 13: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/13.jpg)
© 2009 NetSpot Pty Ltd
The value of partnering
Partnering with an experienced services provider can:
• Reduce implementation time
• Avoid common mistakes
• Utilise existing knowledge
• Assist evaluation of partner services such as managed hosting and technical support
![Page 14: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/14.jpg)
© 2009 NetSpot Pty Ltd
Supporting the case for change
![Page 15: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/15.jpg)
© 2009 NetSpot Pty Ltd
An Open Source LMS can lead to...
... a re-think of teaching practice
![Page 16: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/16.jpg)
© 2009 NetSpot Pty Ltd
An Open Source LMS can lead to...
... the use of the LMS for more than just teaching and learning
• Research
• Collaboration
• Networking
![Page 17: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/17.jpg)
© 2009 NetSpot Pty Ltd
An Open Source LMS can lead to...
... an alignment of institutional culture to a community-driven product
![Page 18: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/18.jpg)
© 2009 NetSpot Pty Ltd
Critical success factors
![Page 19: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/19.jpg)
© 2009 NetSpot Pty Ltd
1. Clear governance
Including
• a Business Owner
• a project definition
• clearly defined roles and responsibilities
• Executive buy-in
![Page 20: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/20.jpg)
© 2009 NetSpot Pty Ltd
2. Sound evaluation framework
Consider
• Pedagogical
• Support
• Integration
• Financial
• Strategic
Instruments such as surveys, observations, interviews, feature lists, TCO estimates
![Page 21: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/21.jpg)
© 2009 NetSpot Pty Ltd
3. Stakeholder representation
Including
• Teaching and learning
• Technology
• Support staff
• Administrative staff
![Page 22: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/22.jpg)
© 2009 NetSpot Pty Ltd
The biggest challenge?
Complex pilot that closely resembles the production environment, but that takes longer and costs more
Simple pilot that focuses on key
aspects, but that may leave gaps in
the evaluation process
![Page 23: Reflections on experiences in managing the piloting and evaluation phase of open source learning environments within the tertiary sector](https://reader033.vdocument.in/reader033/viewer/2022042813/5447b1bab1af9f0f098b4775/html5/thumbnails/23.jpg)
© 2009 NetSpot Pty Ltd
Questions?