sociedade portuguesa de inovação information society technologies programme accompanying measures...
TRANSCRIPT
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Information Society Technologies ProgrammeInformation Society Technologies Programme
Accompanying MeasuresAccompanying Measures
(IST-2001-32633)(IST-2001-32633)
SponsorSponsor
Innovation in e-Learning Seminar
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
To disseminate, stimulate discussion and creative To disseminate, stimulate discussion and creative suggestions with regard to identified best practices in e-suggestions with regard to identified best practices in e-LearningLearning
ObjectiveObjective
Innovation in e-Learning Seminar
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
9:159:15 IntroductionIntroduction9:309:30 Project Objectives and Applied MethodologyProject Objectives and Applied Methodology10:30 10:30 BreakBreak10:4510:45 Project Results – Case StudiesProject Results – Case Studies11:3011:30 Roundtable DiscussionRoundtable Discussion12:0012:00 LunchLunch13:1513:15 Presentations and Input From ParticipantsPresentations and Input From Participants15:1515:15 BreakBreak15:30 15:30 Next StepsNext Steps16:0016:00 Closing CommentsClosing Comments
AgendaAgenda
Innovation in e-Learning Seminar
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Project ObjectivesProject Objectives&&
Applied MethodologyApplied Methodology
Innovation in e-Learning Seminar
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Project Objectives & Applied Methodology
Project ObjectivesProject Objectives GeneralGeneral Objective Objective SpecificSpecific Objective Objective
Applied Methodology Applied Methodology Identification of e-Learning SitesIdentification of e-Learning Sites Initial EvaluationInitial Evaluation
- StructureStructure- ApplicationsApplications
Final EvaluationFinal Evaluation- Learner ModelsLearner Models- Soft Skills & Informal LearningSoft Skills & Informal Learning- Communities of LearningCommunities of Learning
Dissemination ActivitiesDissemination Activities
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Project Objectives
To stimulate To stimulate creativitycreativity, and to enhance education and , and to enhance education and training systems for lifelong learning. (IST 2001 Key training systems for lifelong learning. (IST 2001 Key Action 3.2.1 – Self Learning for Work)Action 3.2.1 – Self Learning for Work)
General ObjectiveGeneral Objective
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Project Objectives
To conduct a study on innovative structures and To conduct a study on innovative structures and applications of e-Learning within the United States applications of e-Learning within the United States and Europe.and Europe.
To foster innovative e-Learning development To foster innovative e-Learning development through dissemination of “best practice” innovative through dissemination of “best practice” innovative structures and applications. structures and applications.
Specific ObjectivesSpecific Objectives
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
e-Learning Sites:e-Learning Sites:
• Internet based learning that is focused on the Internet based learning that is focused on the delivery of content (text, audio, video, delivery of content (text, audio, video, animation, simulation) in a training format. animation, simulation) in a training format.
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Utilized the four leading search engines based on the Utilized the four leading search engines based on the Jupiter Media Matrix’s ratings for “audience reach”, Jupiter Media Matrix’s ratings for “audience reach”, 2002 (searchenginewatch.com).2002 (searchenginewatch.com).
• Microsoft NetworkMicrosoft Network• YahooYahoo• GoogleGoogle• America OnlineAmerica Online
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Conducted a search with the term “e-learning” and Conducted a search with the term “e-learning” and selected only sites with a focus on students as the end selected only sites with a focus on students as the end user.user.
• About 50 sites identifiedAbout 50 sites identified
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Search engines are the most common method for Search engines are the most common method for identifying Internet sites. Theme “Self-learning for identifying Internet sites. Theme “Self-learning for work” - accessible existing sites.work” - accessible existing sites.
Assumption: leading e-Learning sites have the Assumption: leading e-Learning sites have the knowledge to leverage search engine and directories knowledge to leverage search engine and directories to attract end users.to attract end users.
Assumption: the term “e-learning” is a universal Assumption: the term “e-learning” is a universal term applied across Europe and the United States term applied across Europe and the United States for Internet based learning.for Internet based learning.
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Restricted search due to assumptions – the term “e-Restricted search due to assumptions – the term “e-learning” and e-learning sites ability to leverage learning” and e-learning sites ability to leverage search engines.search engines.
• Other options are also highly restricted such as Other options are also highly restricted such as surveys of members of relevant associations surveys of members of relevant associations (European Distance Education Network – (European Distance Education Network – EDEN) that rely on a significant response rate. EDEN) that rely on a significant response rate. There is always a low interest for participating There is always a low interest for participating in evaluations!in evaluations!
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Restricted search due to assumptions – the term “e-Restricted search due to assumptions – the term “e-learning” and e-learning sites ability to leverage learning” and e-learning sites ability to leverage search engines. (Continued)search engines. (Continued)
• Possibly limited to English based sites – 6 % of Possibly limited to English based sites – 6 % of the resulting sites were non English based.the resulting sites were non English based.
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Resulting sites represented a diversity of Resulting sites represented a diversity of organisation structures (private for profit, organisation structures (private for profit, associations, etc.) but no traditional universities.associations, etc.) but no traditional universities.
• A lack of university focus on the general public A lack of university focus on the general public market.market.
• Opportunity to transfer innovative activities to Opportunity to transfer innovative activities to the traditional university sector – dissemination the traditional university sector – dissemination activities.activities.
Identification of e-Learning SitesIdentification of e-Learning Sites
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Initial EvaluationInitial Evaluation Identified a set of criteria to evaluate the sites’ structures Identified a set of criteria to evaluate the sites’ structures
and applications.and applications.
Evaluated the sites based on the set of criteria.Evaluated the sites based on the set of criteria.
Identified the top 5 sites with regard to structures.Identified the top 5 sites with regard to structures.
Identified the top 5 sites with regard to applications.Identified the top 5 sites with regard to applications.
Identified the top 20 sites overall (structures / Identified the top 20 sites overall (structures / applications).applications).
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Initial EvaluationInitial Evaluation Analysis of structures accounted for 7 specific criteria:Analysis of structures accounted for 7 specific criteria:
Objectiveness of the MissionObjectiveness of the Mission – clearly – clearly stated/understoodstated/understood
Unique Design and Structure of the InterfaceUnique Design and Structure of the Interface
Aesthetics of the Web siteAesthetics of the Web site – draw interest and – draw interest and appealingappealing
Usability and NavigationUsability and Navigation – user friendly – user friendly
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Initial EvaluationInitial Evaluation Analysis of structures accounted for 7 specific criteria Analysis of structures accounted for 7 specific criteria
(continued):(continued):
Adaptability to the WebAdaptability to the Web – course content adapted or – course content adapted or simply a written documentsimply a written document
Appropriateness of the Course Appropriateness of the Course StructureStructure – take into – take into account subject (Accounting includes problem account subject (Accounting includes problem solving simulations)solving simulations)
Support AvailableSupport Available – (contact information, call – (contact information, call centre)centre)
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Initial EvaluationInitial Evaluation Analysis of applications accounted for 4 specific criteria:Analysis of applications accounted for 4 specific criteria:
Technological CharacteristicsTechnological Characteristics –course specific –course specific (Audio, video, animation, whiteboards)(Audio, video, animation, whiteboards)
DegreeDegree of Interaction of Interaction with with OtherOther StudentsStudents (Synchronous interaction via audio/video/chat, (Synchronous interaction via audio/video/chat, email)email)
Degree of Interaction with a TutorDegree of Interaction with a Tutor (Synchronous (Synchronous interaction via audio/video/chat, email)interaction via audio/video/chat, email)
Pedagogical ToolsPedagogical Tools –course specific (exercises, –course specific (exercises, quizzes, simulations)quizzes, simulations)
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Initial EvaluationInitial Evaluation
Previous works:Previous works:
• Previous studies within the e-learning field: Previous studies within the e-learning field: LGUIDE – The e-Learning ExpertsLGUIDE – The e-Learning Experts
• Thesis: “A Framework for Comparing Web-Thesis: “A Framework for Comparing Web-Based Learning Environments” Based Learning Environments”
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Initial EvaluationInitial Evaluation
Subjective component to the evaluation, although Subjective component to the evaluation, although limited.limited.
Short list of criteria sources – a need to review the Short list of criteria sources – a need to review the sources utilized with other existing sources – sources utilized with other existing sources – American Society for Training & DevelopmentAmerican Society for Training & Development, , Expert PapersExpert Papers
Clear need to develop widely accepted criteria to Clear need to develop widely accepted criteria to assess e-Learning practices – DG Education & assess e-Learning practices – DG Education & Culture “eLearning call for Proposals”, September Culture “eLearning call for Proposals”, September 20022002
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology - Recap
Evaluation: site applications
Evaluation: site structures
Formation of a single ranking Summaries of top 20 sites
Evaluation: best practices. 1. Learner Models 2. Soft skills & informal
learning 3. Communities of learning
Identification of “best practices” & best practice case studies.
Project Seminar
Refinement of project findings and report
Public dissemination of
results
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation Evaluated the top 20 e-Learning sites with regard to the Evaluated the top 20 e-Learning sites with regard to the
following 3 areas:following 3 areas:
• Learner ModelsLearner Models – – focus on focus on flexible, personal models flexible, personal models for learning.for learning.
• Soft Skills and Informal LearningSoft Skills and Informal Learning – focus on the – focus on the developmentdevelopment of soft skills (communication, of soft skills (communication, teamwork, leadership, project management, etc) and teamwork, leadership, project management, etc) and applying informal learning.applying informal learning.
• Communities of LearningCommunities of Learning – focus on identifying and – focus on identifying and implementing virtual communities, individuals with implementing virtual communities, individuals with similar learning needs, within and across similar learning needs, within and across organisational boundaries.organisational boundaries.
Description
Reasoning
Reflection
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Learner Models evaluation was based on 10 criteria:Learner Models evaluation was based on 10 criteria:
Skills Skills GapGap AnalysisAnalysis – skill level evaluation prior to – skill level evaluation prior to coursecourse
Tutor Tutor AvailabilityAvailability
Student Student FlexibilityFlexibility – course scheduling – course scheduling, course , course navigationnavigation
Control of Control of Screen InformationScreen Information – student level – student level interfaceinterface
Defined Defined ObjectivesObjectives – course purpose, expected – course purpose, expected performanceperformance
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Learner Models evaluation was based on 10 criteria Learner Models evaluation was based on 10 criteria (continued):(continued):
Self Self Assessment Assessment – periodically preferred– periodically preferred
Content Content IntegrationIntegration – – audio, videoaudio, video, slide show, , slide show, animationanimation
Document Document ManagementManagement – bibliography – bibliography, e-books, e-books
Help Help FacilitiesFacilities – beyond a tutor such as links, help – beyond a tutor such as links, help deskdesk
Simple Simple User InterfaceUser Interface – user friendly, consistent – user friendly, consistent interfaceinterface
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Soft Skills and Informal Learning evaluation was based Soft Skills and Informal Learning evaluation was based on 7 criteria:on 7 criteria:
Interaction ActivityInteraction Activity – promoted and actual – promoted and actual interactioninteraction
Reward Reward – recognition or reinforcement of – recognition or reinforcement of accomplishmentsaccomplishments: diploma, certificate: diploma, certificate
TransferTransfer – relate course to the student’s “real – relate course to the student’s “real world”world”
EnvironmentEnvironment – – positive environmentpositive environment, tolerance of , tolerance of errors, appropriate feedbackerrors, appropriate feedback
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Soft Skills and Informal Learning evaluation was based Soft Skills and Informal Learning evaluation was based on 7 criteria (continued):on 7 criteria (continued):
Communication Communication InteractivityInteractivity – level of interaction: – level of interaction: student / student and student / instructorstudent / student and student / instructor
MotivationMotivation – ability to motivate the student – ability to motivate the student, justify , justify the need to learnthe need to learn
Student Centred Student Centred – ability to manage depth and – ability to manage depth and scope of learning, schedule, contribution.scope of learning, schedule, contribution.
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Communities of Learning evaluation was based on 8 Communities of Learning evaluation was based on 8 criteria:criteria:
Clearly Stated PurposeClearly Stated Purpose – establish a foundation for – establish a foundation for the community of learningthe community of learning
Experienced ModeratorsExperienced Moderators – ability to initiate and – ability to initiate and guide discussionsguide discussions
Registration System Registration System – to allow students to present – to allow students to present themselves to the community and provide the themselves to the community and provide the community a structurecommunity a structure
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Communities of Learning evaluation was based on 8 Communities of Learning evaluation was based on 8 criteria (continued):criteria (continued):
Synchronous ToolsSynchronous Tools – allow real-time interaction – allow real-time interaction (chat rooms, discussion boards, virtual meetings)(chat rooms, discussion boards, virtual meetings)
Asynchronous ToolsAsynchronous Tools – ability to initiate and guide – ability to initiate and guide discussions (e-mail, message posting on web forums)discussions (e-mail, message posting on web forums)
Group Problem Solving Group Problem Solving – foster groups with – foster groups with objectivesobjectives within the course structure within the course structure
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Communities of Learning evaluation was based on 8 Communities of Learning evaluation was based on 8 criteria (continued):criteria (continued):
Scheduled EventsScheduled Events – ability to increase student – ability to increase student awareness of group activities on particular topicsawareness of group activities on particular topics
Level of InteractionLevel of Interaction – final result: existence of actual – final result: existence of actual communitiescommunities with activity with activity
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
EC defined key topics of learningEC defined key topics of learning
Previous works:Previous works:
• Previous studies within the e-learning field: Previous studies within the e-learning field: LGUIDE – The e-Learning ExpertsLGUIDE – The e-Learning Experts
• Thesis: “A Framework for Comparing Web-Based Thesis: “A Framework for Comparing Web-Based Learning Environments” Learning Environments”
• Various articles and reports from “experts”Various articles and reports from “experts”
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Final EvaluationFinal Evaluation
Description
Reasoning
Reflection
Subjective component to the evaluation, although Subjective component to the evaluation, although limited.limited.
Short list of criteria sources – a need to review the Short list of criteria sources – a need to review the sources utilized with other existing sources – sources utilized with other existing sources – American Society for Training & DevelopmentAmerican Society for Training & Development
Clear need to develop widely accepted criteria to Clear need to develop widely accepted criteria to assess e-Learning practices – DG Education & assess e-Learning practices – DG Education & Culture “eLearning call for Proposals”, September Culture “eLearning call for Proposals”, September 20022002
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Applied Methodology
Letter of Interest to about 750 individuals Letter of Interest to about 750 individuals involved/interested in Distance Learning involved/interested in Distance Learning
About 60 responses directly interested in the About 60 responses directly interested in the project findingsproject findings
• SeminarSeminar
• E-mail final reportsE-mail final reports
• Website: spi.pt/innoelearningWebsite: spi.pt/innoelearning
Dissemination ActivitiesDissemination Activities
DecemberDecember 2002 2002
Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
ContactsContacts
December 2002December 2002Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação
Sociedade Portuguesa de InovaçãoEdf. Les PalacesRua Júlio Dinis, 242 – Sala 208 4050-318 Porto, Portugal
Tel: 351-22-6076400 Fax: 351-22-6099164
E-mail: [email protected]