![Page 1: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/1.jpg)
Supporting group learning and Supporting group learning and assessment through Internetassessment through Internet
Liane Tarouco Marlise GellerLiane Tarouco Marlise Geller
Antonio R. de Vit Luciano HackAntonio R. de Vit Luciano Hack
Graduate Program Informatic on EducationGraduate Program Informatic on Education
Universidade Federal do RS - BrazilUniversidade Federal do RS - Brazil
![Page 2: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/2.jpg)
CMDLCMDL Computer Mediated Distance Learning (classroom is routinely a Computer Mediated Distance Learning (classroom is routinely a
far more scrutable educational environment than the physical far more scrutable educational environment than the physical classroom)classroom)
email & news groupsemail & news groups chatchat videoconferencevideoconference
![Page 3: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/3.jpg)
CSCLCSCL
Computer Supported collaborative LearningComputer Supported collaborative Learning
group learning is more effective group learning is more effective
Learning through reflexive discussionLearning through reflexive discussion
![Page 4: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/4.jpg)
CSCL based on Internet CSCL based on Internet servicesservices
Computer Supported collaborative Computer Supported collaborative LearningLearning
CSCL based on InternetCSCL based on Internet asynchronous asynchronous
email, news groups,email, news groups,
electronic boardelectronic board synchronoussynchronous
chat, videoconferencechat, videoconference
![Page 5: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/5.jpg)
Collaborative learningCollaborative learning
ProblemsProblems heterogeneous contributions heterogeneous contributions lack of capability for monitoring alllack of capability for monitoring all
group workgroup work
![Page 6: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/6.jpg)
Learning assessment became a challenge to those who work with distance education
Learning assessmentLearning assessment
![Page 7: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/7.jpg)
Learning assessmentLearning assessment
Evaluation process should include a great variety of evidences that go beyond the traditional final examination based on paper and pencil.
![Page 8: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/8.jpg)
Face-to-face contextFace-to-face context
Professors use more than just formal mechanisms to evaluate students. body language participation
Quality of questions proposed by students are good indicators of learning
![Page 9: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/9.jpg)
Distance EducationDistance Education
What normally occurs it is the use of formal mechanisms only
![Page 10: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/10.jpg)
Why ?Why ?
It occurs not only because of the lack It occurs not only because of the lack of accessible mechanisms that can of accessible mechanisms that can assist instructors on this task, but also, assist instructors on this task, but also, because many professors prefer to because many professors prefer to work with more traditional methods of work with more traditional methods of evaluation.evaluation.
AuthenticationAuthentication Legal aspectsLegal aspects
![Page 11: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/11.jpg)
Internet evolutionInternet evolution
Evolution of networks and computers Evolution of networks and computers and especially the Internetand especially the Internet
New mechanisms and services started New mechanisms and services started to show upto show up
![Page 12: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/12.jpg)
Keeping trackKeeping track
Tools to keep track of students Tools to keep track of students activities and interactions activities and interactions with learning environment with learning environment with the group of studentswith the group of students with the professorwith the professor
![Page 13: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/13.jpg)
Internet for distance Internet for distance educationeducation
Reduction of the distribution costs; Reduction of the distribution costs; Internet facilitates collaborative writing;Internet facilitates collaborative writing; The corrections and updates are simpler The corrections and updates are simpler
to handle; to handle; Several techniques for evaluation are Several techniques for evaluation are
possible using multimedia for the possible using multimedia for the interaction between professor and interaction between professor and students and between students. students and between students.
![Page 14: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/14.jpg)
Distance education Distance education assessmentassessment
Assessment based on contributions for group Assessment based on contributions for group discussions discussions
Tests (automatically handled by computer Tests (automatically handled by computer program) program)
Term papers (analyzed by professor or Term papers (analyzed by professor or assistants)assistants)
Oral or written tests conduced in the presence Oral or written tests conduced in the presence of the instructor (some times through of the instructor (some times through videoconference) or with a remote assistant.videoconference) or with a remote assistant.
![Page 15: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/15.jpg)
Time spent with assessmentTime spent with assessment
![Page 16: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/16.jpg)
Types of assessmentTypes of assessment
case studiescase studies examsexams paperspapers projectsprojects
All of them requires extensive time to All of them requires extensive time to grade and are very difficult to get grade and are very difficult to get automated help to do the evaluation.automated help to do the evaluation.
![Page 17: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/17.jpg)
![Page 18: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/18.jpg)
Distance education Distance education technologiestechnologies
Ancient formsAncient forms Internet basedInternet based
environmentenvironment
Printed text books HTML pagesPrinted text books HTML pages
ExercisesExercises Forms and CGI Forms and CGI
TV broadcast MBONETV broadcast MBONE
VHS tapes Real Video, MPEGVHS tapes Real Video, MPEG
Audio tapesAudio tapes Real audio Real audio
AssesmentAssesment Forms and CGI Forms and CGI
![Page 19: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/19.jpg)
TopicsTopics Kirkpatrick's model for evaluation - Kirkpatrick's model for evaluation - set set
of tools to provide capability to asses of tools to provide capability to asses according this modelaccording this model
consensusconsensus trackingtracking voting voting self-evaluationself-evaluation
![Page 20: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/20.jpg)
Kirkpatrick’s modelKirkpatrick’s model
Reaction
Learning
Behaviour
Results
![Page 21: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/21.jpg)
Formative evaluationFormative evaluation
Formative evaluation is important to Formative evaluation is important to make easy for the students not only make easy for the students not only inform their opinions and feelings inform their opinions and feelings about how course is going on but see about how course is going on but see this contributions being handled and this contributions being handled and considered. considered.
![Page 22: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/22.jpg)
Using quiz system Using quiz system
Teachers may built artifacts and link themTeachers may built artifacts and link them CGI allows dynamically building and editingCGI allows dynamically building and editing
![Page 23: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/23.jpg)
Basic functions includedBasic functions included
Feedback for each alternative
Indication of correct answer
Nothing more, just counting incidence of selections on each alternative
![Page 24: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/24.jpg)
Complementary toolsComplementary tools
ConsensusConsensus
TrackingTracking
VotingVoting
Self-evaluationSelf-evaluation
![Page 25: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/25.jpg)
Tool of consensusTool of consensus
It allows on time creation of enquete proposing instigating questions, as well as the collection and tabulation of responses;
The tool has the capability to keep track of each student's level of contribution to the discussion as well as enquete responses.
![Page 26: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/26.jpg)
Tracking toolTracking tool The register of learning activities
(accessed page with dates and time) is important because it allows the professor to know the progress of students trough the course;
The collected information will show that type of access the student has made (visited units, tools used, etc), as well as the time spent on it.
![Page 27: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/27.jpg)
Voting toolVoting tool
Aimed to provide conditions for a fast feedback for the instructor on specific subjects.
![Page 28: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/28.jpg)
Self-evaluation toolSelf-evaluation tool
Allows the dynamic building of enquetes for self-evaluation by professor and by students.
![Page 29: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/29.jpg)
Group activity handlingGroup activity handling
Group activity may give opportunity Group activity may give opportunity for student to present contributions for student to present contributions that some times are relegated to that some times are relegated to forgetfulness.forgetfulness.
![Page 30: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/30.jpg)
ConsolidationConsolidation
It is also needed a voting system to It is also needed a voting system to support group decision about the support group decision about the consolidated results from discussionconsolidated results from discussion
orderingordering reorderingreordering selectingselecting discarding discarding
![Page 31: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/31.jpg)
What was neededWhat was needed
Development of applications to Development of applications to handle participants contributions handle participants contributions
Provide support for group decisionProvide support for group decision
Utilization of contributions that came Utilization of contributions that came up during group activityup during group activity
![Page 32: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/32.jpg)
Handling group activity resultsHandling group activity results
A set of tools was designed A set of tools was designed and developed to support and developed to support distance education distance education collaborative work.collaborative work.
![Page 33: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/33.jpg)
Group activity resultsGroup activity results
Group activity results on a log file Group activity results on a log file containing interchanged texts containing interchanged texts (synchronous or asynchronously) (synchronous or asynchronously) during a group debate.during a group debate.
Example: Using an environment like Palace for chat
![Page 34: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/34.jpg)
Other services used for Other services used for group discussiongroup discussion
WWW based chat WWW based chat Videoconferencing complemented with chatVideoconferencing complemented with chat
![Page 35: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/35.jpg)
Developed solutionDeveloped solution
Application for handle results of group Application for handle results of group discussion (brainstorming)discussion (brainstorming)
consolidation of contributionsconsolidation of contributions
summaries with more relevant ideassummaries with more relevant ideas
voting processvoting process
![Page 36: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/36.jpg)
Previous efforts and resultsPrevious efforts and results
I ssue analyzerIssue analyzer
EurekhaEurekha
ESCOOPESCOOP
![Page 37: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/37.jpg)
Issue AnalyzerIssue Analyzer Tool supporting brainstormingTool supporting brainstorming
Used natural language recognitionUsed natural language recognition
Grouping of similar ideas Grouping of similar ideas
Organize them according with definitions of Organize them according with definitions of the groupthe group
Client server applicationClient server application
Supported only synchronous communicationSupported only synchronous communication
![Page 38: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/38.jpg)
EurekhaEurekha Tool initially developed for information retrievalTool initially developed for information retrieval Uses methods for grouping textual objectsUses methods for grouping textual objects Objects are organized automatically in similar Objects are organized automatically in similar
objects groupsobjects groups Directed to natural languageDirected to natural language Designed to work with files (each text object Designed to work with files (each text object
must be presented as a different file)must be presented as a different file)
![Page 39: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/39.jpg)
ESCOOPESCOOP Handle log files derived from group activityHandle log files derived from group activity Clean and cutClean and cut
remove stop wordsremove stop words spell checkingspell checking remove names of sendersremove names of senders
Uses Eurekha for clusteringUses Eurekha for clustering Handle voting processHandle voting process
![Page 40: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/40.jpg)
ConclusionsConclusions Formative evaluation plays an important
role to get distance students motivated because they feel a sense of not being lost in space
Just the opposite, they feel that being closely monitored and having their opinions being asked often is more like having a personal tutor that pay attention on way they do and what they say.
![Page 41: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/41.jpg)
ConclusionsConclusions
This kind of attention provided by the system helps to minimize solitude that sometimes is referred as main desisting factor from students in distance education programs
![Page 42: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/42.jpg)
Conclusions Conclusions Cognitive development improvedCognitive development improved
development of better self-expressiondevelopment of better self-expression
help student to learn about how to help student to learn about how to work collaboratively work collaboratively
stimulate problem solving critical stimulate problem solving critical thinking and collaborative analysis thinking and collaborative analysis
learning through reflexive discussionslearning through reflexive discussions
![Page 43: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/43.jpg)
Results Results
colaboration valued/consideredcolaboration valued/considered better follow up from teacherbetter follow up from teacher contributions more homogeneous contributions more homogeneous secundary results secundary results
writing skills improvedwriting skills improved
more reflexive thinking about what is being more reflexive thinking about what is being presentedpresented
![Page 44: Supporting group learning and assessment through Internet Liane Tarouco Marlise Geller Antonio R. de Vit Luciano Hack Graduate Program Informatic on Education](https://reader036.vdocument.in/reader036/viewer/2022070307/551a57e255034643688b4808/html5/thumbnails/44.jpg)
More details / ContactsMore details / Contacts
Marlise GellerMarlise Geller
[email protected]@ulbra.tche.br
Liane TaroucoLiane Tarouco
[email protected]@penta.ufrgs.br