niki lambropoulos may 2004 phd presentation slide 1 overview 1 st study: vicarious learning in...

Slide Slide 11Niki Lambropoulos May 2004 PhD presentationNiki Lambropoulos May 2004 PhD presentation

Overview

11stst study: study: Vicarious Learning in Online Vicarious Learning in Online CommunitiesCommunities• Pilot study, Results & DiscussionPilot study, Results & Discussion

22ndnd study: study: Agent-assisted Participation in Agent-assisted Participation in Communities of PracticeCommunities of Practice • Preparing the Pilot studies Preparing the Pilot studies

• Identification of the participation process (Web-Identification of the participation process (Web-based Questionnaires, Andrews et al, 2001)based Questionnaires, Andrews et al, 2001)

• Identification of system requirements (intelligent Identification of system requirements (intelligent designer-based model methodology)designer-based model methodology)

Niki Lambropoulos May 2004 PhD presentationNiki Lambropoulos May 2004 PhD presentation

PART I > Up to Xmas 2003PART I > Up to Xmas 2003Vicarious Learning in Vicarious Learning in Online CommunitiesOnline Communities

Niki LambropoulosNiki [email protected] [email protected]

Learning Technology Research Learning Technology Research InstituteInstitute-- London Metropolitan University London Metropolitan University


Introduction: Human<->Computer

Computers are used as mediumComputers are used as medium

Humans work in and around computersHumans work in and around computers

Humans interact with computers in a basic Humans interact with computers in a basic behaviouristic mannerbehaviouristic manner

Humans cannot interfere with the interfaceHumans cannot interfere with the interface

Humans cannot suggest something to the Humans cannot suggest something to the computers regarding their relationshipcomputers regarding their relationship

Humans create ideas using the resources and Humans create ideas using the resources and not the computersnot the computers


IssuesIssues

Creative copying of meaning - multilogueCreative copying of meaning - multilogue Active Readers On the Web (AROW) – Active Readers On the Web (AROW) –

Lurkers (never post)Lurkers (never post) Online Communities and levels of Online Communities and levels of

engagement engagement Enquiry towards the machine Enquiry towards the machine Human interacts with the machineHuman interacts with the machine The machine helps the Human with The machine helps the Human with

his/her processhis/her process


Question 1

Can computers be creative?Can computers be creative?


Question 2

Can they copy Humans’ actions?Can they copy Humans’ actions?


Answer: perhaps by

I.I. Mapping the activation processMapping the activation process

II.II. Following Psychology Following Psychology

III.III. Working with Management Working with Management

IV.IV. Building the interface using the Building the interface using the findings findings


Intelligent Dynamic Enquiry

IDE is based on DI (London – McMillen IDE is based on DI (London – McMillen 1992)1992)

‘‘what would be studiedwhat would be studied ‘‘ ‘‘how the information would be collected’how the information would be collected’ ‘‘how they would make sense of what how they would make sense of what

they discoveredthey discovered ‘‘ ‘‘how to tell the machine the findings’how to tell the machine the findings’ ‘‘how the machine will interact with the how the machine will interact with the

findings’findings’


IDE Process:

QuestionnairesQuestionnaires

>Unstructured to structured Q (based in >Unstructured to structured Q (based in Grounded Theory Concept towards a Grounded Theory Concept towards a machine) machine)

> Identification of keywords in the data > Identification of keywords in the data and new Q constructionand new Q construction

UsersUsers

Half of the users from the previous phase Half of the users from the previous phase participate in the next phaseparticipate in the next phase

(following CoP concept fro new users and new views)(following CoP concept fro new users and new views)


IDE Reveals:

users involvementusers involvement newcomers’ new points of viewnewcomers’ new points of view patterns recognition strategies for data mining patterns recognition strategies for data mining

and identification of agents’ rolesand identification of agents’ roles meaningful shared data sources meaningful shared data sources simplicity in the construction simplicity in the construction functionality of the system functionality of the system goals and actions that are determining the goals and actions that are determining the

system's environment system's environment re-use of solutions and experiences using roles re-use of solutions and experiences using roles mapping of the framework for the agents’ roles mapping of the framework for the agents’ roles the number and the types of the agents the number and the types of the agents iterative interaction of the agentsiterative interaction of the agents


A case study

The Goal: how to participate actively in The Goal: how to participate actively in an online dialogue?an online dialogue?

25,000 users in TakingITGlobal (9-50 25,000 users in TakingITGlobal (9-50 years old)years old)

Data were taken every week for a monthData were taken every week for a month

11stst Phase: 13 participants (16-48 years Phase: 13 participants (16-48 years old)old)

22ndnd Phase: 6 old and 7 new Phase: 6 old and 7 new 33rdrd Phase: 2 active participants Phase: 2 active participants


A case study: the Results

Discussion on Peace Discussion on Peace 5/10/01 – 23/7/035/10/01 – 23/7/03 2 moderators2 moderators 346 members sent 346 members sent

2,850 messages2,850 messages 97% views97% views 3%3% repliesreplies

Views & Replies 5/01-7/03 (2 years, 2 months & 13 days)

02000400060008000

10000120001400016000

5/0

1-10

/01

10/0

1-1/

02

1/0

2-6/

02

7/02-

11/02

12/0

2-1/

03

2/03-

2/03

3/03-

3/03

4/03-

4/03

5/03-

5/03

6/03-

6/03

7/03-

7/03

Series1

Series2

Study 1

0

20

40

60

80

100

120

Messages

Mem

bers

Members


A case study: the Results >

Levels of engagementLevels of engagement (Oriogun, 2003) (Oriogun, 2003)

5/10/01 – 23/7/035/10/01 – 23/7/03 57% Low57% Low 18% Medium18% Medium 25%25% HighHigh + Potential ?%+ Potential ?%

Study 1 High-Low-Medium Participation

24% H 19% M 57% L

1

2

3


A case study: the Results >

Real problems affect Online interactionReal problems affect Online interaction Decisions on reading a message (date, person, Decisions on reading a message (date, person,

keywords, familiar words)keywords, familiar words) Reading a dialogue (learn & use, add, resolve, Reading a dialogue (learn & use, add, resolve,

conclude)conclude) Criteria selection (clarification, innovation, Criteria selection (clarification, innovation,

integration, promotion, search)integration, promotion, search) Think>Reflect>Respond (clarification, Think>Reflect>Respond (clarification,

statement, opening new topic, contradiction, statement, opening new topic, contradiction, challenge)challenge)

Read the same messagesRead the same messages


A case study: the Results.

ObstaclesObstacles irrelevant title (70%)irrelevant title (70%) quantity of the messages (20%)quantity of the messages (20%) the interface (10%)the interface (10%) poor quality of the messagepoor quality of the message irrelevant responses irrelevant responses

Significant observationsSignificant observations Time consumingTime consuming 2/13 (15,3%) developed empathy. These were 2/13 (15,3%) developed empathy. These were

the ones who actively participated in the the ones who actively participated in the discussiondiscussion


A case study: Discussion >

EEnformatic – SILOD Phase Informatic – SILOD Phase I

initial contactinitial contact identification of keywordsidentification of keywords identification of keyword locus contextidentification of keyword locus context identification of information lociidentification of information loci comparison and critical view between comparison and critical view between

the information locithe information loci


Discussion (I)

Pseudo-Pseudo-eenergetic – SILOD Phase IInergetic – SILOD Phase II Active EngagementActive Engagement with an Agentwith an Agent

the positive response (R+) describes a the positive response (R+) describes a member’s opinion in order to promote, to member’s opinion in order to promote, to clarify, to present a meaningful information or clarify, to present a meaningful information or to integrate new points of view; to integrate new points of view;

the negative response (Rˉ) describes an the negative response (Rˉ) describes an opposition, a challenge, the opening of the opposition, a challenge, the opening of the discussion on a different level or the addition discussion on a different level or the addition of a new approach; and of a new approach; and

the neutral response (R) that describes the the neutral response (R) that describes the inactivity of the member.inactivity of the member. This should be This should be omitted.omitted.


Discussion (II)

EEnergetic – SILOD Phase IIInergetic – SILOD Phase III

Active EngagementActive Engagement with a Humanwith a Human

Interactive engagementInteractive engagement refers to the refers to the members’ ability to suggest to the members’ ability to suggest to the agents changes via Online Dynamic agents changes via Online Dynamic Enquiry regarding the policy and the Enquiry regarding the policy and the system as suchsystem as such


A case study: System Definition

Agent-Oriented Systems MethodologyAgent-Oriented Systems Methodology specification of the systemspecification of the system directly programming systems and directly programming systems and verification of the systemverification of the system

Characteristics:Characteristics: Architectural Independence (different Architectural Independence (different

paradigms and architectures must be paradigms and architectures must be accommodated naturally)accommodated naturally)

Robustness and Scalability (supporting Robustness and Scalability (supporting dynamic social interactions between agents dynamic social interactions between agents and the system) and the system) Wooldridge & Ciancarini,Wooldridge & Ciancarini, 20012001

the user mobility for user modeling & supportthe user mobility for user modeling & support


AOSE can handle:

Sociability and ReactivitySociability and Reactivity (agents interactions)(agents interactions)

the beliefs that agents have, regarding a the beliefs that agents have, regarding a dynamic environment (reactivity within the dynamic environment (reactivity within the Internet, other agents and the user)Internet, other agents and the user)

the goals that agents try to achieve (exhibition the goals that agents try to achieve (exhibition of goal directed and reactive behaviour)of goal directed and reactive behaviour)

the actions that agents perform and the the actions that agents perform and the effects of these actions effects of these actions

the ongoing interaction that agents have the ongoing interaction that agents have between them and the environment (social between them and the environment (social ability)ability)


AOSE> Gaia> Specification

IDE provided the mappingIDE provided the mapping

GaiaGaia ((Zambonelli, Jennings & Wooldridge, 2003)Zambonelli, Jennings & Wooldridge, 2003)

The goalsThe goals The environmental modelThe environmental model The preliminary interaction modelThe preliminary interaction model The preliminary roles modelThe preliminary roles model The rulesThe rules


Conclusion towards Phase II

IDE as user-based inventive methodologyIDE as user-based inventive methodology

reveals theoretical frameworkreveals theoretical framework

reveals needs reveals needs

identifies specificationsidentifies specifications for a systemfor a system

identifies characteristics identifies characteristics for a systemfor a system

a combination of IDE and intelligent designer-a combination of IDE and intelligent designer-based model –existed approaches- will give the based model –existed approaches- will give the best results towards the construction of best results towards the construction of applicationapplication


Implementation?

Injection of a multi-agent system in Injection of a multi-agent system in online discussion forumsonline discussion forums

• FIPAFIPA• PHP, XML (XRoles)PHP, XML (XRoles)• Jade Jade • MySQLMySQL

BUT… Xmas 2003BUT… Xmas 2003


Agent-assisted Participation Agent-assisted Participation in Communities of Practicein Communities of Practice

Niki LambropoulosNiki [email protected] [email protected]

Learning Technology Research InstituteLearning Technology Research Institute-- London Metropolitan UniversityLondon Metropolitan University


SCH.GR EEEP.GR

4 Online Courses for the Greek teachers 4 Online Courses for the Greek teachers (Communities of Practice, CoP)(Communities of Practice, CoP)

Introduction to ODLIntroduction to ODL

Introduction to Greek Introduction to Greek language as a foreign language as a foreign

Blended LearningBlended Learning

Learning ObjectsLearning Objects

8,500 potential students – 150 up to now8,500 potential students – 150 up to now

Cooperation with ARIADNE Knowledge PoolCooperation with ARIADNE Knowledge Pool


Online Community: DefinitionOnline Community: Definition

Hillery: 94 different definitions of Community Hillery: 94 different definitions of Community (1955)(1955)

An online community consists of An online community consists of (Preece, 2000)(Preece, 2000) : :PeoplePeoplePurposePurposePoliciesPoliciesComputer systems Computer systems

Sociability is concerned with social interaction. Communities with good sociability have unambiguous, supportive, social structures. Usability is concerned with human-computer interaction. Systems with good usability are consistent, controllable and predictable

o PsychologyPsychology

o ManagementManagement

o Technology Technology


Recent Research (2000-)Recent Research (2000-)

Online Community dynamics in everyday lifeOnline Community dynamics in everyday life (Diane Maloney-Krichmar)(Diane Maloney-Krichmar)

Lurking and participation in 1000 online Lurking and participation in 1000 online communitiescommunities (Dorine Andrews, Blair Nonnecke, Greg Morton)(Dorine Andrews, Blair Nonnecke, Greg Morton)

Communicating trust using mobile devices – Communicating trust using mobile devices – empathy & predicabilityempathy & predicability (Heidi Feng, Jonathan Lazar)(Heidi Feng, Jonathan Lazar)

What makes online communities successful? What makes online communities successful? Evaluation heuristics and metricsEvaluation heuristics and metrics (Chadia Abras)(Chadia Abras)

Framework for online community Framework for online community developmentdevelopment (Clarisse S. de Souza)(Clarisse S. de Souza)


What Works- Usability & SociabilityWhat Works- Usability & Sociability

Support evolving communitySupport evolving community

Assess community needsAssess community needs

Design usabilityDesign usabilityInteraction dialogInteraction dialog

NavigationNavigation

ArchivesArchives

Support Tools Support Tools

Plan sociabilityPlan sociabilityPolicies for membershipPolicies for membership

Security & PrivacySecurity & Privacy

CopyrightCopyright

ModeratorsModerators

Source: Preece, Jenny, Online Communities, Wiley, 2000


Criteria for successCriteria for success

UsabilityUsabilitySpeed of Speed of learninglearning

ProductivityProductivity User satisfactionUser satisfaction RetentionRetention ErrorsErrors

SociabilitySociabilityNo. participantsNo. participants

No. messagesNo. messages ReciprocityReciprocity On-topic discussionOn-topic discussion Empathy Empathy Trust Trust

Social satisfactionSocial satisfaction Lurking Lurking Uncivil behaviorUncivil behavior

Source: Jenny Preece, 2001Source: Jenny Preece, 2001


Levels of engagement in CoP Levels of engagement in CoP

No level of engagement - lurkers No level of engagement - lurkers (Preece et al, 2003) (Preece et al, 2003)

Potential level of engagementPotential level of engagement or or

The Grey Zone The Grey Zone Low level of engagementLow level of engagement Medium level of engagementMedium level of engagement High level of engagementHigh level of engagement

Oriogun, 2003Oriogun, 2003


Silent participants or lurkersSilent participants or lurkers (Blair Nonnecke, 2000)(Blair Nonnecke, 2000)

Reasons for not posting (Reasons for not posting (++ & & --)) Uncomfortable in public Uncomfortable in public ++ Learning about the group Learning about the group ++ Building identity Building identity ++ Fear of persistent messages Fear of persistent messages Information overload Information overload ++ Not necessary to postNot necessary to post Personal characteristics (e.g., shyness)Personal characteristics (e.g., shyness) Group influences Group influences ++

Lurkers often feel part of a communityLurkers often feel part of a community++


NOT:NOT: Formal departmentsFormal departments Operational teamsOperational teams Project teamsProject teams Communities of InternetCommunities of Internet Informal networksInformal networks

What are CoP?What are CoP?

Source: Dorin Andrews (NASA Research Summit 2003)Source: Dorin Andrews (NASA Research Summit 2003)


1.1. Mutually defining identitiesMutually defining identities

2.2. Ability to assess the appropriateness of actions Ability to assess the appropriateness of actions and productsand products

3.3. Specific tools, representations & other artifactsSpecific tools, representations & other artifacts

4.4. Local lore, shared stories, inside jokes, knowing Local lore, shared stories, inside jokes, knowing laughterlaughter

5.5. Jargon and shortcuts to communicationJargon and shortcuts to communication

6.6. Styles for displaying membershipStyles for displaying membership

7.7. Shared discourse reflecting a certain Shared discourse reflecting a certain perspective on the worldperspective on the world

CoP have…CoP have…

Source: Dorine Andrews, NASA Research Summit 2003Source: Dorine Andrews, NASA Research Summit 2003


CoP & Genre Issues CoP & Genre Issues (Collins (Collins et et al, KMi Report, 01)al, KMi Report, 01)

Master & DiscipleMaster & Disciple Roles in progressRoles in progress Active involvement (LPP)Active involvement (LPP) TerminologyTerminology Newcomers, new viewsNewcomers, new views Evolution comes from interaction Evolution comes from interaction

between different communitiesbetween different communities


CoP: what is new?CoP: what is new?

Genre-based Learning ObjectsGenre-based Learning Objects

Agent-assisted CoPAgent-assisted CoP Hypothesis:Hypothesis:

Identification of the process could create:Identification of the process could create:• genre-based learning objects in a system for genre-based learning objects in a system for

the lurkers and newcomers along with the lurkers and newcomers along with considerations regarding considerations regarding

Psychology, Psychology, Management and Management and TechnologyTechnology


MethodologyMethodology

A need of a new way A need of a new way

for discovering data towards an for discovering data towards an application application

A.A. IDE & IDE &

B.B. Intelligent Designer-based modelIntelligent Designer-based model


Research MethodologyResearch Methodology

A.A. IDE (identification of the process)IDE (identification of the process)

B.B. Intelligent Designer-based Model Intelligent Designer-based Model 1.1. Conduct interviews to get the needsConduct interviews to get the needs

2.2. Get the latest applications related to Get the latest applications related to the product, if existedthe product, if existed

3.3. Production of the applicationProduction of the application

4.4. Evaluation (quasi-experimental study, Evaluation (quasi-experimental study, 3 groups of 3-5 individuals)3 groups of 3-5 individuals)


Research MethodologyResearch Methodology

A.A. Intelligent Designer-based ModelIntelligent Designer-based Model (towards an application)(towards an application)

Machine Evolution (Turing, 1950)Machine Evolution (Turing, 1950) heredity material as up to date heredity material as up to date

technologytechnology mutation as changes mutation as changes natural selection as users’ evaluationnatural selection as users’ evaluation


Methodology: Pilot 1 (IDE)Methodology: Pilot 1 (IDE)

Identification of the processIdentification of the process Web-based QuestionnairesWeb-based Questionnaires - -Use of Checklist Use of Checklist

& Open box using Cold Fusion, Microsoft Access & & Open box using Cold Fusion, Microsoft Access & HTML (Online Q – sch.gr eeep.gr)HTML (Online Q – sch.gr eeep.gr)

General/demographic informationGeneral/demographic information Ways of using LMSWays of using LMS CoP characteristics CoP characteristics Personal Goals Personal Goals

Data analysisData analysis pearson corpearson corrrelation, elation, Control- Control- relationshiprelationshipss X X Regression Analysis and Regression Analysis and Multivariable Methods Multivariable Methods


Methodology: Pilot 1 (IDE)Methodology: Pilot 1 (IDE)

Web-based Questionnaires Web-based Questionnaires (Andrews et al., 2001, 2003)(Andrews et al., 2001, 2003)

Quality criteriaQuality criteria

survey designsurvey design participant privacy and confidentialityparticipant privacy and confidentiality sampling and participant selectionsampling and participant selection distribution and response distribution and response

managementmanagement survey pilotingsurvey piloting


Methodology: Pilot II > Methodology: Pilot II > Intelligent Designer-based Model -Intelligent Designer-based Model -11

Results for Results for Psychology towards Psychology towards ManagementManagement ( (interviews frominterviews from: : bbc, commkit, bbc, commkit, ladomery, neoone, jindal, tempero, sulake, tuc, lts, exmosis, tagteacher, ladomery, neoone, jindal, tempero, sulake, tuc, lts, exmosis, tagteacher, habbo, bibliotech, chatmoderators)habbo, bibliotech, chatmoderators)

Each community is unique (nature of the group)Each community is unique (nature of the group) EncouragementEncouragement Genuine leaders (not watering people)Genuine leaders (not watering people) ‘‘Pounce’ new users immediately after a first messagePounce’ new users immediately after a first message Lack of Lack of critical-consumer positioncritical-consumer position (one-to-many (one-to-many

media, TV)media, TV) Decision on brevity – length Decision on brevity – length Relevant interestsRelevant interests Lurker is a Lurker is a derogatoryderogatory word word (3)(3) More to dig out without body language and eye More to dig out without body language and eye

contactcontact


Results for Results for Technology Technology ((interviews frominterviews from: : bbc, commkit, ladomery, neoone, jindal, tempero, sulake, tuc, bbc, commkit, ladomery, neoone, jindal, tempero, sulake, tuc, lts, exmosis, tagteacher, habbo, bibliotech, chatmoderators)lts, exmosis, tagteacher, habbo, bibliotech, chatmoderators)

Registration systemRegistration system ProfileProfile Induction/trainingInduction/training TimeTime Small group based social spacesSmall group based social spaces Democracy (Democracy (Votes and polls, Surveys)Votes and polls, Surveys) Visualisation of databasesVisualisation of databases

Methodology: Pilot II > Methodology: Pilot II > Intelligent Designer-based Model -Intelligent Designer-based Model -11


Requirements of the systemRequirements of the system

Psychology (Emotional Intelligence)Psychology (Emotional Intelligence) Management (Strategies, Preece et al, Management (Strategies, Preece et al,

2003)2003) TechnologyTechnology

Moodle/dokeos open source LMSMoodle/dokeos open source LMS Registration/ProfileRegistration/Profile Visualisation Information (members’ Visualisation Information (members’

databases)databases) Support of sub-constructions Support of sub-constructions

(messages/groups)(messages/groups) Avatar > Induction/trainingAvatar > Induction/training Track systemTrack system Automatic > Votes and polls, SurveysAutomatic > Votes and polls, Surveys


Key: Empathy * E.I. Key: Empathy * E.I.

‘‘KnowingKnowing what another person is what another person is feeling, feeling, feelingfeeling what another what another person is feeling and person is feeling and respondingresponding compassionately to another person’compassionately to another person’

Levenson & Reuf, 1992Levenson & Reuf, 1992

Source: Jenny Preece, Webshop, 2002Source: Jenny Preece, Webshop, 2002


… … for your attention!for your attention!

Niki LambropoulosNiki Lambropoulos

Thank you …

Any questions and/or suggestions?


Additional material if timeAdditional material if time


Analysis of 500 messagesAnalysis of 500 messages

0

5

10

15

20

25

30

35

40

45

Other Narrative Empathy Factual

Source: Jenny Preece, Webshop, 2002Source: Jenny Preece, Webshop, 2002

9%9%

niki lambropoulos may 2004 phd presentation slide 1 overview 1 st study: vicarious learning in...

Documents