Research Trends: Research Trends:

Qualitative Analysis in Qualitative Analysis in

CSCLCSCL

Heisawn Jeong, PhD

Hallym University, S. Korea

Web 2.0Web 2.0

Social networking, Social networking, blogsblogs, , wikiwiki, video sharing, etc., video sharing, etc.

Web environment/technology that enables Web environment/technology that enables

interactions among usersinteractions among users

User creates contents as well as receives.User creates contents as well as receives.

Collaboration and learningCollaboration and learning

Effectiveness of collaboration as a tool for learningEffectiveness of collaboration as a tool for learning

and knowledge buildingand knowledge building

Increased use of technology to support learningIncreased use of technology to support learning

CSCL: ComputerCSCL: Computer--Supported Collaborative LearninSupported Collaborative Learnin

MultiMulti--disciplinary and multidisciplinary and multi--method research method research

approachesapproaches

Goals of the talkGoals of the talk

Methodological trends in ComputerMethodological trends in Computer--Supported Supported

Collaborative LearningCollaborative Learning

MixedMixed--Method approaches Method approaches

Methodological issues and challengesMethodological issues and challenges

Disclaimer: SpeakerDisclaimer: Speaker’’s methodological backgrounds methodological background

(cognitive psychology, verbal data analysis)(cognitive psychology, verbal data analysis)

Methodological trendsMethodological trends

Meta contentMeta content--analysis of CSCL empirical researchanalysis of CSCL empirical research

paperspapers

OnOn--going researchgoing research

JeongJeong, H., & , H., & HmeloHmelo--Silver, C. (2010). Silver, C. (2010). An overview of CSCL An overview of CSCL

methodologies. Paper presented at the International Conferencmethodologies. Paper presented at the International Conference

of the Learning Sciences, Chicago.of the Learning Sciences, Chicago.

JeongJeong, H., & , H., & HmeloHmelo--Silver, C. (2011). Silver, C. (2011). A portrait of CSCL A portrait of CSCL

methodologies. Paper to be presented at the Computermethodologies. Paper to be presented at the Computer--SupporSuppor

Collaborative Learning, Hong Kong.Collaborative Learning, Hong Kong.

Method of analysisMethod of analysis

7 leading journals of the field7 leading journals of the field

4 years of publication (20054 years of publication (2005--2008)* (N=1,423)2008)* (N=1,423)

Empirical papers (N=315*)Empirical papers (N=315*)

Results are based on N=265 (Coding is still in Results are based on N=265 (Coding is still in

progress)progress)

JournalsJournals

International Journal of Computer Supported International Journal of Computer Supported Collaborative Learning (Collaborative Learning (ijCSCLijCSCL))

Journal of the Learning SciencesJournal of the Learning Sciences

Learning and InstructionLearning and Instruction

Computers and EducationComputers and Education

Journal of Computer Assisted LearningJournal of Computer Assisted Learning

International Journal of Artificial Intelligence in International Journal of Artificial Intelligence in EducationEducation

Computers in Human Behavior. Computers in Human Behavior.

Paper selectionPaper selection

Papers published during 2005~2008 (exception: Papers published during 2005~2008 (exception:

2006~2007 for 2006~2007 for ijCSCLijCSCL))

Empirical CSCL papers:Empirical CSCL papers:

Report on dataReport on data

Collaborative learningCollaborative learning

Use of computers or other technologiesUse of computers or other technologies

315* empirical CSCL papers (out of 1,423 papers)315* empirical CSCL papers (out of 1,423 papers)

Coding categoriesCoding categories

1.1. Design Design

2.2. Study settings Study settings

3.3. DataData

4.4. Analysis Analysis

5.5. Research questionsResearch questions

6.6. Theoretical frameworTheoretical framewor

7.7. Learner levelLearner level

8.8. Domain Domain

9.9. Pedagogical Pedagogical

approachesapproaches

10.10. Technologies Technologies

11.11. Type of collaborationType of collaboration

Research designResearch design

Majority of the studies are descriptive (e.g., surveyMajority of the studies are descriptive (e.g., survey

observations, ethnographic studies).observations, ethnographic studies).

Research settingsResearch settings

Majority of the studies were carried out in Majority of the studies were carried out in

classrooms.classrooms.

Data typesData types

Multiple types of data are collected in a given studMultiple types of data are collected in a given stud

(M=2.72)(M=2.72)

Data on learning processes are:Data on learning processes are:

Data on learning outcomes are:Data on learning outcomes are:

Other data sources include:Other data sources include:

AnalysesAnalyses

Quantitative analyses are dominant throughout, buQuantitative analyses are dominant throughout, bu

substantial proportion of the studies use qualitativesubstantial proportion of the studies use qualitative

analysesanalyses

Popular quantitative analyses are:Popular quantitative analyses are:

Qualitative analyses are getting more popular, butQualitative analyses are getting more popular, but

they are not clearly defined.they are not clearly defined.

Summary of trendsSummary of trends

Increase of field (i.e., classroom) researchIncrease of field (i.e., classroom) research

Increase of designIncrease of design--based research based research

Increase of mixedIncrease of mixed--methods or multimethods or multi--methods methods

researchresearch

Types of mixedTypes of mixed--approacheapproaches

Collect qualitative data in addition to quantitative Collect qualitative data in addition to quantitative

data. Contextualize quantitative analysis with data. Contextualize quantitative analysis with

qualitative analyses. qualitative analyses.

Collect qualitative data, but analyze them to allowCollect qualitative data, but analyze them to allow

quantitative analyses (e.g., verbal analysis, quantitative analyses (e.g., verbal analysis,

quantitative content analysis)quantitative content analysis)

Use quantitative and qualitative analysis to addresUse quantitative and qualitative analysis to addres

different research questionsdifferent research questions

Methodological challengesMethodological challenges

Shallow application of methodologiesShallow application of methodologies

Increase of qualitative methods, but often lack cleaIncrease of qualitative methods, but often lack clea

definition and rigor of applicationdefinition and rigor of application

Lack of more sophisticated methodological Lack of more sophisticated methodological

vocabularies vocabularies

Epistemological incompatibility: Epistemological incompatibility:

Reality vs. InterpretationReality vs. Interpretation

Procedure vs. MeaningfulnessProcedure vs. Meaningfulness

Presented at the Asia-Pacific conference on

Qualitative Research in Web 2.0

22 & 23 Feb 2011, Macau SAR

For more information

Please visit: http://www.merlien.org