learning analytics and knowledge (lak) 14 education data sciences
DESCRIPTION
Full paper presentationTRANSCRIPT
![Page 1: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/1.jpg)
1
Education Data SciencesFraming Emergent Practices for Analytics of Learning, Organizations, and Systems
Philip J. PietyEd Info Connections
Daniel T. HickeyLearning Sciences,
School of EducationIndiana University
MJ BishopCenter for Innovation and
Excellence in Learning & Teaching University System of Maryland
![Page 2: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/2.jpg)
2
Acknowledgements
![Page 3: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/3.jpg)
3
Four Big Ideas
1. Sociotechnical paradigm shift2. Notion of Education Data Sciences (EDS)– Academic/Institutional Analysis– Learning Analytics/Educational Data Mining– Learning Analytics/Personalization– Systemic Instructional Improvement
3. Common features across these communities4. Framework for EDS
![Page 4: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/4.jpg)
4
SOCIOTECHNICAL PARADIGM SHIFT IN CONCEPTION OF DATA
From External/Distant/Artificial to Internal/Current/Contextual
![Page 5: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/5.jpg)
5
Paradigm Shifts
4. Disruption in traditional evidentiary practice
3. Expansion of academic knowledge
(ex: CCSS, NGSS)
2. Qualitative shift from
institution to individual
1. Digital tools create vast quantities, categories of data
![Page 6: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/6.jpg)
6
The Educational Data Movement
Understanding how the organizational model of education is similar to/different from other fields is key to understanding the educational data movement.
1980 – 1990 - 2000 - 2010
Finance
Manufacturing
Retail
Health Care
Education
![Page 7: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/7.jpg)
7
The Educational Data Movement
Understanding how the organizational model of education is similar to/different from other fields is key to understanding the educational data movement.
1980 – 1990 - 2000 - 2010
Finance
Manufacturing
Retail
Health Care
Big Data,Analytics,
Informatics, Data
Science
Education
![Page 8: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/8.jpg)
8
The Educational Data Movement
![Page 9: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/9.jpg)
9
Early Childhood
K-12
Post Secondary
Continuing/Career
Individuals Cohorts Organizations Systems
Scale of Educational Context
Educ
ation
al L
evel
(Age
)The EDS Landscape
![Page 10: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/10.jpg)
10
Early Childhood
K-12
Post Secondary
Continuing/Career
Individuals Cohorts Organizations Systems
Scale of Educational Context
Educ
ation
al L
evel
(Age
)
Academic/Institutional
Analytics
Academic/Institutional Analytics
![Page 11: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/11.jpg)
11
Academic/Institutional Analytics
![Page 12: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/12.jpg)
12
Systemic/Instructional Improvement
Early Childhood
K-12
Post Secondary
Continuing/Career
Individuals Cohorts Organizations Systems
Scale of Educational Context
Educ
ation
al L
evel
(Age
)
Academic/Institutional
Analytics
Systemic/Instructional Improvement
![Page 13: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/13.jpg)
13
Systemic/Instructional Improvement
“In many ways, the practice of data use is out ahead of research. Policy and interventions to promote data use far outstrip research studying the process, context, and consequences of these efforts. But the fact that there is so much energy promoting data use and so many districts and schools that are embarking on data use initiatives means that conditions are ripe for systematic, empirical study.”
Coburn, Cynthia E., and Erica O. Turner. "Research on data use: A framework and analysis." Measurement: Interdisciplinary Research & Perspective 9.4 (2011): 173-206.
![Page 14: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/14.jpg)
14
Systemic/Instructional Improvement
Early Childhood
K-12
Post Secondary
Continuing/Career
Individuals Cohorts Organizations Systems
Lear
ning Analy
tics/
Ed. D
ata M
ining
Scale of Educational Context
Educ
ation
al L
evel
(Age
)
Academic/Institutional
Analytics
EDM/Learning Analytics
![Page 15: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/15.jpg)
15
EDM/Learning Analytics
![Page 16: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/16.jpg)
16
Systemic/Instructional Improvement
Early Childhood
K-12
Post Secondary
Continuing/Career
Individuals Cohorts Organizations Systems
Lear
ner A
naly
tics/
Pe
rson
aliz
ation Lear
ning Analy
tics/
Ed. D
ata M
ining
Scale of Educational Context
Educ
ation
al L
evel
(Age
)
Academic/Institutional
Analytics
LearnER Analytics/Personalization
![Page 17: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/17.jpg)
17
LearnER Analytics/Personalization
![Page 18: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/18.jpg)
18
Systemic/Instructional Improvement
Early Childhood
K-12
Post Secondary
Continuing/Career
Individuals Cohorts Organizations Systems
Lear
ner A
naly
tics/
Pe
rson
aliz
ation Lear
ning Analy
tics/
Ed. D
ata M
ining
Scale of Educational Context
Educ
ation
al L
evel
(Age
)
Academic/Institutional
Analytics
D. Flipped Classrooms
C. Early Warning Systems
A. School to College Analyses
B. Teacher Preparation
Efficacy Evaluation
Boundary Conditions
![Page 19: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/19.jpg)
19
COMMON FEATURES & FACTORS IN EDUCATIONAL DATA SCIENCES
A unified perspective for Educational Data Science
![Page 20: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/20.jpg)
20
Five Common Features in EDS
1. Rapidly changing- Indicative of sociotechnical movement
2. Boundary issues- All communities touch on other communities
3. Disruption in evidentiary practices- Big data is disrupting all the sectors
4. Visualization, interpretation, and culture- Dashboards, representations, APIs, open data
5. Ethics, privacy and governance - FERPA & COPPA
![Page 21: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/21.jpg)
21
Four Factors that Make All Educational Data Unique
• Human/social creation–Most requires human manipulation
• Measurement imprecision–Reliability issues are huge
• Comparability challenges –Validity creates “wicked problems”
• Fragmentation–Systems can’t talk to each other
![Page 22: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/22.jpg)
22
SOME COMMON PRINCIPLES
A unified perspective for Educational Data Science
![Page 23: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/23.jpg)
23
Computer Science
Education Data Sciences
Statistical Data Analysis
Organization & Mgmt Sciences
Classroom/ Learning Technology
Learning Sciences
Decision Sciences
Machine Learning
Data Mining
Hum-Comp. Interaction &Visualization
Natural Language Processing
Computational Statistics
Interdisciplinary Perspectives
Information Sciences
![Page 24: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/24.jpg)
24
Recognize Social/Temporal LevelsTimescale
Context
Targeted Educational
ContentTime
Frame
Format of Educational
EvidenceAppropriate Formative Function for Students
Ideal FormativeFunctions for Others
Immediate
Curricular Activity(lesson)
Minutes Event-oriented observations (Informal observations of the enactment of the activity)
Discourse during the enactment of a particular activity.
Teacher: Refining discourse during the enactment of a particular activity.
Close Curricular Routines (chapet/unit)
Days Activity-oriented quizzes (semi-formal classroom assessments)
Discourse following the enactment of chapter, quiz.
Teacher: Refining the specific curricular routines and providing informal remediation to students.
Proximal Entire Curricula
Weeks Curriculum-oriented exams (Formal classroom assessments)
Understanding of primary concepts targeted in curriculum.
Teacher/curriculum developer: providing formal remediation and formally refining curricula.
Distal Regional/National Content Standards
Months Criterion-referenced tests (external tests aligned to content standards)
Administrators: Selection of curricula that have the largest impact on achievement in broad content domains.
Remote National Achieve-ment
Years Norm-referenced external tests standardized across years (ex: ITBS, NAEP)
Policy makers: Long-term impact of policies on broad achievement targets.
![Page 25: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/25.jpg)
25
Digital Fluidity
State Longitudinal Data Systems
District Data Warehouses and
Teacher Evaluation Systems
Learning Tools-Driven
Analytics
School Teams
School Leaders
District Curriculum
District Leaders
Teacher Planning
Individual Students
State Analysis
![Page 26: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/26.jpg)
26
Values in Design
Infrastructure and Tools Context
Organizational and Political Context
•routines•access to data•leadership•time•norms•power relations
Processes of data use
•noticing•interpreting•constructing implications
•data components•linkages•time span covered•Infrastructure boundaries•data quality•technology features
![Page 27: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/27.jpg)
27
Flashlights, Imperfect Lenses
![Page 28: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/28.jpg)
28
Four Big Ideas
1. Sociotechnical paradigm shift2. Notion of Education Data Sciences (EDS)– Academic/Institutional Analysis– Learning Analytics/Educational Data Mining– Learning Analytics/Personalization– Systemic Instructional Improvement
3. Common features across these communities4. Framework for EDS
![Page 29: Learning Analytics and Knowledge (LAK) 14 Education Data Sciences](https://reader038.vdocument.in/reader038/viewer/2022110308/557cf59ed8b42a89158b48b0/html5/thumbnails/29.jpg)
29
Education Data SciencesFraming Emergent Practices for Analytics of Learning, Organizations, and Systems
Philip J. PietyEd Info Connections
Daniel T. HickeyLearning Sciences,
School of EducationIndiana University
MJ BishopCenter for Innovation and
Excellence in Learning & Teaching University System of Maryland