combining content analytics and activity tracking to mine user interests and enable knowledge...
TRANSCRIPT
![Page 1: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/1.jpg)
Combining Content Analytics and Activity Tracking
to Identify User Interests and Enable Knowledge Discovery
Andrii Vozniuk, María Jesús Rodríguez-Triana, Adrian Holzer, Denis Gillet
The copyright of images belongs to their authors. I will remove them on demand. Contact me at [email protected]
UMAP PALE, Halifax, July 2016
Paper: https://goo.gl/5cJsSK
![Page 2: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/2.jpg)
REACT - EPFL - Lausanne
![Page 3: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/3.jpg)
REACT=
Coordination & Interaction Systems Group
![Page 4: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/4.jpg)
SpeakUp
is a co-located social media to improve audience interaction
speakup.info
![Page 5: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/5.jpg)
graasp.euGraaspa social media used as a personal and collaborative learning environment
![Page 6: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/6.jpg)
Inquiry Learning SpacesTeachers construct courses for their students by finding and
structuring relevant content
![Page 7: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/7.jpg)
Content in Graasp
![Page 8: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/8.jpg)
Teachers would like to benefit from relevant
content uploaded by others
Students would like to get relevant contenteven when not included
![Page 9: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/9.jpg)
How to suggest relevant content to users ?& keep them in control
![Page 10: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/10.jpg)
Approach
![Page 11: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/11.jpg)
“Learner-content interaction is a defining characteristic of education …”
M. G. Moore. Editorial: Three types of interaction.The American Journal of Distance Education, 3(2):1–6, 1989.
”… it is the process of intellectually interacting with content that results in changes in the learner’s understanding, the learner’s perspective, or the cognitive structures of the learner’s mind”
![Page 12: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/12.jpg)
Recommenders for LearningA review of 82 recommenders for learning [Drachsler et al 2015]
Discovering by the instructors relevant learning resources used by students when learning, that are not part of the materials provided by the instructor [Zaldivar et. al. 2011]• Considered present terms to describe the content• TF-IDF based on terms from the content• Looked at one type of interaction (visit)• No possibility to adjust recommendations by the user
Personalized recommendations of relevant knowledge assets based on user interactions with content [El Helou et. al. 2010]• Built user-content graph based on interactions• Used modified PageRank to get relevant items• Considered multiple types of interactions• Did not look inside of the content• No possibility to adjust recommendations by the user
No explicit identification of interests. No control over them.
![Page 13: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/13.jpg)
RecordUser-
ContentInteractions
BuildUser
InterestsProfile
ProvideRecommendations
ExtractConceptsfrom theContent
Our Approach
![Page 14: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/14.jpg)
Extracting ConceptsExtracted
TextContent
Items on platform
Binary Text File
.pdf .docx
Imagewith text
.png .jpg .tiff
Image
Audio
Video
Content Extraction
Plain Text File
Optical Character
Recognition
Speech-To-Text
Visual Image Recognition
Visual Video Recognition
Content Analysis
Content and ConceptsIndexing
IdentifiedConcepts
IndexedIdentifiedConcepts
andText
Content
RecommenderSystem
![Page 15: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/15.jpg)
Pdf Report
PowerpointPresentation
Image withText
YoutubeVideo
Σw*UA*DC
accessed
rated
commented
downloadedEducationEducational psychologyKnowledgeLearningKnowledge ManagementHuman-Computer InteractionInterdisciplinarityAcademiaSystems thinkingScientific methodEducational technologyVirtual learning environment
User
Identified Concepts (DC)
Identified User Concepts(UC)
Tracked Activities (UA)
EducationEducational psychology
KnowledgeLearning
Knowledge ManagementSystems thinkingScientific method
Educational technologyVirtual learning environment
LearningKnowledge Management
Human-Computer InteractionInterdisciplinarity
EducationEducational psychology
Academia
Building Interests Profile
![Page 16: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/16.jpg)
Providing Recommendations
Step 2. Use vector cosine similarity for scoring and ranking
Step 1. Compute TF-IDF for each term in the vectors
Step 0. Represent each content item concepts using the document vector model
![Page 17: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/17.jpg)
Implementation & Evaluation
![Page 18: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/18.jpg)
Graasp
AlchemyAPI for concept extractionActivityStreams / xAPI for Interaction Tracking
ElasticSearch for storage and recommendations
Open-source tools for text extraction
![Page 19: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/19.jpg)
Implementation in Graasp
![Page 20: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/20.jpg)
Preliminary Evaluation• Six pre-service teachers, participants of a workshop on
inquiry-based learning
• They were newly registered users (no interaction data)
• Interacted for 2 hours
• Survey from three parts
1. General disposition towards the interests identification and the interests-based recommender
2. System Usability Scale for the solution
3. Recommender Precision
![Page 21: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/21.jpg)
Evaluation Outcomes
Complete results: https://goo.gl/Wes6uP
Would like to edit interests
Concerned about privacy
We use a 5-point Likert Scale
![Page 22: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/22.jpg)
Evaluation Outcomes
Was easy to use
Easy to get started
![Page 23: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/23.jpg)
Evaluation Outcomes
Misidentified concepts in popular content can push up irrelevant concepts
Two groups: relevant and irrelevant interests
Two groups: relevant and irrelevant suggestions
![Page 24: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/24.jpg)
Conclusions• Proposed a general and scalable approach
deployable in systems where content and interactions are available
• Allows users to modify the interests
• Implementation in a real system, can be used as a guideline
• Preliminary evaluation in an authentic setting
![Page 25: Combining content analytics and activity tracking to mine user interests and enable knowledge discovery - UMAP PALE 2016 - Andrii Vozniuk, Maria Rodriguez-Triana, Adrian Holzer, Denis](https://reader031.vdocument.in/reader031/viewer/2022030115/589c42561a28abec478b6f0f/html5/thumbnails/25.jpg)
Future Work• Address misidentified concepts-related issues
• Learn optimal action weights
• Incorporate concept relevance score into similarity
• Substantial Evaluation
• Run a bigger scale evaluation
• Check not only precision, but as well recall
• Compare to existing approaches. Dataset?