peopleviews: human computation for constraint-based recommendation
TRANSCRIPT
![Page 1: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/1.jpg)
W I S S E N T E C H N I K L E I D E N S C H A F T
contact: [email protected] // http://www.ist.tugraz.at/
PeopleViews: Human Computation forConstraint-Based Recommendation
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz,Stefan Reiterer, Martin Stettinger, Institute for Software Technology,Graz University of Technology
![Page 2: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/2.jpg)
2 Contents
1. Motivation
2. PeopleViews
3. Recommendation approach
4. Evaluation
5. Ongoing and future work
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 3: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/3.jpg)
3
Motivation
Constraint-based Recommendation
Specific type of knowledge based recommendation
Relies on a predefined set of constraints
Rankings determined by utility function
Why constraint-based recommendation?
Suitable for complex item domainsPossible to ”explain“ recommendationsDiagnoses for too strict requirements
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 4: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/4.jpg)
4
Motivation
Knowledge acquisition bottleneck
Only a few KnowledgeEngineers
Possibly a lot of userswith item knowledge
Idea: enable users tocontribute to knowledgebases
Are users willing tocontribute to knowledgebases?
End Users
KnowledgeEngineers
Item Knowledge Knowledge Base
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 5: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/5.jpg)
5
Motivation
How willing are end users to contribute?
N=161, 111 would be willing to contribute
[Felfernig et al., CrowdRec 2014]
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 6: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/6.jpg)
6
PeopleViews
PeopleViews
Short-term tasks (Micro-tasks)
Domain experts perform short-term knowledgeengineering tasks they are much better incompared to knowledge engineers.
Potential advantages
Less effort related to recommendation knowledgebase development and maintenanceFewer erroneous constraintsSignificantly higher degree of scalability
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 7: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/7.jpg)
7
PeopleViews
PeopleViews - Knowledge base
Product attributes
”Facts“ about items, e.g. sensor size of a cameraDefined when item is added to knowledge base
User attributes
Perceived differently by users, e.g. a camerasfield of applicationDefined by users in micro tasks
Support
Support of item for specific {user, product}attribute value
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 8: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/8.jpg)
8
PeopleViews
PeopleViews - Features
Users are able to:
Define new knowledge bases
Create new recommendation domainAdd items to existing domainsEvaluate existing items
”Answer“ micro tasks
Use existing knowledge bases to getrecommendations
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 9: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/9.jpg)
9
PeopleViews
Definition of knowledge bases
Product attributes
attribute question to user domain similaritymetric
sensorsize Preferred sensorsize?
{fullframe, APS-C,MFT, 1“, 2/3“} EIB
max-shutterspeed
Required max.shutter speed?
{1/4000, 1/6000,1/8000, 1/16000} LIB
maxISO Required max.ISO sensitivity?
{6400, 12800,25600} MIB
price Max. price? integer LIB
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 10: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/10.jpg)
10
PeopleViews
Definition of knowledge bases
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 11: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/11.jpg)
11
PeopleViews
Definition of knowledge bases
User attributes
attribute choice type question to user domainusertype multiple Suited for whom? { beginner, amateur, expert }
application single Preferred { sport, architecture, macro,application? landscape, portrait }
usability single Minimum accepted { average, high, very high }usability?
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 12: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/12.jpg)
12
PeopleViews
Definition of knowledge bases
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 13: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/13.jpg)
13
PeopleViews
Micro-tasks
choice type: multipleAlexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 14: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/14.jpg)
14
PeopleViews
Micro-tasks
choice type: single
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 15: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/15.jpg)
15
PeopleViews
Micro-tasks
choose item, single attributeAlexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 16: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/16.jpg)
16
PeopleViews
Recommendation view
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 17: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/17.jpg)
17
PeopleViews
Recommendation view - Item details
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 18: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/18.jpg)
18
Recommendation approach
Recommendation approach in PeopleViews
User attributes
support(Φ,u, v) =
∑s(Φ,u, v)
|s(Φ,u, v)|· |s(Φ,u, v)||s(Φ,u)|
symbol meaningΦ itemu user attribute u ∈ Up product attributev {user, product} attribute value
s(Φ, u, v) support specified by user
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 19: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/19.jpg)
19
Recommendation approach
Recommendation approach in PeopleViews
Product attributes
support(Φ,p, v) =
1if v = val(Φ, p), 0 otherwise EIB
1− |v - val(Φ, p)|max(Φ, p) - min(Φ, p)
NIB
val(Φ, p)-min(Φ, p)max(Φ, p) - min(Φ, p)
MIB
max(Φ, p)-val(Φ, p)max(Φ, p) - min(Φ ,p)
LIB
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 20: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/20.jpg)
20
Recommendation approach
Recommendation approach in PeopleViews
Selection of recommendation-relevant items
f(Φ) =∧u∈U
u ∈ values(Φ, u) ∪ {noval} → include(Φ)
Ranking items by their utility
utility(Φ, REQ) =∑
a=v∈REQ
support(Φ, a, v) ·w(a)
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 21: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/21.jpg)
21
Evaluation
Evaluation of recommender algorithms
Collect data using WeeVis (http://www.weevis.org)
Canon DSLR recommender
16 items, 7 attributes (27 possible ”answers“)
Users defined their requirements and selected bestmatching camera
356 unique sessions
1 out of N ”training and evaluation“
Is desired item in top n recommended items?
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 22: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/22.jpg)
22
Evaluation
Comparison to other approaches
1 1.5 2 2.5 3 3.5 4 4.5 50
10
20
30
40
50
60
70
80
90
100
top n
pre
cis
ion in %
Learned Weights
Support Values
Popularity Based
Random
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 23: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/23.jpg)
23
Ongoing and future work
Ongoing and future work
Recommendation approaches
Implementation and evaluation of furtherapproaches; diagnoses and repair
Micro-task scheduling
Automatically assign micro-tasks to users, usinga content-based approach
Quality assurance
Improve dataset quality and prevent manipulation
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger
![Page 24: Peopleviews: Human Computation for Constraint-Based Recommendation](https://reader031.vdocument.in/reader031/viewer/2022030223/588307981a28abe70d8b6a43/html5/thumbnails/24.jpg)
24
Thank you!
Alexander Felfernig, Thomas Ulz, Sarah Haas, Michael Schwarz, Stefan Reiterer, Martin Stettinger