hyper: a flexible and extensible probabilistic framework for hybrid recommender systems pigi kouki,...
TRANSCRIPT
![Page 1: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/1.jpg)
HyPER: A Flexible and Extensible Probabilistic Framework for
Hybrid Recommender Systems
Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki, Lise Getoor
University of California, Santa Cruz University of Maryland, College Park
San Jose State University
![Page 2: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/2.jpg)
2
Motivation• Increasing amount of data useful for recommendations
content
social demographic
ratings
![Page 3: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/3.jpg)
3
Multiple Data Sources
• Content – [Gunawardana and Meek, RecSys 2009]– [Forbes and Zhu, RecSys 2011]– [de Campos et al., IJAR 51(7) 2010]
• Social relationships– [Ma et al., WSDM 2011]– [Liu et al., DSS 55(3) 2013]
Combining ratings with otherdata sources improves performance
![Page 4: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/4.jpg)
4
Multiple Data Sources
• Content – [Gunawardana and Meek, RecSys 2009]– [Forbes and Zhu, RecSys 2011]– [de Campos et al., IJAR 51(7) 2010]
• Social relationships– [Ma et al., WSDM 2011]– [Liu et al., DSS 55(3) 2013]
Combining ratings with otherdata sources improves performance
![Page 5: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/5.jpg)
5
Multiple Data Sources
• Content – [Gunawardana and Meek, RecSys 2009]– [Forbes and Zhu, RecSys 2011]– [de Campos et al., IJAR 51(7) 2010]
• Social relationships– [Ma et al., WSDM 2011]– [Liu et al., DSS 55(3) 2013]
Combining ratings with otherdata sources improves performance
![Page 6: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/6.jpg)
6
Multiple Data Sources
• Review text – [McAuley & Leskovec, RecSys 2013]– [Ling et al., RecSys, 2014]
• Tags and labels– [Guy et al., SIGIR 2010]
• Feedback– [Sedhain et al., RecSys, 2014]
Combining ratings with otherdata sources improves performance
#cool #neat #ok #sucks
![Page 7: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/7.jpg)
7
Multiple Data Sources
• Review text – [McAuley & Leskovec, RecSys 2013]– [Ling et al., RecSys, 2014]
• Tags and labels– [Guy et al., SIGIR 2010]
• Feedback– [Sedhain et al., RecSys, 2014]
Combining ratings with otherdata sources improves performance
#cool #neat #ok #sucks
![Page 8: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/8.jpg)
8
Multiple Data Sources
• Review text – [McAuley & Leskovec, RecSys 2013]– [Ling et al., RecSys, 2014]
• Tags and labels– [Guy et al., SIGIR 2010]
• Feedback– [Sedhain et al., RecSys, 2014]
Combining ratings with otherdata sources improves performance
#cool #neat #ok #sucks
![Page 9: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/9.jpg)
9
Multiple Recommenders
• [Jahrer et al., KDD 2010]• [Burke, In The Adaptive Web, 2007]
Combining predictions of multiple recommenders also improves performance
“Predictive accuracy is substantially improved when blending multiple predictors”-[Bell et al., The BellKor Solution to the Netflix Prize, 2007]
See also:
![Page 10: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/10.jpg)
10
Desiderata for Hybrid Systems
• To get the best performance, we should make use of all available data sources and algorithms
• We need a framework that is:– General
• Combines arbitrary data modalities• Combines multiple recommenders• problem and data-agnostic
– Extensible to new information sources/recommenders– Scalable to large data sets
![Page 11: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/11.jpg)
11
Desiderata for Hybrid Systems
• To get the best performance, we should make use of all available data sources and algorithms
• We need a framework that is:– General
• Combines arbitrary data modalities• Combines multiple recommenders• problem and data-agnostic
– Extensible to new information sources/recommenders– Scalable to large data sets
![Page 12: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/12.jpg)
12
Desiderata for Hybrid Systems
• To get the best performance, we should make use of all available data sources and algorithms
• We need a framework that is:– General
• Combines arbitrary data modalities• Combines multiple recommenders• problem and data-agnostic
– Extensible to new information sources/recommenders– Scalable to large data sets
![Page 13: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/13.jpg)
13
General Hybrid Recommendersin the Literature
• Existing hybrid systems, though powerful, typically fall short on either generality, extensibility, or scalability– Often combine collaborative and/or content-based methods with
each other or just one other data modality (cf. previous slides)
– Some systems can leverage heterogeneous data• [Gemmell et al. 2012, Burke et al. 2014, Yu et al. 2014]
• Probabilistic graphical modeling approaches are typically more general, less scalable– Bayesian networks [de Campos et al., IJAR 51(7) 2010]
– Markov logic networks [Hoxha & Rettinger, ICMLA 2013]
![Page 14: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/14.jpg)
14
General Hybrid Recommendersin the Literature
• Existing hybrid systems, though powerful, typically fall short on either generality, extensibility, or scalability– Often combine collaborative and/or content-based methods with
each other or just one other data modality (cf. previous slides)
– Some systems can leverage heterogeneous data• [Gemmell et al. 2012, Burke et al. 2014, Yu et al. 2014]
• Probabilistic graphical modeling approaches are typically more general, less scalable– Bayesian networks [de Campos et al., IJAR 51(7) 2010]
– Markov logic networks [Hoxha & Rettinger, ICMLA 2013]
![Page 15: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/15.jpg)
15
Our Approach
• A general, extensible, scalable recommender framework
• Leverages advances in statistical relational learning– Probabilistic soft logic [Bach et al., UAI 2013, ArXiv 2015]
• Inspired by recent work in drug-target interaction prediction [Fakhraei et al., Transactions on Computational Biology and Bioinformatics 11(5) 2014]
We propose HyPER: Hybrid Probabilistic Extensible Recommender
![Page 16: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/16.jpg)
16
Hybrid Modeling with HyPER
Data Source
Recommender
3
4
…
Predicted Ratings
![Page 17: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/17.jpg)
17
Hybrid Modeling with HyPER
Data Source 1
Recommender
3
4
…
Predicted RatingsData Source 2
Data Source N
…
![Page 18: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/18.jpg)
18
Hybrid Modeling with HyPER
Data Source 1
Recommender 1
3
4
…
Predicted RatingsData Source 2
Data Source N
…
Recommender 2
Recommender M
…
HyPER
![Page 19: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/19.jpg)
19
HyPER: High-Level Approach
• User-item ratings viewed as a weighted bipartite graph
• Build hybrid model by adding links to encode additional information– multiple user and item similarities, social
information,…
• Predict ratings by reasoning over the graph, via a graphical model
![Page 20: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/20.jpg)
20
HyPER: High-Level Approach
• User-item ratings viewed as a weighted bipartite graph
• Build hybrid model by adding links to encode additional information– multiple user and item similarities, social
information,…
• Predict ratings by reasoning over the graph, via a graphical model
![Page 21: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/21.jpg)
21
HyPER: High-Level Approach
• User-item ratings viewed as a weighted bipartite graph
• Build hybrid model by adding links to encode additional information– multiple user and item similarities, social
information,…
• Predict ratings by reasoning over the graph, via a graphical model
![Page 22: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/22.jpg)
22
Extended Recommendation Graph
![Page 23: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/23.jpg)
23
Extended Recommendation Graph
![Page 24: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/24.jpg)
24
Extended Recommendation Graph
![Page 25: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/25.jpg)
25
Extended Recommendation Graph
![Page 26: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/26.jpg)
26
Extended Recommendation Graph
![Page 27: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/27.jpg)
27
Modeling and Reasoning over the Graph
• Hinge-loss Markov random fields (HL-MRFs) [Bach et al., UAI 2013]
– Exact, efficient, and scalable inference– Continuous random variables– Models defined by PSL programs
• Probabilistic Soft Logic (PSL) [Bach et al., ArXiv 2015]
– Statistical relational learning system– Logical probabilistic programming interface – Templating language for HL-MRFs
![Page 28: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/28.jpg)
28
Modeling and Reasoning over the Graph
• Hinge-loss Markov random fields (HL-MRFs) [Bach et al., UAI 2013]
– Exact, efficient, and scalable inference– Continuous random variables– Models defined by PSL programs
• Probabilistic Soft Logic (PSL) [Bach et al., ArXiv 2015]
– Statistical relational learning system– Logical probabilistic programming interface – Templating language for HL-MRFs
![Page 29: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/29.jpg)
29
Hinge-loss Markov Random Fields
Conditional random field over continuous random variablesbetween 0 and 1
![Page 30: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/30.jpg)
30
Hinge-loss Markov Random Fields
Conditional random field over continuous random variablesbetween 0 and 1
Feature functions are hinge loss functions
![Page 31: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/31.jpg)
31
Hinge-loss Markov Random Fields
Feature functions are hinge loss functions
Conditional random field over continuous random variablesbetween 0 and 1
![Page 32: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/32.jpg)
32
Hinge-loss Markov Random Fields
Feature functions are hinge loss functions
Conditional random field over continuous random variablesbetween 0 and 1
Linear function
![Page 33: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/33.jpg)
33
Hinge-loss Markov Random Fields
Feature functions are hinge loss functions
Conditional random field over continuous random variablesbetween 0 and 1
Linear function
![Page 34: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/34.jpg)
34
Hinge-loss Markov Random Fields
Feature functions are hinge loss functions
Conditional random field over continuous random variablesbetween 0 and 1
Linear function
2
![Page 35: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/35.jpg)
35
Hinge-loss Markov Random Fields
Feature functions are hinge loss functions
Conditional random field over continuous random variablesbetween 0 and 1
Hinge losses encode the distance to satisfactionfor each instantiated rule
2
Linear function
![Page 36: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/36.jpg)
36
Efficient Inference in HL-MRFs
• Energy function is convex, can find a global MAP state
• The alternating direction method of multipliers (ADMM) is used for efficient and scalable inference
![Page 37: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/37.jpg)
37
Probabilistic Soft Logic
• Statistical relational learning language• Uses first-order logical rules • Τemplates HL-MRFs
logical operators
predicatesweight
w : LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
![Page 38: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/38.jpg)
38
Probabilistic Soft Logic
• Statistical relational learning language• Uses first-order logical rules• Τemplates HL-MRFs
predicatesweight
w : LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
![Page 39: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/39.jpg)
39
Probabilistic Soft Logic
• Statistical relational learning language• Uses first-order logical rules• Τemplates HL-MRFs
logical operators
predicatesweight
w : LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
![Page 40: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/40.jpg)
40
Probabilistic Soft Logic
• Statistical relational learning language• Uses first-order logical rules • Τemplates HL-MRFs
predicatesweight
w : LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
logical operators
![Page 41: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/41.jpg)
41
Probabilistic Soft Logic
• Converts rules to hinge-loss potentials
• PSL program = rules + data• Open source: http://psl.umiacs.umd.edu
hinge-loss
LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
![Page 42: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/42.jpg)
42
Probabilistic Soft Logic
• Converts rules to hinge-loss potentials
• PSL program = rules + data• Open source: http://psl.umiacs.umd.edu
hinge-loss
LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
max{LikesGenre(U, G) + IsGenre(M, G) - Rating(U, M) -1, 0}
![Page 43: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/43.jpg)
43
Probabilistic Soft Logic
• Converts rules to hinge-loss potentials
• PSL program = rules + data• Open source: http://psl.umiacs.umd.edu
hinge-loss
LikesGenre(U, G) && IsGenre(M, G) Rating(U, M)
max{LikesGenre(U, G) + IsGenre(M, G) - Rating(U, M) -1, 0}
![Page 44: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/44.jpg)
44
Recommendations with HyPER
• Similar items get similar ratings from a user– e.g. cosine, adjusted cosine, Pearson, content
SimilarItems(i1,i2)
Rating(u,i1) = 5
Rating(u,i1) = ?
SimilarItemssim(i1, i2) && Rating(u, i1) Rating(u, i2)
![Page 45: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/45.jpg)
45
Recommendations with HyPER• Similar users give similar ratings to an item– e.g. cosine, Pearson
SimilarUsers(u1,u2)
Rating(u1,i) = 4
Rating(u2,i) = ?
SimilarUserssim(u1, u2) && Rating(u1, i) Rating(u2, i)
![Page 46: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/46.jpg)
46
• Mean-centering priors
• Additional data sources
• Leveraging existing recommenders• e.g. matrix factorization, item-based
Recommendations with HyPER
AverageUserRating(u) Rating(u, i)AverageItemRating(i) Rating(u, i)
![Page 47: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/47.jpg)
47
• Mean-centering priors
• Social network links
• Leveraging existing recommenders• e.g. matrix factorization, item-based
Recommendations with HyPER
Friends(u1, u2) && Rating (u1, i) Rating(u2, i)
AverageUserRating(u) Rating(u, i)AverageItemRating(i) Rating(u, i)
![Page 48: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/48.jpg)
48
• Mean-centering priors
• Social network links
• Leveraging existing recommenders• e.g. matrix factorization, item-based
Recommendations with HyPER
RatingRecommender(u, i) Rating(u, i)
Friends(u1, u2) && Rating (u1, i) Rating(u2, i)
AverageUserRating(u) Rating(u, i)AverageItemRating(i) Rating(u, i)
![Page 49: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/49.jpg)
49
• Mean-centering priors
• Social network links
• Leveraging existing recommenders• e.g. matrix factorization, item-based
Recommendations with HyPER
Extensible to new data/algorithms – just add rules!
RatingRecommender(u, i) Rating(u, i)
Friends(u1, u2) && Rating (u1, i) Rating(u2, i)
AverageUserRating(u) Rating(u, i)AverageItemRating(i) Rating(u, i)
![Page 50: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/50.jpg)
50
Balancing the Rules
• Balancing done through weights wj
• Higher wj indicates a more important rule
• Weight learning by approximating a gradient step in the conditional log-likelihood:
![Page 51: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/51.jpg)
51
Experimental Validation
• Yelp academic dataset– ~34k users, ~3.6k items, ~99k ratings – ~81k friendships– 514 business categories
• Last.fm– ~1.8k users, ~17k items, ~92k ratings– ~12k friendships– ~9.7k artist tags
• Evaluation metrics: RMSE, MAEhttps://www.yelp.com/academic_datasethttp://grouplens.org/datasets/hetrec-2011/
![Page 52: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/52.jpg)
52
Baselines
• Collaborative filtering systems– Item-based cf. [Ning et al., In Recommender Systems Handbook, 2015]
– Matrix factorization (MF) cf. [Koren et al., IEEE Computer 42(8) 2009]
– Bayesian probabilistic matrix factorization (BPMF) [Salakhutdinov & Mnih., ICML 2008]
• Hybrid Systems– Naïve hybrid (averaged predictions)– BPMF with social relations and content (BPMF-SRIC)
[Liu et al., DSS 55(3) 2013]
![Page 53: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/53.jpg)
53
HyPER vs Baselines
• HyPER outperforms all other models in both datasets• Results statistically significant
![Page 54: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/54.jpg)
54
HyPER Submodels: Mean-centering
• HyPER combined model beats individual rules
![Page 55: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/55.jpg)
55
HyPER Submodels: User-based
• HyPER combined model beats/matches best individual rules• Similar story for item-based, content & social
![Page 56: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/56.jpg)
56
• HyPER can combine different recommenders effectively• Results statistically significant better
Combining the Baselines
![Page 57: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/57.jpg)
57
HyPER (All Rules)
• Combining all rules achieves the best performance in both datasets
![Page 58: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/58.jpg)
58
Scaling to Large Datasets
• Parallel implementation for inference and learning based on ADMM [Bach et al, UAI 2013]
• Scaling to big-data applications:– perform inference in parallel on densely
connected subgraphs of the original graph– fully distributed implementation of ADMM
![Page 59: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/59.jpg)
59
Conclusions
• HyPER is a general-purpose, extensible framework for hybrid recommender systems
• With HyPER, practitioners can define custom hybrid models for using all available data/algorithms, via logical rules in PSL
• HyPER outperforms existing techniques on two popular datasets
![Page 60: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/60.jpg)
60
Conclusions
• HyPER is a general-purpose, extensible framework for hybrid recommender systems
• With HyPER, practitioners can define custom hybrid models for using all available data/algorithms, via logical rules in PSL
• HyPER outperforms existing techniques on two popular datasets
Thank you for your attention!
![Page 61: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/61.jpg)
61
HyPER Submodels – Item-based, Content & Social
![Page 62: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/62.jpg)
62
ReferencesX. Ning, C. Desrosiers and G. Karypis. A comprehensive survey of neighborhood-based recommendation
methods. In Recommender Systems Handbook. 2nd edition, Springer, 2015S. Fakhraei, B. Huang, L. Raschid, and L. Getoor. Network-based drug-target interaction prediction with
probabilistic soft logic. Transactions on Computational Biology and Bioinformatics, 11(5), 2014.J. Liu, C. Wu, and W. Liu. Bayesian probabilistic matrix factorization with social relations and item contents for
recommendation. Decision Support Systems, 55(3), 2013.R. Salakhutdinov and A. Mnih. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In
ICML, 2008.Y. Koren, R. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. IEEE Computer,
42(8), 2009.A. Gunawardana and C. Meek. A unified approach to building hybrid recommender systems. In RecSys, 2009.R. Burke. Hybrid web recommender systems. In The Adaptive Web. Springer, 2007.L. de Campos, J. Fernandez-Luna, J. Huete, and M. Rueda-Morales. Combining content-based and collaborative
recommendations: A hybrid approach based on Bayesian networks. International Journal of Approximate Reasoning, 51(7), 2010.
M. Jahrer, A. Toscher, and R. Legenstein. Combining predictions for accurate recommender systems. In KDD, �2010.
![Page 63: HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e9f5503460f94ba0c24/html5/thumbnails/63.jpg)
63
ReferencesJ. Hoxha and A. Rettinger. First-order probabilistic model for hybrid recommendations. In ICMLA, 2013.S. H. Bach, B. Huang, B. London, and L. Getoor. Hinge-loss Markov random fields: Convex inference for structured
prediction. In UAI, 2013.S.H. Bach, M. Broecheler, B. Huang, and L. Getoor. Hinge-loss Markov random fields and probabilistic soft logic.
ArXiv:1505.04406 [cs.LG], 2015.A. P. Forbes and M. Zhu. Content-boosted matrix factorization for recommender systems: Experiments with recipe
recommendation. In RecSys, 2011.J. Chen, G. Chen, H. Zhang, J. Huang, and G. Zhao. Social recommendation based on multi-relational analysis. In WI-
IAT, 2012.R. Burke, F. Vahedian, and B. Mobasher. Hybrid recommendation in heterogeneous networks. In User Modeling,
Adaptation, and Personalization. Springer, 2014.J. Gemmell, T. S., B. Mobasher, and R. Burke. Resource recommendation in social annotation systems: A linear-
weighted hybrid approach. Journal of Computer and System Sciences, 78(4), 2012.X. Yu, X. Ren, Y. Sun, Q. Gu, B. Sturt, U. Khandelwal, B. Norick, and J. Han. Personalized entity recommendation: A
heterogeneous information network approach. In WSDM, 2014.H. Ma, D. Zhou, C. Liu, M. R. Lyu, and I. King. Recommender systems with social regularization. In WSDM, 2011.J. McAuley and J. Leskovec. Hidden factors and hidden topics: Understanding rating dimensions with review text. In
RecSys, 2013.G. Ling, M. R. Lyu, and I. King. Ratings meet reviews, a combined approach to recommend. In RecSys, 2014.I. Guy, N. Zwerdling, I. Ronen, D. Carmel, and E. Uziel. Social media recommendation based on people and tags. In
SIGIR, 2010.S. Sedhain, S. Sanner, D. Braziunas, L. Xie, and J. Christensen. Social collaborative ltering for cold-start
recommendations. In RecSys, 2014.