![Page 2: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/2.jpg)
Overview • Matrix Factoriza<on Model • asymmetric MF
• Objec<ve: op<mize various Ranking Metrics • exploit proper<es of MF model & implicit data
• Training: pointwise & listwise • Related Work • Experiments
![Page 3: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/3.jpg)
Basic Idea:
data .
items i
users u
≈ users u
Low-‐rank Matrix Factoriza<on Model
![Page 4: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/4.jpg)
Basic Idea:
-‐ latent user vector: -‐ by [Paterek 07], extended to SVD++ [Koren 08]
Asymmetric Matrix Factoriza<on
![Page 5: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/5.jpg)
Overview • Matrix Factoriza<on Model • asymmetric MF
• Objec5ve: op5mize various Ranking Metrics • exploit proper5es of MF model & implicit data
• Training: pointwise & listwise • Related Work • Experiments
![Page 6: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/6.jpg)
AMF as Neural Network
rank loss = f (ranks)
items i … click history
… user vec.
… scores … ranks
![Page 7: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/7.jpg)
AMF as Neural Network
rank loss = f (ranks)
items i … click history
… user vec.
… scores … ranks
![Page 8: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/8.jpg)
1st term: Rank Loss example 1: AUC • pairwise comparisons ! (linear) sum of ranks
![Page 9: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/9.jpg)
example 2: nDCG (for binary relevance) • emphasizes top of ranked list • also a func<on of the ranks of the posi<ves
1st term: Rank Loss
![Page 10: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/10.jpg)
2nd term: Ac<va<on Func<on
T
Scores ! Ranks: + + + -‐ binary data: nega<ves and posi<ves -‐ sparse data: many few ! MF scores: Gaussian distrib. assumed
scores i
![Page 11: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/11.jpg)
score
rank
1
N
Scores ! Ranks:
2nd term: Ac<va<on Func<on
score
![Page 12: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/12.jpg)
score
… piecewise quadra<c
2nd term: Ac<va<on Func<on
![Page 13: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/13.jpg)
3rd term • score:
• deriva<ve:
![Page 14: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/14.jpg)
Pueng it All Together
training objec<ve func<on: rank prior on param’s scores of loss " lambda nega<ves "gamma -‐ minimized by stochas<c gradient descent
![Page 15: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/15.jpg)
Overview • Matrix Factoriza<on Model • asymmetric MF
• Objec<ve: op<mize various Ranking Metrics • exploit proper<es of MF model & data
• Training: pointwise & listwise • Related Work • Experiments
![Page 16: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/16.jpg)
Listwise Approach
• consider ALL items for each user:
-‐ es<mate standard devia<on of scores for each user ! width of ac<va<on func<on
![Page 17: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/17.jpg)
Listwise Approach
• consider ALL items for each user: -‐ sort by scores ! exact ranks -‐ using logis<c ac<va<on func<on: 2nd term in chain rule
![Page 18: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/18.jpg)
AUC
nDCG
Listwise Approach
deriva5ves L’: 1st & 2nd terms top of ranked list
![Page 19: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/19.jpg)
! between nDCG and AUC: L’ = constant ! use very large std. for ac<va<on func<on in pointwise approach
AUC
nDCG
Pointwise Approach
deriva5ves L’: top of ranked list
![Page 20: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/20.jpg)
Overview • Matrix Factoriza<on Model • asymmetric MF
• Objec<ve: op<mize various Ranking Metrics • exploit proper<es of MF model & data
• Training • Related Work • Experiments
![Page 21: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/21.jpg)
Related Work
• various learning-‐to-‐rank approaches exist • ogen tailored to specific ranking losses • mostly pairwise approaches, eg: • AUC: BPR [Rendle et al. ’09] • MRR: CLiMF [Shi et al. ’12] used as • MAP: TFMAP [Shi et al. ‘12] baselines
• listwise approaches, eg: • top-‐1 [Shi et al. ’10] ... like neural network
• … addi<onal references in the paper
![Page 22: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/22.jpg)
Overview • Matrix Factoriza<on Model • basic MF ! asymmetric MF ! Neural Network
• Objec<ve: op<mize various Ranking Metrics • exploit proper<es of MF model & data
• Training • Related Work • Experiments
![Page 23: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/23.jpg)
10 m MovieLens Data
• 10k movies & 70k users • 1% dense data • binarized: 3+ star ra<ng ! 1, otherwise 0 • 5-‐fold cross-‐valida<on
![Page 24: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/24.jpg)
10 m MovieLens Data
5-‐fold cross-‐valida<on std : 0.001
![Page 25: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/25.jpg)
10 m MovieLens Data
std=0.002
![Page 26: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/26.jpg)
Nellix Play Data • Test day: 4/9/2014 • rela(ve improvement to RMSE training
std=1%
![Page 27: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/27.jpg)
Nellix Play Data
std=2%
![Page 28: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/28.jpg)
Conclusions • learning-‐to-‐rank approach: – implicit feedback data – proper<es of MF model ! Gaussian distribu<on of scores ! non-‐linear ac<va<on func<ons derived for ranking
• pointwise and listwise training • various ranking metrics can be used: – compe<<ve for op<mizing AUC – par<cularly effec<ve at head of ranked list
![Page 29: Gaussian Ranking by Matrix Factorization, ACM RecSys Conference 2015](https://reader031.vdocument.in/reader031/viewer/2022021502/58f1184f1a28ab2b1e8b45d1/html5/thumbnails/29.jpg)
Thank You ! Ques5ons ?