alex smola , how jing chao-yuan wu , amr ahmed , alex ...cywu/rrn2017_slides.pdfrecurrent...

32
Recurrent Recommender Networks Chao-Yuan Wu 1 , Amr Ahmed 2 , Alex Beutel 2 Alex Smola 3 , How Jing 4 2 1 3 4 1

Upload: others

Post on 12-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Recurrent Recommender NetworksChao-Yuan Wu1, Amr Ahmed2, Alex Beutel2

Alex Smola3, How Jing4

21 3 4

1

Page 2: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Traditional recommender systems

4

3 5 1

3

2

1 ?

2 5

Predict missing values

Observe interactions

2

Page 3: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Traditional recommender systemsassume stationary states

4

3 5 1

3

2

1 ?

2 5

f(vu, vm)u

mUser states

Movie states3

Page 4: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

However…, user & movie states should be time-dependent.

4

Page 5: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

User preference changes over time

5

?10 years ago

now

Page 6: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Movie reception changes over time

So bad that it’s great to watch

Bad movie6

Page 7: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Exogenous effects“La La Land” won big at Golden Globes

7

Page 8: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Seasonal effects

Only watch during Christmas

8

Page 9: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Traditional MF

Page 10: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Modeling temporal dynamics within each user and movieTraditional MF

10

Page 11: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Also…, we consider real prediction instead of interpolation.

11

Page 12: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Kid started using

Consider a user profile….

12

Page 13: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

?

Traditional random split

??

13

Page 14: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Real scenario

?? ??

14

Page 15: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Real scenario

?? ?

In this paper we design and evaluate our model with this real scenario.

?

15

Page 16: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Recurrent Recommender Networks

User RNN

Movie RNN

user

movie16

Page 17: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

User Recurrent Neural Network (User RNN)

17

Page 18: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

User Recurrent Neural Network (User RNN)

18

Rating

Page 19: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Movie RNN

19

Rating

Page 20: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Recurrent Recommender Networksuser

movie 20

Page 21: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Experiments

21

Page 22: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Rating prediction accuracy

PMF: Salakhutdinov & Mnih NIPS ‘07T-STD: Koren KDD ‘09U-AR & I-AR: Sedhain et al. WWW ‘15

(RMSE)

22

Page 23: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

How does the model react to the temporal effects?

23

Page 24: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

24

?

Page 25: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Automatically captures exogenous effects

Oscar & Golden globe

25

Page 26: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Automatically captures system-wise effects

Netflix changed the Likert scale

26

Page 27: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Automatically models effects that used to be captured by hand-crafted features

Movie age effects

27

Page 28: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

Large improvement when movies have large fluctuations

28

Improvement

Fluctuation

Page 29: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

SummaryNovel model

Page 30: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

SummaryNovel model Future prediction

? ? ??

Page 31: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

SummaryNovel model Future prediction

Accurate prediction

? ? ??

Page 32: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3

32

SummaryNovel model Future prediction

Accurate prediction Temporal dynamics

? ? ??