nrs2013 recap
DESCRIPTION
TRANSCRIPT
Challenge Recap
ACM RecSys 2013, Hong Kong
Torben Brodtplista GmbH
International News RecommenderSystems Workshop and Challenge
October 13th, 2013
Dates
planned● 6 month development● 1 month offline dataset (2013/07)● 3 weeks online evaluation (2013/08)
Dates
actual● 6 month development● 1 month offline dataset (2013/07)● 3 weeks “online evaluation” (2013/08)
○ Registration Problems○ Missing Leaderboard
● 3 weeks ranking period (2013/09)
Number Quiz
How many registrations?
Number Quiz
How many registrations?
23
Number Quiz
How many active teams?
Number Quiz
How many active teams?
11
Participants from
recs
API
real user
researcher
workshops and talks● SIGIR, RecSysteams from● TU Berlin● HPI Potsdam● CWI Amsterdam● NTNU Norway● NTU Singapore● CVUT Prag● UCSB California● Ben Gurion, Israel● etc
Number Quiz
How many active recommenders?
Number Quiz
How many active recommenders?
31
Number Quiz
How many recommendations being delivered?
Number Quiz
How many recommendations being delivered?
571,744,114
Number Quiz
How many clicks being delivered?
Number Quiz
How many clicks being delivered?
764,181
Next steps
● dataset license○ original one: free for use in correlation with challenge○ new one: tba
● reproducability○ reference algorithms?
● questionlist / FAQ
Winners
1. recommenders.netwinner of an ipad
2. inbeatwinner of a nexus 7
3. i2rwinner of a raspberry pi
Questions