rank all the (geo) things!

31
Rank all the (geo) things! @jsuchal @SynopsiTV

Upload: jano-suchal

Post on 18-Jun-2015

202 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Rank all the (geo) things!

Rank all the (geo) things!@jsuchal@SynopsiTV

Page 2: Rank all the (geo) things!

Blogs, newsletters

How do you learn things?

Courses, training

Conferences Work

Page 3: Rank all the (geo) things!

Research papers?

Page 4: Rank all the (geo) things!

WHY NOT?

Page 5: Rank all the (geo) things!

WHY NOT?

“It’s not useful for the real-world.”

“I wouldn’t understand any of

that.”

Page 6: Rank all the (geo) things!

About me

PhD dropout FIIT STU Bratislava

foaf.sk, otvorenezmluvy.sk, govdata.sk

sme.sk news recommender

developer @ SynopsiTV

Page 7: Rank all the (geo) things!

My workflow

Page 8: Rank all the (geo) things!

My workflow

MAGIC!M

AG

IC!

MA

GIC

!

Page 9: Rank all the (geo) things!

Search vs. recommender engine

Search engine

input: queryoutput: list of results

Recommendation engine

input: movieoutput: list of similar movies

Page 10: Rank all the (geo) things!

Academic Mode

Page 11: Rank all the (geo) things!

Accurately interpreting clickthrough data as implicit feedback

Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in Information retrieval, SIGIR ’05, pages 154–161, New York, NY, USA, 2005. ACM.

Significant on two-tailed tests at a 95% confidence level !!!

Page 12: Rank all the (geo) things!

Learning to Rank for Spatiotemporal Search

Blake Shaw, Jon Shea, Siddhartha Sinha, and Andrew Hogue. 2013. Learning to rank for spatiotemporal search. In Proceedings of the sixth ACM international conference on Web search and data mining (WSDM '13). ACM, New York, NY, USA, 717-726.

Page 13: Rank all the (geo) things!

Learning to Rank for Spatiotemporal Search

Page 14: Rank all the (geo) things!

Learning to Rank for Spatiotemporal Search

Page 15: Rank all the (geo) things!

Learning to Rank for Spatiotemporal Search

Page 16: Rank all the (geo) things!

Learning to Rank for Spatiotemporal Search

Page 17: Rank all the (geo) things!

Learning to Rank for Spatiotemporal Search

Page 18: Rank all the (geo) things!

Accurately interpreting clickthrough data as implicit feedback

Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in Information retrieval, SIGIR ’05, pages 154–161, New York, NY, USA, 2005. ACM.

Page 19: Rank all the (geo) things!

Accurately interpreting clickthrough data as implicit feedback

Page 20: Rank all the (geo) things!

Evaluation Metrics

● Mean Average Precision @ N○ probability of target result being in top N items

● Mean Reciprocal Rank○ 1 / rank of target result

● Normalized Discounted Cumulative Gain● Expected Reciprocal Rank

Page 21: Rank all the (geo) things!

Optimizing search engines using clickthrough data

Thorsten Joachims. Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD ’02, pages 133–142, New York, NY, USA, 2002. ACM.

Page 22: Rank all the (geo) things!

Optimizing search engines using clickthrough data

Page 23: Rank all the (geo) things!

Query chains: learning to rank from implicit feedback

Filip Radlinski and Thorsten Joachims. Query chains: learning to rank from implicit feedback. In KDD ’05: Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, pages 239–248, New York, NY, USA, 2005. ACM.

Page 24: Rank all the (geo) things!

On Caption Bias in Interleaving Experiments

Katja Hofmann, Fritz Behr, and Filip Radlinski: On Caption Bias in Interleaving Experiments In Proceedings of the ACM Conference on Information and Knowledge Management (CIKM) 2012

Page 25: Rank all the (geo) things!

On Caption Bias in Interleaving Experiments

Page 26: Rank all the (geo) things!

Fighting Search Engine Amnesia: Reranking Repeated Results

Milad Shokouhi, Ryen W. White, Paul Bennett, and Filip Radlinski. Fighting search engine amnesia: reranking repeated results. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, SIGIR ’13, pages 273–282, New York, NY, USA, 2013. ACM.

In this paper, we observed that the same results are often shown to users multiple times during search sessions. We showed that there are a number of effects at play, which can be leveraged to improve information retrieval performance. In particular, previously skipped results are much less likely to be clicked, and previously clicked results may or may not be re-clicked depending on other factors of the session.

Page 27: Rank all the (geo) things!

Challenges

Page 28: Rank all the (geo) things!

Diversification

Page 29: Rank all the (geo) things!

Group recommendations

Page 30: Rank all the (geo) things!

Context-aware recommendations

Time of day

DeviceMood

Season

Location

Page 31: Rank all the (geo) things!

Seriousrecommenders and search?Get in touch!

@synopsitv @jsuchal