relevance feedback for the modern searcher: elicitation techniques revisited
DESCRIPTION
Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited. Diane Kelly School of Information and Library Science University of North Carolina at Chapel Hill, USA. Once upon a time …. Explicit-O- Saurus. User-Model-O- Saurus. Implicit-O- Saurus. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/1.jpg)
Relevance Feedback for the Modern Searcher: Elicitation Techniques RevisitedDiane KellySchool of Information and Library ScienceUniversity of North Carolina at Chapel Hill, USA
![Page 2: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/2.jpg)
Once upon a time …
Explicit-O-Saurus
![Page 3: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/3.jpg)
User-Model-O-Saurus
![Page 4: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/4.jpg)
Implicit-O-Saurus
![Page 5: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/5.jpg)
The Story of Explicit-O-Saurus • Review (some) past and present use of explicit feedback
techniques• Relevance feedback (short-term) (document and term)• User modeling (long-term)
• Present typical explanations for why these techniques are not used by searchers
• Argue that these explanations are no longer adequate
![Page 6: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/6.jpg)
Schultz, C. K. (1968). H.P. Luhn: Pioneer of Information Science (p.32). London, UK: American Documentation Institute.
1950s: Luhn’s Selective Dissemination of Information
![Page 7: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/7.jpg)
1960s: Salton, Rocchio, and Ide
Ide, E. (1967). User interaction with an automated information retrieval system. In G. Salton (Ed.) Information Storage and Retrieval: Scientific Report No. ISR-12.
![Page 8: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/8.jpg)
Oddy, R. N. (1977). Information retrieval through man-machine dialogue. Journal of Documentation, 33(1), 1-14.
1970s: Oddy’s Thomas
![Page 9: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/9.jpg)
1980s: User Modeling
Allen, R. B. (1990). User models: Theory, method, and practice. International Journal of Man-Machine Studies, 32, 511-543.
Rich, E. (1983). Users are individuals: Individualizing user models. International Journal of Human-Computer Studies, 51, 323-338.
“While the term ‘user model’ emphasizes the information about the person, it is obvious that a great deal of situational, task, or environmental information may be encoded in the model.”
![Page 10: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/10.jpg)
Croft, W. B., & Thompson, R. H. (1987). I3R: A new approach to the design of document retrieval systems. Journal of the American Society for Information Science, 38, 389-404.
1980s: Intelligent IR
![Page 11: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/11.jpg)
Maes, P. (1994). Agents that reduce work and information overload. CACM, 37(7), 30-40.
1990s: Agents
![Page 12: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/12.jpg)
SYSTEM
USER
![Page 13: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/13.jpg)
CAT-A-CONE: AN INTERACTIVEHearst, M. A. & Karadi, C. (1997). Cat-a-Cone: An Interactive Interface for Specifying Searches and Viewing Retrieval Results using a Large Category Hierarchy. Proc. of SIGIR ‘97.
1990S: And Some Visualization
![Page 14: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/14.jpg)
Belkin, N. J., Cool, C., Kelly, D., Lin, S.-J., Park, S.Y., Perez-Carballo, J., & Sikora, C. (2001). Iterative exploration, design and evaluation of support for query reformulation in interactive information retrieval. Information Processing & Management 37(3), 404-434.
1990s: And more relevance feedback
![Page 15: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/15.jpg)
2000s: Implicit Feedback
Click-through Dwell time Scrolling Queries
But explicit feedback is not really dead …
![Page 16: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/16.jpg)
Date Viewed Online: October 12, 2010
![Page 17: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/17.jpg)
http://www.movielens.org/rateMore and http://www.grouplens.org/
Dates Viewed Online: October 12 and December 06, 2010
![Page 18: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/18.jpg)
Date Viewed Online: November 11, 2010
![Page 19: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/19.jpg)
Date Viewed Online: November 11, 2010
![Page 20: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/20.jpg)
Date Viewed Online: November 11, 2010
![Page 21: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/21.jpg)
Date Viewed Online: December 06, 2010
![Page 22: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/22.jpg)
http://hunch.com/
Date Viewed Online: October 12, 2010
![Page 23: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/23.jpg)
What Caused the Supposed Demise of Explicit Feedback?
1. Users are unwilling to put forth the effort required to provide feedback
2. Users don’t have the additional cognitive resources to engage in explicit feedback
![Page 24: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/24.jpg)
REASON 1: Users are unwilling to put forth the effort required to provide feedback.
http://www.pewinternet.org/http://www.visualeconomics.com/how-the-world-spends-its-time-online_2010-06-16/
REALLY?
![Page 25: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/25.jpg)
REASON 2: Users don’t have the additional cognitive resources to engage in explicit feedback.
• Well, maybe back then …
![Page 26: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/26.jpg)
• Better questions
• Better measures
A Future for Explicit Feedback
“While the term ‘user model’ emphasizes the information about the person, it is obvious that a great deal of situational, task, or environmental information may be encoded in the model.” (Allen, 1990)
• More creative
• More engaging
• More adaptive
Focused on information-seeking support not information search support.
![Page 27: Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b66550346895dc957fa/html5/thumbnails/27.jpg)
A Future for Explicit Feedback