rise presentation for programme meeting 2011 07-05

Recommendations Improve the Search Experience Final Programme meeting05 July 2011

Richard Nurse

http://www.open.ac.uk/blogs/rise

http://www.flickr.com/photos/jm3/2779185414/sizes/m/in/photostream/



“That recommender systems can enhance the student

experience in new generation e-resource discovery services”

Hypothesis


Recommender database

So what about collecting more data?

http://www.open.ac.uk/blogs/rise http://library.open.ac.uk/rise


http://library.open.ac.uk/rise

People on course ‘A’ viewed resource ‘B’

People who looked at resource ‘C’ also looked at resource ‘D’

People who searched for subject ‘E’ looked at resource ‘F’

What can the data tell us?


Course recommendation

Search recommendation

Relationship recommendation


So how do you get a recommendation?


User A Course A123

Resource BRV=14

Views

User C Course A123

Resource BRV=15

Recommended +1 Resource BRV=16

Views +1

User C Course A123

Resource BRV=17

Rate Useful +1

User C Course A123

Resource BRV=14

Rate Not Useful -2

Resource BRV=15

Views +1


Added a privacy policy to RISE, EDS and SFX interfaces

Provided an opt-out feature


Privacy and opt-out URL

http://library.open.ac.uk/rise/?page=privacy

Data Protection and privacy





Face to Face evaluation

http://www.flickr.com/photos/ryanhealy/3729881896/sizes/m/in/photostream/

UndergraduatesLike ratings and reviews from other

students

‘other people’s experiences valuable’

Which module studied?

How high a mark?

Postgraduates

Citation as a recommendation

Wary of provenance

Feed to module website

Want synonyms

Trust repository



Survey results 1

Not useful17%

Quite useful17%

Very useful30%Not used

4%

Not sure9%

Not applicable22%

These resources may be related to others you've viewed recently



Survey results 2

Not useful22%

Slightly useful9%

Quite useful9%Very useful

17%Not used9%

Not applicable35%

People on your course(s) viewed



Survey results 3

Not useful17%

Quite useful13%

Very useful30%

Not used17%

Not applicable22%

People using similar search terms often viewed



Survey results 4

Not relevant35%

Slightly relevant

13%

Quite relevant30%

Very relevant17%

Not used4%

How relevant where the recommendations?



Should we have a recommender system?

“I think it would be a very good useful feature. It would be definitely very very useful” postgraduate Maths student

“So it would be interesting to see what other people are looking at. Yes, I would definitely use that because my limited knowledge of the library might mean that other people were using slightly different ways of searching and getting different results.” undergraduate English Literature student

I have just had a go, it was good with suggested papers that I had already found (which shows potential in my view) through Google.

http://www.flickr.com/photos/earlg/337743409/sizes/m/in/photostream/



Recommendations usage

1 2 3 40

200

400

600

800

1000

1200

1400

1600

1800

2000

Relationship

Course

Search

http://www.flickr.com/photos/smin/613285324/sizes/m/in/photostream/


•EZProxy data

•Use other data sources

•Search terms

•Need more data!

•Users like recommendations ‘in principle’

•Recommendations provenance

•Interest in the search tools

•Quality of recommendations isn’t high

•Limited use of it so far


Interim findings


Recommendations Improve the Search Experience Final Programme meeting05 July 2011

Richard Nurse


http://www.flickr.com/photos/jm3/2779185414/sizes/m/in/photostream/


rise presentation for programme meeting 2011 07-05

Technology

survey results

user acourse a123 resource

viewsresource brv

different results

rate useful

richard nursehttp

good useful feature

recommendations usagehttp