adaptive information systems: from adaptive hypermedia to the adaptive web

60
Adaptive Information Systems: From Adaptive Hypermedia to the Adaptive Web Peter Brusilovsky School of Information Sciences University of Pittsburgh, USA [email protected] http://www.sis.pitt.edu/~peterb

Upload: chiko

Post on 27-Jan-2016

51 views

Category:

Documents


1 download

DESCRIPTION

Adaptive Information Systems: From Adaptive Hypermedia to the Adaptive Web. Peter Brusilovsky School of Information Sciences University of Pittsburgh, USA [email protected] http://www.sis.pitt.edu/~peterb. Information Systems: One Size Fits All?. Number of users is increasing - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive Information Systems:From Adaptive Hypermedia to

the Adaptive WebPeter Brusilovsky

School of Information Sciences

University of Pittsburgh, [email protected]

http://www.sis.pitt.edu/~peterb

Page 2: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Information Systems: One Size Fits All?

• Number of users is increasing• Yet almost all of them offer the same content and the

same links to all– Stores– Museums– Courses– News sites

• Adaptive information systems offer an alternative. They attempt to treat differently users that are different from the system’s point view

Page 3: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

User Model

Collects informationabout individual user

Provides adaptation effect

AdaptiveSystem

User Modeling side

Adaptation side

Adaptive systems

Classic loop “user modeling - adaptation” in adaptive systems

Page 4: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

What can be taken into account?

• Knowledge about the content and the system

• Short-term and long-term goals

• Interests

• Navigation / action history

• User category, background, profession, language, capabilities

• Platform, bandwidth, context…

Page 5: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

What Can be Adapted?

• Intelligent Tutoring Systems– adaptive course sequencing– adaptive group formation…

• Adaptive GUI– menu adaptation– dialog form adaptation• …

• Adaptive Hypermedia Systems– adaptive presentation– adaptive navigation support

• Adaptive Help Systems• Adaptive . . .

Page 6: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Personalized Information Access 2000

• Adaptive IR systems (IR, from 1980)– Use word-level profile of interests and remedial feedback to adapt search

and result presentation

• Adaptive hypermedia (HT, ITS, from 1990)– Use explicit domain models and manual indexing to deliver a range of

adaptation effects to different aspects of user models

• Web recommenders (AI, ML, from 1995)– Use explicit and implicit interest indicators, apply clickstream

analysis/log mining to recommend best resources for detected use interests

– Content-based recommenders– Collaborative recommenders

Page 7: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Personalized Information Access 2000

AdaptiveHypermedia

AdaptiveIR

WebRecommenders

HCI / HT

AI / IR

• Concept-level domain models• Concept-level user model• Manual indexing at design time• Use many adaptation techniques• Adapt to many user factors• Expressive, reliable adaptation

• No domain model• Keyword-level user model• No manual indexing• Adapt to user interests• Use ranked list of links/docs

Page 8: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive Hypermedia

• How hypertext and hypermedia can become adaptive?

• Which adaptation technologies can be applied?

• How we can model the user in adaptive hypertext?

Page 9: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Do we need Adaptive Hypermedia?

Hypermedia systems are almost adaptive but ...Different people are differentIndividuals are different at different times"Lost in hyperspace”

We may need to make hypermedia adaptive where ..There us a large variety of usersSame user may need a different treatmentThe hyperspace is relatively large

Page 10: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

So, where we may need AH?

• Educational Hypermedia– Hypadapter, Anatom-Tutor, ISIS-Tutor, Manuel

Excell, ELM-ART, InterBook, AHA

• On-line Information systems– MetaDoc, KN-AHS, PUSH, HYPERFLEX

• On-line Help Systems– EPIAIM, HyPLAN, LISP-Critic, ORIMUHS

Page 11: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

What Can Be Adapted?

• Web-based systems = Pages + Links

• Adaptive presentation

– content adaptation

• Adaptive navigation support

– link adaptation

Page 12: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive

hypermedia

technologies

Adaptive

presentation

Adaptive

navigation support

Direct guidance

Adaptive link

sorting

Adaptive link

hiding

Adaptive link

annotation

Adaptive link

generation

Adaptive

multimedia

presentation

Adaptive text

presentation

Adaptation of

modality

Canned text

adaptation

Natural

language

adaptation

Inserting/

removing

fragments

Altering

fragments

Stretchtext

Sorting

fragments

Dimming

fragments

Map adaptation

Hiding

Disabling

Removal

Page 13: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive Presentation: Goals

• Provide the different content for users with different knowledge, goals, background

• Provide additional material for some categories of users– comparisons– extra explanations– details

• Remove irrelevant piece of content• Sort fragments - most relevant first

Page 14: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive presentation techniques

• Conditional text filtering– ITEM/IP

• Adaptive stretchtext– MetaDoc, KN-AHS

• Frame-based adaptation– Hypadapter, EPIAIM

• Natural language generation– PEBA-II, ILEX

Page 15: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Conditional text filtering

If switch is known and user_motivation is high

Fragment 2

Fragment K

Fragment 1

• Similar to UNIX cpp• Universal technology

– Altering fragments– Extra explanation– Extra details– Comparisons

• Low level technology– Text programming

Page 16: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive Stretchtext (PUSH)

Page 17: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive presentation: evaluation

• MetaDoc: On-line documentation system, adapting to user knowledge on the subject

• Reading comprehension time decreased

• Understanding increased for novices

• No effect for navigation time, number of nodes visited, number of operations

Page 18: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive navigation support: goals

• Guidance: Where I can go? – Local guidance (“next best”)– Global guidance (“ultimate goal”)

• Orientation: Where am I? – Local orientation support (local area)– Global orientation support (whole hyperspace)

Page 19: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive navigation support

• Direct guidance

• Hiding, restricting, disabling

• Generation

• Sorting

• Annotation

• Map adaptation

Page 20: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive annotation: Font color

Annotations for concept states in ISIS-Tutor: not ready (neutral); ready and new (red); seen (green); and learned (green+)

Page 21: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive hiding

Hiding links to concepts in ISIS-Tutor: not ready (neutral) links are removed. The rest of 64 links fits one screen.

Page 22: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive Link Annotation

Page 23: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive annotation and removing

Page 24: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive annotation in InterBook

1. State of concepts (unknown, known, ..., learned)

2. State of current section (ready, not ready, nothing new)

3. States of sections behind the links (as above + visited)

3

2

1

Page 25: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

QuizGuide: Dual Annotations

Page 26: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Annotations in CourseAgent

Page 27: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

User Modeling in Classic AH• Classic AH use external models

– Domain models, pedagogical modes, stereotype hierarchy, etc.

• Users are modeled in relation to these models– User is field-independent– User knowledge of loops is high– User is interested in 19th century architecture styles

• Resources are connected (indexed) with elements of these models (aka knowledge behind pages)– This section presents while loop and increment– This page is for field-independent learners– This church is built in 1876

Page 28: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Concept 1

Concept 2

Concept 3

Concept 4

Concept 5

Concept N

Domain Model

Page 29: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Indexing of NodesExternal (domain) model

Concept 1

Concept 2

Concept 3

Concept 4

Concept m

Concept n

Hyperspace

Page 30: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Indexing of Fragments

Fragment 1

Fragment 2

Fragment K

Concept 1

Concept 2

Concept 3

Concept 4

Concept 5

Concept N

NodeConcepts

Page 31: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Concept 1

Concept 2

Concept 3

Concept 4

Concept 5

Concept N103

0

27

4

Concept-Level User Model

Page 32: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Evaluation of Adaptive Link Sorting

• HYPERFLEX: IR System– adaptation to user search goal– adaptation to “personal cognitive map”

• Number of visited nodes decreased (significant)

• Correctness increased (not significant)

• Goal adaptation is more effective

• No significant difference for time/topic

Page 33: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Evaluation of Adaptive Link Annotation and Hiding

• ISIS-Tutor, an adaptive tutorial• The students are able to achieve the same

educational goal almost twice as faster• The number of node visits (navigation overhead)

decreased twice • The number of attempts per problem to be solved

decreased almost 4 times (from 7.7 to 1.4-1.8)

Page 34: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Summary: It works!

• Adaptive presentation makes user to understand the content faster and better

• Adaptive navigation support reduces navigation efforts and allows the users to get to the right place at the right time

• Altogether AH techniques can significantly improve the effectiveness of hypertext and hypermedia systems

Page 35: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Why Search Personalization?

• R. Larsen: With the growth of DL even a good query can return not just tens, but thousands of "relevant" documents1

• Personalization is an attempt to find most relevant documents using information about user's goals, knowledge, preferences, navigation history, etc.

1 Larsen, R.L. Relaxing Assumptions . . . Stretching the Vision: A Modest View of Some Technical Issues. D-Lib Magazine, 3, April (1997), available online at http://www.dlib.org/dlib/april97/04larsen.html

Page 36: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Modeling Users in Adaptive Search

• Most essential feature: user interests• Observing user document selectin, adaptive IR

systems build profile of user interests• Keyword-level modeling

– Uses a long list of keywords (terms) in place of domain model

– User interests are modeled as weigthed vector or terms

– More advanced systems use several profiles for different domains or timeframes

Page 37: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Keyword User Profiles

Page 38: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

How Search Could be Changed?• Let’s classify potential impact by stages

Before search During search After search

Page 39: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Pre-Process: Query Expansion

• User profile is applied to add terms to the query– Popular terms could be added to introduce context– Similar terms could be added to resolve indexer-

user mismatch– Related terms could be added to resolve ambiguity– Works with any IR model or search engine

Page 40: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Post-Processing

• The user profile is used to organize the results of the retrieval process – present to the user the most interesting documents– Filter out irrelevant documents

• Extended profile can be used effectively• In this case the use of the profile adds an extra step to

processing• Similar to classic information filtering problem• Typical way for adaptive Web IR

Page 41: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Post-Filter: Re-Ranking

• Re-ranking is a typical approach for post-filtering

• Each document is rated according to its relevance (similarity) to the user or group profile

• This rating is fused with the relevance rating returned by the search engine

• The results are ranked by fused rating– User model: WIFS, group model: I-Spy

Page 42: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

YourNews: Adaptive Search and Filtering with Open User Profile

Page 43: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Recommender Systems

• Started as extension of work on adaptive information filtering

• What is filtering? Search without explicit query• Started as SDI – user provided profiles• Later considered user feedback (yes/no or ratings) to

automatically improve profile• Modern IF can start without profile, constructing it by

observation and user feedback– Rating, bookmarking, downloading, purchasing

Page 44: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Example: Syskill and Webert

Page 45: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Amazon: Reviews and ratings

Page 46: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Types of Recommender Systems

• Classic content-based• Collaborative recommender systems (collaborative

filtering)– Started with proactive push and pull systems, but merged the

“filtering” movement

• Rule-based (purchasing printer)• Case-based• Demographic

Page 47: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Access Type vs. Engine

• Recommendation is a type of information access – proactive ranked suggestion based on user data and observing behavior

• Engine behind decides to what extent information is relevant (answers goals, interests, knowledge)

• Types of engines:– Classic content based (keywords, same as IR)– Medatada-based (still content!)– Collaborative– Hybrid

Page 48: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

A Look under the Hood

AdaptiveHypermedia

AdaptiveIR

WebRecommenders

Navigation Search Recommendation

Metadata-based mechanism

Keyword-based mechanism

Community-based mechanism

Types of information access

Adaptation Mechanisms

Page 49: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Personalized Information Access 2008

AdaptiveHypermedia

AdaptiveIR

WebRecommenders

Navigation Search Recommendation

Metadata-based mechanism

Keyword-based mechanism

Community-based mechanismAdaptation Mechanisms

Page 50: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Web Personalization 2000

AdaptiveHypermedia

AdaptiveIR/IF

WebRecommenders

• Explicit domain model• Concept-level user model• Manual indexing• Use “classic” AI • Use many adaptation techniques• Reliable adaptation• Adapt to many user factors

• No domain model• Keyword-level user model• No manual indexing• Adapt to user interests• Use ranked list of links/docs• Use “modern” AI

HCI / HT

AI / IR

Page 51: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Web Personalization 2010

AdaptiveHypermedia

AdaptiveIR/IF

WebRecommenders

• No Manual indexing• Use ML and log mining• Extensive use of BN• Adapt to many user factors• Use many adaptation techniques

• No manual indexing• Explicit or derived domain ontology• Concept-level user model• Adapt to more than just interests

Ontology-basedOpen Corpus

Page 52: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Personalized Information Access: Integrated Prospect

AdaptiveHypermedia

AdaptiveIR/IF

WebRecommenders

• With and without domain models• Keyword- and concept-based UM• Use of any AI techniques that fit

• Use many forms of information access• Use a range of adaptation techniques• Adapt to more than just interests

AdaptiveInfo Vis

Page 53: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Why integrated prospect?

• Use larger variety of user models• Use larger variety of user modeling techniques

– Even for the same kind of models

• Use larger variety of information access techniques and adaptation techniques– Especially for the same kind of models– About 90% of user information needs are not solved

by classic search-based access

Page 54: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

Adaptive Information Services

• Early prototypes: Basaar, FAB, ELFI

• Integrates content-based and collaborative technologies

• Integrates search and filtering

• Integrates user-driven and adaptive personalization

• Example: http://www.n24.de

Page 55: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web
Page 56: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

ASSIST-ACM

Re-ranking result-list based on search and browsing history information

Augmenting the links based on search and browsing history information

Page 57: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

The Need to Be Mobile

• Background– Technology: wearables, mobiles, handhelds…– GIS and GPS work– HCI: Ubiquitous Computing

• Need to adapt to the platform– Screen, computational power, bandwidth

• New opportunities– Taking into account location/time/other context– Sensors and affective computing

Page 58: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

New Application Areas

• Mobile handheld guides– Museum guides: HYPERAUDIO, HIPS– City guides: GUIDE

• Mobile recommenders– News and entertainment recommender

• http://www.adaptiveinfo.com

• Adaptive mobile information sites– ClixSmart Navigator

• http://www.changingworlds.com/

Page 59: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

3D Web

• Web is not 2D anymore - it includes a good amount of VR content

• 3D offers more power and supports some unique ways to access information

• 3D Web as the future of the Web?

• The dream of an immersive Web:– Neal Stephenson: Metaverse (Snow Crash)– Victor Lukyanenko: The Depth (Mirrors)

Page 60: Adaptive Information Systems: From Adaptive Hypermedia to  the Adaptive Web

What we will learn?

• Document and user modeling

• Major techniques for personalized information access

• Some special kinds of personalization– Mobile, 3D, collaborative work

• Personalization in special domain– E-commerce, cultural heritage, education