the web changes everything

35
THE WEB CHANGES EVERYTHING Jaime Teevan, Microsoft Research, @jteevan

Upload: ursula

Post on 22-Feb-2016

36 views

Category:

Documents


0 download

DESCRIPTION

The Web Changes Everything. Jaime Teevan, Microsoft Research, @ jteevan. The Web Changes Everything. Content Changes. JanuaryFebruaryMarch April May JuneJuly August September. Today’s tools focus on the present. But there’s so much more information available!. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: The Web Changes Everything

THE WEBCHANGES EVERYTHINGJaime Teevan, Microsoft Research, @jteevan

Page 2: The Web Changes Everything
Page 3: The Web Changes Everything

The Web Changes Everything

Content Changes

January February March April May June July August September

Page 4: The Web Changes Everything

The Web Changes Everything

January February March April May June July August September

Content Changes

People Revisit

January February March April May June July August September

Today’s tools focus on the presentBut there’s so much more information available!

Page 5: The Web Changes Everything

The Web Changes Everything

January February March April May June July August September

Content Changes

Large scale Web crawl over time Revisited pages

55,000 pages crawled hourly for 18+ months Judged pages (relevance to a query)

6 million pages crawled every two days for 6 months

Page 6: The Web Changes Everything

Measuring Web Page Change Summary metrics

Number of changes

Time between changes

Amount of change

Top level pages change by more and faster than pages

with long URLS..edu and .gov pages do not change by very much or

very oftenNews pages change quickly, but not as drastically as

other types of pages

Page 7: The Web Changes Everything

Measuring Web Page Change Summary metrics

Number of changes

Time between changes

Amount of change Change curves

Fixed starting point

Measure similarity over different time intervals

Series1

00.20.40.60.8

1

Dice

Sim

ilarit

y

Time from starting point

Knot point

Page 8: The Web Changes Everything

Measuring Within-Page Change DOM structure

changes Term use changes

Divergence from norm cookbooks frightfully merrymaking ingredient latkes

Staying power in page

TimeSep. Oct. Nov. Dec.

Page 9: The Web Changes Everything

Accounting for Web Dynamics Avoid problems caused by change

Caching, archiving, crawling Use change to our advantage

Ranking Match term’s staying power to query intent

Snippet generationTom Bosley - Wikipedia, the free encyclopediaThomas Edward "Tom" Bosley (October 1, 1927 October 19, 2010) was an American actor, best known for portraying Howard Cunningham on the long-running ABC sitcom Happy Days. Bosley was born in Chicago, the son of Dora and Benjamin Bosley.en.wikipedia.org/wiki/tom_bosley

Tom Bosley - Wikipedia, the free encyclopediaBosley died at 4:00 a.m. of heart failure on October 19, 2010, at a hospital near his home in Palm Springs, California. … His agent, Sheryl Abrams, said Bosley had been battling lung cancer.en.wikipedia.org/wiki/tom_bosley

Page 10: The Web Changes Everything

Revisitation on the Web

January February March April May June July August September

Content Changes

People Revisit

January February March April May June July August September

What’s the last Web page you visited?

Revisitation patterns Log analysis

Browser logs for revisitation

Query logs for re-finding User survey for intent

Page 11: The Web Changes Everything

Measuring Revisitation Summary metrics

Unique visitors Visits/user Time between

visits Revisitation curves

Revisit interval histogram

Normalized

Series1

00.20.40.60.8

1

Coun

t

Time Interval

Page 12: The Web Changes Everything

Four Revisitation Patterns Fast

Hub-and-spoke Navigation within site

Hybrid High quality fast pages

Medium Popular homepages Mail and Web applications

Slow Entry pages, bank pages Accessed via search

engine

Page 13: The Web Changes Everything

Search and Revisitation Repeat query

(33%) microsoft

research Repeat click

(39%) research.microsof

t.com Query msr

Lots of repeats (43%) Many navigational

Repeat Click

New Click

Repeat Query

33% 29% 4%

New Query 67% 10% 57%

39% 61%

Page 14: The Web Changes Everything

7th

Page 15: The Web Changes Everything

How Revisitation and Change Relate

January February March April May June July August September

Content Changes

People Revisit

January February March April May June July August September

Why did you revisit the last Web page you did?

Page 16: The Web Changes Everything

Possible Relationships Interested in change

Monitor Effect change

Transact Change unimportant

Find Change can

interfere Re-find

Page 17: The Web Changes Everything

Understanding the Relationship Compare summary metrics Revisits: Unique visitors, visits/user,

interval Change: Number, interval, similarity

2 visits/user3 visits/user4 visits/user5 or 6 visits/user7+ visits/user

Number of changes

Time between changes

Similarity

2 visits/user 172.91 133.26 0.823 visits/user 200.51 119.24 0.824 visits/user 234.32 109.59 0.815 or 6 visits/user 269.63 94.54 0.82

7+ visits/user 341.43 81.80 0.81

Page 18: The Web Changes Everything

Comparing Change and Revisit Curves

Three pages New York Times Woot.com Costco

Similar change patterns

Different revisitation NYT: Fast (news,

forums) Woot: Medium Costco: Slow (retail)

Page 19: The Web Changes Everything

Series1

00.20.40.60.8

11.2

NYT WootCostco

Comparing Change and Revisit Curves

Three pages New York Times Woot.com Costco

Similar change patterns

Different revisitation NYT: Fast (news,

forums) Woot: Medium Costco: Slow (retail)

Series1

00.20.40.60.8

11.2

NYT WootCostco

Series1

00.20.40.60.8

11.2

NYT WootCostco

Series1

-0.2

0.2

0.6

1

NYT WootCostco

Time

Page 20: The Web Changes Everything

Within-Page Relationship Page elements

change at different rates

Pages revisited at different rates Resonance can

serve as a filter for interesting content

Page 21: The Web Changes Everything
Page 22: The Web Changes Everything
Page 23: The Web Changes Everything
Page 24: The Web Changes Everything

Exposing Change

Diff-IE toolba

r

Changes to page since

your last visit

Page 25: The Web Changes Everything

Interesting Features

Always on

In-situ

New to you

Non-intrusive

Page 26: The Web Changes Everything

Studying Diff-IE

January February March April May June July August September

Content Changes

People Revisit

January February March April May June July August September

SURVEYHow often do pages change?o o o o oHow often do you revisit?o o o o o

InstallDiff-IE

SURVEYHow often do pages change?o o o o oHow often do you revisit?o o o o o

Page 27: The Web Changes Everything

Seeing Change Changes Web Use Changes to perception

Diff-IE users become more likely to notice change

Provide better estimates of how often content changes

Changes to behavior Diff-IE users start to revisit more Revisited pages more likely to have

changed Changes viewed are bigger changes

Content gains value when history is exposed

14%

51%

53%

Page 28: The Web Changes Everything

Change Can Cause Problems

Dynamic menus Put commonly used items at top Slows menu item access

Search result change Results change regularly Inhibits re-finding

Fewer repeat clicks Slower time to click

Page 29: The Web Changes Everything

Change During a Single Query

Results even change as you interact with them

Page 30: The Web Changes Everything

Change During a Single Query Results even change as you interact with

them Many reasons for change

Intentional to improve ranking General instability

Analyze behavior when people return after clicking

Page 31: The Web Changes Everything

Understanding When Change Hurts Metrics

Abandonment Satisfaction Click position Time to click

Mixed impact Results change

Above: 4.5% increase

Results change Below: 1.9% decrease

Abandonment

Above Below

Static 36.6% 43.1%Change 41.4% 42.3%

Page 32: The Web Changes Everything

Use Experience to Bias Presentation

Page 33: The Web Changes Everything

Change Blind Search Experience

Page 34: The Web Changes Everything

The Web Changes Everything

January February March April May June July August September

Content Changes

People Revisit

January February March April May June July August September

Web content changes provide valuable insight

People revisit and re-find Web content Explicit support for Web

dynamics can impact how people use and understand the Web

Relating revisitation and change enables us to

Identify pages for which change is important

Identify interesting components within a page

Page 35: The Web Changes Everything

Thank you.Web Content Change Adar, Teevan, Dumais & Elsas. The Web changes everything: Understanding the dynamics of Web content. WSDM 2009.Kulkarni, Teevan, Svore & Dumais. Understanding temporal query dynamics. WSDM 2011.Svore, Teevan, Dumais & Kulkarni. Creating temporally dynamic Web search snippets. SIGIR 2012.Web Page Revisitation Teevan, Adar, Jones & Potts. Information re-retrieval: Repeat queries in Yahoo’s logs. SIGIR 2007.Adar, Teevan & Dumais. Large scale analysis of Web revisitation patterns. CHI 2008.Tyler & Teevan. Large scale query log analysis of re-finding. WSDM 2010.Teevan, Liebling & Ravichandran. Understanding and predicting personal navigation. WSDM 2011.Relating Change and RevisitationAdar, Teevan & Dumais. Resonance on the Web: Web dynamics and revisitation patterns. CHI 2009.Teevan, Dumais, Liebling & Hughes. Changing how people view changes on the Web. UIST 2009.Teevan, Dumais & Liebling. A longitudinal study of how highlighting Web content change affects people’s web interactions. CHI 2010.Lee, Teevan & de la Chica. Characterizing multi-click behavior and the risks and opportunities of changing results during use. SIGIR 2014.

Jaime Teevan @jteevan