DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
1
DO NOT DISTRIBUTE
Collaborative Filtering and Net PerceptionsNovember 15, 2000
The Darden School
Sam Tutterow JD/MBA ‘99
The Darden School
Agenda
How CF works
Where it works (and doesn’t)
Some results
The privacy issue
A quick history of Net Perceptions
Getting a job in high tech marketing
Q&A throughout
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
2
DO NOT DISTRIBUTE
The Darden School
How collaborative filtering works
How it works
Mathematically
Philosophically (marketing)
The Darden School
The ratings databaseP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
3
DO NOT DISTRIBUTE
The Darden School
A customer comes to the web siteP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
The Darden School
Then we find their “soul mates” in real-timeP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
4
DO NOT DISTRIBUTE
The Darden School
The soul mates determine the best offerP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
The Darden School
How collaborative filtering works
How it works
Mathematically
Philosophically (marketing)
Key characteristics of CF
Focus is on individuals, not on segments
Learns individual preferences in real-time
An adaptive system that gets smarter with every use
Viewed as a customer benefit, not an ad
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
5
DO NOT DISTRIBUTE
The Darden School
Business problems CF helps solve
Customer objectives
• Getting the first purchase
• Increasing average transaction sizes
• Getting more profit out of the customer base
Product objectives
• Moving overstock inventory
• Promoting high margin items
• Launching new items effectively
The Darden School
Where it works - on the web site
Seven key applications
1. Home page
2. Product detail page
3. Shopping cart cross-sells
4. Check-out page
5. Recommendation center
6. Product category sorting
7. Search results sorting
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
6
DO NOT DISTRIBUTE
The Darden School
The Darden School
Where it works - on the web site
Seven key applications of NPEC
• Home page
• Product detail page
• Shopping cart cross-sells
• Check-out page
• Recommendation center
• Product category sorting
• Search results sorting
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
7
DO NOT DISTRIBUTE
The Darden School
The Darden School
Where it works - on the web site
Seven key applications of NPEC
• Home page
• Product detail page
• Shopping cart cross-sells
• Check-out page
• Recommendation center
• Product category sorting
• Search results sorting
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
8
DO NOT DISTRIBUTE
The Darden School
The Darden School
Results - on the web site
“The click-through is twice as high as anything we get without the software. It has twice the sales impact, too.”
Jim LaBelleVP Marketing, Wine.com1to1, November 2000
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
9
DO NOT DISTRIBUTE
The Darden School
Other places where CF works
In the call center
Through email campaigns
Other customer touch points such as cell phones, PDAs, kiosks, POS systems
“walk-talk-click-beep”
The Darden School
* Converted from British Pounds
With Net With traditional Perceptions’
cross-sell realtime methods recommendations
Ave. Cross-Sell Value $19.50* 60%higher
Cross Sell Success Rate 9.8% 50%higher
Results - in the call center
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
10
DO NOT DISTRIBUTE
The Darden School
Results - through email
Click-throughResponse Rate 10% 19.1% 2X
Purchase Rate 0.25% 2.7% 10X
Industry NETP versusAverage* Delivered Industry
* Forrester Research
The Darden School
Some of our personalization customers
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
11
DO NOT DISTRIBUTE
The Darden School
Where CF works best
Best environment• Lots of products, lots of customers
• Where preferences are expressed and observable through customer behavior (not a “spec’d” purchase)
• Where customers are uniquely identifiable
Best applications• Retail commerce
• Knowledge management
The Darden School
The knowledge management applicationP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
12
DO NOT DISTRIBUTE
The Darden School
The privacy issue
The Darden School
The privacy issue
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
13
DO NOT DISTRIBUTE
The Darden School
The privacy issue
• Lots of media coverage over the past year
– But coverage has slowed recently
• Privacy issue lies on a spectrum, not in absolutes1. Type of info tracked (anon clicks, mailing address, personalfinancials?)
2. How I consent (opt in immediately, opt out possible, opt out not honored?)
3. Where the info will be used (today, this site only, sold to others?)
4. Value I receive (great experience, save some time, info used to harm me?)
Pause forQuestions and Answers
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
14
DO NOT DISTRIBUTE
The Darden School
Agenda
How CF works
Where it works (and doesn’t)
Some results
The privacy issue
A quick history of Net Perceptions
Getting a job in high tech marketing
Q&A throughout
The Darden School
Net Perceptions (A)
“Establishing credibility”
Key events
• Amazon as first customer on the web (pre IPO)
• IPO (4/23/99)
• GUS results demonstrate value of the technology in call center (9/20/99)
-
10
20
30
40
50
60
70
4/23
/99
6/7/
99
7/22
/99
9/5/
99
10/2
0/99
12/4
/99
1/18
/00
3/3/
00
4/17
/00
6/1/
00
7/16
/00
8/30
/00
10/1
4/00
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
15
DO NOT DISTRIBUTE
The Darden School
Net Perceptions (B)
“Catching the wave”
Key events
• Significant customer, partner, and industry leader recognition (November 99)
• ABC and NBC profile the company (December 99)
• Acquire KD1 analytics company (January 99) -
10
20
30
40
50
60
70
4/23
/99
6/7/
99
7/22
/99
9/5/
99
10/2
0/99
12/4
/99
1/18
/00
3/3/
00
4/17
/00
6/1/
00
7/16
/00
8/30
/00
10/1
4/00
The Darden School
Net Perceptions (C)
“The dot-com collapse”
Key events
• Secondary offering raises over $100 million (3/24/00)
• Dot-com market collapses (early April 2000)
• Miss Q3 revenue and earnings targets (9/28/00)
• Lay off 17% of work force (10/19/00)
-
10
20
30
40
50
60
70
4/23
/99
6/7/
99
7/22
/99
9/5/
99
10/2
0/99
12/4
/99
1/18
/00
3/3/
00
4/17
/00
6/1/
00
7/16
/00
8/30
/00
10/1
4/00
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
16
DO NOT DISTRIBUTE
The Darden School
Where we are today - markets and competitionMarkets
• Multi-channel retailers
• Fortune 1000 (knowledge management)
Closest competitors in retail
• Analytical CRM (Epiphany, Broadbase, Blue Martini)
• Retail-specific ERP (JDA Software, Retek)
• “Build it in-house”
The Darden School
Where we are today - products
Hosted APPS
Software AdvertisingAdvisor
E-commerceAnalyst
RetailAnalyst E-commerce Marketing
Campaigns Call Centers
CoreTechnology
Business Intelligence Personalization“ P e r s o n a l i z a t i o n M a n a g e r ”
Business Intelligence Engine
Knowledge Discovery Engine - Recommendation Engine
AdvertisingAdvisor
E-commerceAnalyst
RetailAnalyst
*Powered by Angara
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
17
DO NOT DISTRIBUTE
The Darden School
Business intelligence customers
Hudson’s Bay
Questions and Answers
Discussion: Job hunting in high tech
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
18
DO NOT DISTRIBUTE