the potential & pitfalls of big data by jag duggal of quantcast - sic2014

23
Copyright 2014 Quantcast Copyright 2014 Quantcast The Potential & Pitfalls of Big Data Jag Duggal, SVP Product, Quantcast Seattle, WA October 15, 2014

Upload: seattle-interactive-conference

Post on 27-Jun-2015

402 views

Category:

Technology


0 download

DESCRIPTION

Big Data is changing the world as we know it — across every industry globally. For the better part of the last decade, Quantcast has been amassing an unparalleled perspective on the entirety of internet activity at an individual level through our Quantcast Measure product, providing us with a unique real-time perspective on consumer behavior. In this session, Jag will provide a unique perspective into how Big Data is transforming the advertising industry.

TRANSCRIPT

Page 1: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

The Potential & Pitfalls of Big DataJag Duggal, SVP Product, QuantcastSeattle, WAOctober 15, 2014

Page 2: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Quantcast is an advertising technology company but a big data company first

Access browsing behavior of +100M

destinations

100MWe see each U.S.

consumer over 600times per month

600XA Top 5 data processing organization alongside

Google and U.S. Dept. of Defense

Page 3: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast

A data revolution, a relevance revolution

Radio

Health

Education

Politics

Agriculture

Page 4: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast

Larger than the original internet

revolution

Copyright 2014 Quantcast

Page 5: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Big data will change the world as we know it

Page 6: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Economy

2004 2005 2006 2007 2008 2009 2010 2011 2012 2013-4.00

-3.00

-2.00

-1.00

0.00

1.00

2.00

3.00

4.00

GDP % growth, annualSource: The World Bank

An

nu

al %

Gro

wth

Page 7: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Geo-Politics

“When you look at our differing views of the Arab Spring, on how to deal with Iran, on changing energy

markets that make gulf oil less central — these things have

altered the basis of U.S.-Saudi relations.”

Source: NY Times

Page 8: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Climate Change

19901991

19921993

19941995

19961997

19981999

20002001

20022003

20042005

20062007

20082009

20102011

20120

1,000

2,000

3,000

4,000

5,000

6,000

7,000

U.S. CO2 Emissions, 1990-2012Source: U.S. EPA Inventory of U.S. Greenhouse Gas and Sinks

Em

mis

ion

s (

mill

ion

me

tric

to

ns

)

Page 9: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Big data will change the world as we know it

“When you look at our differing views of the Arab Spring, on how to deal with

Iran, on changing energy markets that make gulf oil less central — these things

have altered the basis of U.S.-Saudi relations.”

Geo-Politics Climate ChangeEconomy

is changing

Page 10: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast Copyright 2014 Quantcast

Epicenter: Online Media & Advertising

Fragmentation at a whole new level.

Impressions delivered

individually, each entirely distinct.

Segments of One.

Page 11: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

• Map Reduce & Hadoop invented by Google and Yahoo…because personalized media required it

• Today, used in almost every industry

• We buried last vestige of Hadoop at Quantcast two weeks ago…

• ….no longer up to the scale required

• We use instead Quantcast File System (QFS) which we open-sourced

Big data…necessity is the mother of invention

Page 12: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Page 13: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast

Big data and machine learning only as effective as the human expertise

and wisdom that guides it

Page 14: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

(Un)Viewable ads

Page 15: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast

(Wrong) Attribution window

Mismatch Actual customer journey vs. Artificial

conversion window(Beta Quantcast Report)

Page 16: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Last touch attribution

Page 17: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Bad incentives lead to bad behavior: wasted budgets

Page 18: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast

Split funnel attribution Pay for what you want… new customers

Site Visit

Conversion Event(e.g. Jag buys plane ticket on April 4th)

Last View

1

2

Split Credit for Each Conversion

You Decide How to Divide Credit

Last ViewBefore VisitLast View before Site Visit

Page 19: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Tools emerging to allow humans to guide the machines

Moat, DoubleVerify, Integral…and

MRC

Viewability

Awareness by agency experts

Conversion Window

Attribution that “splits the

funnel” pioneered by

Abakus, Ensighten,

Quantcast…and perhaps others

Last touch

Page 20: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast

Selling plane tickets

Page 21: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Present at the creation...

Page 22: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast | Copyright 2014 Quantcast | Confidential

Thank you.

Jag DuggalSVP of Product [email protected]

Page 23: The Potential & Pitfalls of Big Data by Jag Duggal of Quantcast - SIC2014

Copyright 2014 Quantcast Copyright 2014 Quantcast