architecture for measuring ad - developermarch · adtech data and measurement april 25, 2019 yahoo...

25

Upload: others

Post on 04-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)
Page 2: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Architecture for Measuring Ad Performance at Scale Divya B

AdTech Data and Measurement

April 25, 2019

Page 3: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

● Yahoo Bangalore (8 years)

● Yahoo Sunnyvale (2.5 years)

● Apply Cupertino (2.5 years)

● Uber Bangalore (10 months)

Journey

Page 4: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 5: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 6: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Intra-channel

Optimization

Creative Optimization

ROAS

Page 7: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Ad Partner Data

Performance Metrics

Conversions Data Science

●Spend

●Number of installs

●Number of clicks

●Number of trips

●Number of orders

●Number of sign up

●Number of first trips in N

days

●Number of trips for a region

●Cost per trip

●Cost per first trip

●Cost per sign up

●Projected first trip

●Lifetime value

●Cost per projected first trip

Page 8: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 9: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Architecture

Page 10: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Attribution

Facebook

Ad shown to an user

Google

Ad shown to user

App installed

User installs the app

Signed up

User signs up

Page 11: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real-time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 12: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Real-time

Data

Ingestion

Page 13: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Enrichment 06 Technologies 07 Wins

Agenda

Page 14: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Events

Ingestion

Batch

Page 15: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Spend

Ingestion

Batch

Page 16: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 17: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Aggregation

Page 18: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Data Quality

● Unit tests

● Integration Tests

● Dashboards and alerts

Page 19: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 20: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Technologies

● Apache Spark

● Apache Kafka

● Athena

● Piper

● Java/Python/Go

● Apache Cassandra

● Apache Hive

● Apache Hadoop

● Celery

Page 21: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

01 Project Overview 02 Architecture 03 Real time ingestion 04 Batch ingestion 05 Aggregation 06 Technologies 07 Wins

Agenda

Page 22: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Wins

● Scale

● Plug and play

● Data accuracy and freshness

● Extensible

● Modular

Page 23: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Questions?

Page 24: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)

Proprietary and confidential © 2019 Uber Technologies, Inc. All rights reserved. No part of this document may be reproduced or utilized in any

form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage or retrieval systems, without

permission in writing from Uber. This document is intended only for the use of the individual or entity to whom it is addressed and contains

information that is privileged, confidential or otherwise exempt from disclosure under applicable law. All recipients of this document are notified

that the information contained herein includes proprietary and confidential information of Uber, and recipient may not make use of, disseminate,

or in any way disclose this document or any of the enclosed information to any person other than employees of addressee to the extent

necessary for consultations with authorized personnel of Uber.

Page 25: Architecture for Measuring Ad - DeveloperMarch · AdTech Data and Measurement April 25, 2019 Yahoo Bangalore (8 years) Yahoo Sunnyvale (2.5 years) Apply Cupertino (2.5 years)