essnet pilot on mobile phone data - dissemination workshop ... · essnet pilot on mobile phone data...

ESSNet Pilot on Mobile Phone DataDissemination Workshop 2017

WP5 Mobile Phone Data – David Salgado (coord.)

ESSnet on Big Data

Sofia, 23-24 February, 2017

WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Work Package Overview

• First phase (SGA-1):

— Access to data

— Feb 2016 – Dec 2016

— INSEE, INSSE, ISTAT, StatBelgium, StatFinland,

StatSpain (INE – coord.), with collaborations from

CBS, Destatis, ONS, and Eurostat

• Second phase (SGA-2):

— Methodology, technology, quality, other domains

— Jan 2017 – May 2018

— CBS, Destatis, INSEE, INSSE, ISTAT, ONS,StatBelgium, StatFinland, StatSpain (INE – coord.),

with collaborations from Eurostat

David Salgado (ESSnet on Big Data) Mobile Phone Data 23-24 February 2 / 27

WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Tasks (SGA-1)

• Survey on status of access to mobile phone data in

the ESS

• Bilateral negotiations with MNOs

• Workshop ESS-MNOs at Luxembourg

• Deliverables 1.1 and 1.2 reporting every task.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Preliminary analysis. I

• Characteristics of MNOs:

— Investment on Big Data business line or not.

— Nature of the interlocutor department (legal,research, commercial, business . . . ).

— Existence of business intermediary.

• Legal requirements

— Legal support from National Statistical Acts to

request access: statistical legislation.

— Barriers from national and international

telecommunication regulations.

— Barriers from personal data protection regulations.

— Public Administration: equal treatment.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Preliminary analysis. II

• Access conditions

— In-situ access, transmitted data sets to NSIs or

processing by a trusted third-party.

— Access for research only or for standard production.

— Intellectual property rights, industrial secrecy andopen algorithms and tools.

— Combination with official data.

— Cost compensation.

— Confidentiality and privacy assurance.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Premilinary analysis. III

• Data characteristics

— Raw micro-data, preprocessed micro-data, or

aggregated data.

— Event types: calls, messages (SMS/MMS), Internetconnections, LAUs, . . .

— Complementary data: roamers/non-roamers,

sociodemographic variables of subscribers, geographic

and time coverage, . . .

— Variables preprocessing:

� identified or anonymous data hashing algorithm;

� mobile phone spatial location algorithm;

� time coordinate coarse-graining algorithm;

� any other variable.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Preliminary analysis. IV

• Other aspects

— Apparent collision of interests.

— Public opinion and perceptions.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Questionnaire about the access

• Parts:

— General issues

— MNOs characteristics, state of negotiations and legal

requirements

— Access conditions

— Data characteristics

• Submitted to the 28 NSIs involved in TF/ESSnet

25 responses received.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

State of the access (NSIs)

ESS NSIs 32

Surveyed NSIs 28

Responses 25

NSIs having contacted MNOs 14

with only one MNO 7

with more than one MNO 7

NSIs having access to mobile phone data 7


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

State of the access (MNOs)

NSIscontacting

# MNOs

8 1

2 2

4 3

Total 24Granting

access

with stat business 12 3

without stat business 6 4

NA 6 3

Total 10


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

State of the access

• No definitive legal endorsement to request mobile

phone data (according to surveyed NSIs)

• Telecommunication regulations do not observe the

role of NSIs

• Role of the DPA is fundamental

• Data Characteristics vs. Access Type:

In-

situ Trans.

3rd-

party

Not

de-

cided

Pre-

lim.

stage

Raw microdata 0 2(2) 0

2 3Preprocessed microdata 2(1) 1(1) 0

Aggregated data 0 3(2) 1(1)


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Bilateral negotiations

• Negotiations of WP members with their national

MNOs to access mobile phone data for SGA2.

Experiences to be shared in the second half of this talk.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Workshop NSIs-MNOs. I

• Invitations issued to:

— 42 MNOs from 23 countries

— OECD, ITU, NU

— NSIs: WP members + from countries with participating

MNOs + rest of ESS

— EC: Eurostat + DG Connect + DG Digit.

— Private companies

From confirmed attendees

MNOs 13 11

Int’l Orgs 1

ESS 11 NSIs + Eurostat (12)

DG Connect 1

DG Digit 1

Private 1


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Workshop NSIs-MNOs. II

• Agenda:

— Presentation of context and actors (Eurostat)

— Examples of on-going initiatives (France + Estonia +Belgium)

— Core issues regarding access (Spain)

— Conclusions for the future (Eurostat - ESSnet)

• Active contributions from all MNOs, NSIs and Eurostat.

• Several issues clearly identifed in common

agreement.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Workshop NSIs-MNOs. III

• A need for clear use cases to show feasibility and

mutual trust.

• Consensus on partnerships outperforming mandatory

scenarios.

• Concerns arise when moving from research to

production.

• Distributed vs centralised models. Solutions based

on the development of open algorithms.

• Regulation on data protection and relationship with

regulatory authorities is a big issue at national and

European level: More clarity needed.

• Perception by society on the use of these sources.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Deliverables

• Deliverable 1.1

— Preliminary analysis

— Questionnaire

— Results

• Deliverable 1.2

— Technical guidelines

— Business guidelines

— Guidelines based on our experiences


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Technical guidelines: MP Data do not exist


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Belgium

• Context

Three mobile network operators: Proximus (former incumbent, 51%

state-owned, 41% market share), Telenet (36%), Orange Belgium (23%)

• ProximusProject Proximus, Statistics Belgium, Eurostat, JRC: start Dec. 2015, 8publications in 2016, analyses ongoing on new datasets.

Statistics Belgium wants to produce statistics based on mobile phone data

in 2017

• Telenet

Talks since beginning 2015, frozen by legal issues (NDA), takeover of Base,

data ‘readiness’, Statistics Belgium lack of resources

• Orange Belgium

Promising first contact Aug. 2016 but no follow-up, maybe due to Orange

business model (data analysis outsourced, limited autonomy)


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Belgium

Project Statistics Belgium, Proximus, Eurostat, JRC: An example

Population density per km2 based on mobile phone data (left) and 2011 Census (right)


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Finland

• 3 MNOs contacted. One-to-one negotiations.

• Legal concerns expressed and approval requested

from DPA and Finnish Communications Regulatory

Authority.

• Only aggregated data under agreement. Data

handling must taken under extreme caution.

• Data extraction costs for pilots expected to be free of

charge: not so for production in the long-term


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: France

• Mobile Phone Data considered as a promising data

source to provide local statistics

Eurostat Report (2014) : “Feasibility study on the use of

mobile positioning data for tourism statistics”

— Objective measures for mobility; changes in present

population ( 6= resident population measured byCensus) : night vs day ; seasonal variations, etc.

Classifications of areas (residential vs working),commuting between cities, ‘actual’ size of urban

centers, etc.

— Lot of issues: local market shares, trade-off accuracy

/privacy

• Ongoing project with Insee, SENSE Orange lab and

Eurostat


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: France

• Use of (anonymized) Orange CDR data set

corresponding to activity from May to October 2007

(“active” data, spatial localisation of antennas is

known)

• First objective/step : “validation” by

— comparing with census data → requires to identify

“probable”residential addresses from data

— using aggregated data to classify urban areas

(machine learning issue of classification) “ClassifyingUrban Areas in France based on CDR Data”(Stéphanie

Combes, Marie-Pierre de Bellefon, Marteen Vanhoof,

2016)

• Second objective/step : define meaningful indicators for

Official Statistics


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Italy

Wind Data Provision

• In 2014, ISTAT submitted a request to the Italian Data Protection

Authority (Privacy Guarantor) in order to obtain permission to receive

mobile phone data from a National MNO (WIND) and the Privacy

Guarantor recommended ISTAT to provide appropriate guarantees.

• Now WIND has just provided to ISTAT the mobile data (CDR) of the

province of Pisa for 5 weeks (from 01/01/2017 to 12/02/2017).

• The data are broken down by municipality and per day.

CDRs include:— type of CDRs : SMS or VOICE

— caller sim number (encrypted)

— time of activity: date and time of call start and call duration

— municipality where call start


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Italy

SGA-2 for ISTAT: Possible pilots

“Persons and Places” project: to what extent “big data”can

complement administrative data on mobility statistics?

• Intercity mobility: As administrative data do not contain information on the

frequency of mobility, the idea is to specify an estimation method, using

CDRs, to define for each municipality the stock of standing residents,

embedded city users and daily city users (commuters).

• Analysis process built on top of the Sociometer (in cooperation with KDD

Lab ISTI-CNR PISA ) to classify the behavior of each user in the Call Data

Records.

• Planned methodological outcome: integration with administrative data (e.g.

new mobility profiles).


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Italy

SGA-2 for ISTAT: Possible pilots

The use of mobile positioning data for tourism statistics

• A first result of Trips and holidays survey shows the mobile phone

use by Italian residents during tourism trips.

Source: ISTAT – Trips and holidays Survey - 2016

• Planned methodological outcome: Calibration and quality controls

based on survey data.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Romania

• Invitations were sent to all four companies. Only Vodafone and Telekomanswered.

• We discussed with the following departments (no previous knowledgeabout internal organization of MNOs):

— Regulatory Affairs Roaming & Interconnection Department.

— Strategy and Performance Management Department.

— Business Segment Department.

• The outcome of the discussions: NSI does not have access to mobilephone data.


WP Overview

State of access

Negotiations

Workshop

Deliverables

Experiences

Experiences: Spain

• Negotiations with Telefonica.

• Reached business and operational agreement:

— In-situ platform to access and process 1-year wholenational territory preprocessed microdata.

— Obstacle: cost

In agreement with Eurostat not to set up adangerous predecent, we suspend further actions.

As a derived hurdle: equal treatment to all MNOs.


essnet pilot on mobile phone data - dissemination workshop ... · essnet pilot on mobile phone data...

Documents