Ciao Surveys GmbH – Ciao Surveys GmbH – Internet Survey SolutionsInternet Survey Solutions

Name of Presenter

Date

BREAKING DOWN BORDERS: BREAKING DOWN BORDERS: MIGRATING INTERNATIONAL TRACKING MIGRATING INTERNATIONAL TRACKING STUDIES ONLINE STUDIES ONLINE Richard Thornton, Managing Director, Ciao Surveys GmbHRichard Thornton, Managing Director, Ciao Surveys GmbH

Introduction

In today’s crowded marketplace, it is critical to create a competitive edge.

Attitudes and behaviours can change rapidly—and the research providers that keep up with these changes gain this competitive advantage.

Online as a methodology is playing an important role in allowing research buyers and users of tracking study data to deliver the right insights at the best price in the optimised time

However…

Gaining a competitive edge and delivering actionable decisions does not come without

challenges….

It all starts with smart research planning

Target Group

Sample Sizes

Fieldwork Time

Multi-Media?

Languages

Penetration Rate

Countries

Local legislationNat Rep Samples?

Qual or Quant?

Partner with an agency you can trust

Tracking studies run online will invariably be run on panels

The good news is that you have more choice than ever before

But be careful as quality varies within the industry

Make sure your : Research-only panelsResearch-only panels

Panel qualityPanel quality

Recruitment should use the same model locally adapted per countryRecruitment should use the same model locally adapted per country

Panelists should be “active”Panelists should be “active”

Adherence to local data protection lawsAdherence to local data protection laws

Members of local and global market research industry associations: ISO, Members of local and global market research industry associations: ISO, ESOMAR, CASRO, MRA, MRS…ESOMAR, CASRO, MRA, MRS…

Anything else I should know?

Most panel companies claim to deliver a one-stop-shop approach but you should check…

If your panel partner is outsourcing to third parties:

different panels have different profiles

different recruitment methods

specific set-up processes

software requirements

how are panelists targeted

For operational support & infrastructure to handle international studies

Whether the panel company has prior experience of running similar multi-country projects

Sign-up

process

Support

(Help Desk)

$$$

(Incentive)

Survey

Experience

PanelistValue proposition

If you choose the right partner, a good panel has a happy and responsive panel!

Lost in translation… Use professional native-language translators

only

Supplier approval process where external translation agencies are used

What works in one country might not work in another!

Formal vs. informal

Question types, e.g. asking ethnicity can be offensive in some countries

Tailor appropriate language and tone to specific target groups – use localization

Make sure your panel partner is testing survey-links by speakers of relevant languages

Check for plausibility

Local market differences

Clarity of question wording

Make sure your partner has translation software integrated with survey software

Providing the right incentive…

Small incentives for completion of surveys are recommended

For international projects, incentives might need to be weighted per country

In Europe the trend appears to be “cash is king”

In North America prize draws, points, and pools are more widely used

In Asia a reward systems based on points redemption is popular

Different target groups require different incentives

Consumer vs. kids vs. B2B

Panel companies need to ensure payment prophecies are streamlined

International fieldwork made easy…

Compared to traditional research methodologies, online research enables…

larger samples and geographic areas due to cost savings

typically quicker fieldwork completion times for multi-country projects

Sample deployment should factor in time-zone differences for international projects

Online panels allow real-time monitoring of multi-country projects from one location

Quota management, incidence rates, response rates, & screen-out information are available at touch of a button

Top-line results can be provided in real-time for interim meetings and quick decisions

But can online deliver quality results?

Agencies and clients should request as much transparency as possible when running any projects, especially international studies

Online panel companies should run sanity checks at all stages of the fieldwork process

translation through to data delivery

Panel companies should have a dedicated panel support team and Q&A team for all languages supported

Quality assurance screening checks should be in place for…

surveys completed “too quickly”

for click-through patterns or “straight-lining”

Clients should evaluate the panel company’s performance

Respondents should rate the survey experience – this is not happening and needs client buy-in!

Engagement Model

Source: Ciao / Fat Planet

So the challenge is to engage the respondent and boost response rates

Response

SurveyLength

AppropriateIncentives

Panel Involvement

SurveyInvitation

SurveyDesign

SurveyNarrative

RespondentSatisfaction

Tracking Studies definition

Tracking studies are considered to be any study intended to be in the field on a continuous basis (at least three times per year).

Data is collected over time, changes interpreted and cause/effect relationships determined based on activities (advertising/economic events).

Therefore it is essential to keep independent variables such as target groups or study designs consistent.

Trend data can provide companies with a benchmark or meaningful standard by which adverts, products or services can be measured.

Tracking Studies: Study Designs

Multiple study designs are possible!

Advertising/Brand Tracking – Awareness of brand, usage, as well as purchase intent. Example – Study conducted amongst general population to gauge ad awareness and effectiveness.

Usage/Behavior Tracking – Attitude and usage of a brand over time. Example – Study conducted amongst users of a specific product to gauge trial adoption, and usage patterns.

Longitudinal/Diary Tracking – Trial & adoption or specific product. Example – Study conducted to gauge consumer reactions to a specific product, ease of use, product attributes, etc.

The markets are moving fast …

Markets fluctuate more rapidly and require constant monitoring

Markets are becoming global, but consumers remain diverse

There is pressure on market researchers to lower research costs while expecting faster results

… as the internet

Internet users are becoming more and more representative of the offline population

Nearly half of individuals in the EU25 used the internet at least once a week in 2006

A third of households and three-quarters of enterprises had broadband internet access

Household internet access ranges from 23% in Greece to 80% in the Netherlands

Sources Eurostat nov 2006

0%

10%

20%

30%

40%

50%

60%

70%

80%

Ma

lta

Ne

w Z

ea

lan

d

Ice

lan

d

Sw

ed

en

Fa

lkla

nd

Isla

nd

s

De

nm

ark

Ho

ng

Ko

ng

*

Un

ite

d S

tate

s

Au

str

alia

Ca

na

da

No

rwa

y

Ja

pa

n

Sin

ga

po

re

Ko

rea

, So

uth

Gre

en

lan

d

Sw

itze

rla

nd

Ne

the

rla

nd

s

Fa

roe

Isla

nd

s

Un

ite

d K

ing

do

m

Fin

lan

d

Be

rmu

da

Ta

iwa

n

Ge

rma

ny

Lu

xe

mb

ou

rg

Po

rtu

ga

l

Internet penetration

251 million internet users in Europe

Source: internetworldstats.com, August 2006

Online tracker studies have the advantage of:

1. Providing more flexibilityflexibility to allow faster turnaround on changes that affect strategic decisions

2. Having access to international and large samplesinternational and large samples to better target actual and future customers in their local environment; also with low incidence.low incidence.

3. Lowering research cost.cost.

4. Benefiting from proven infrastructure for fast delivery and better control.control.

5. Using multimedia multimedia capabilities to better capture the respondent feedback and explore new research themes

6. Yielding data of comparable qualitycomparable quality to offline.

1 Online provides more flexibility to meet new customer expectations

Online methodology enables a wide range of studies to be conducted, from concept testing, brand awareness, trade-off studies and purchasing intentions.

Can see real-time results and therefore react quickly to unexpected changes that occur during the course of the tracker

Complex survey skip patterns, rotations can be quickly changed

Easy changes to survey questions even during the field stage, including quotas

2 Online provides large profiled and qualified international customized sample Access to 25 proprietary country panels on 4 continents,

with partners covering 40 countries.

Access to a range of 10 vertical pre-selection panelist profiles

Access to large sample size and high response rate to reach low incidence target groups with ease

ALL our members are active panelists who have participated in a survey or joined the panel within the past 6 months

Ciao Surveys extensive international panels coverage

Ciao: Europe > 2 Mio

Ciao: America > 3.3 Mio

Ciao: Asia/Australia > 315k

Ciao proprietary PanelsPartner

Internal studies have shown that an online data collection methodology for tracking studies is less than half the cost of an equivalent CATI or Face to Face study

Cost reductions are made through savings on phone, mail and interviewer costs; printing and paper costs; data entry costs

Pre-selecting eligible respondents is a key money-saver, especially for traditionally low incidence groups

3 Online provides significant cost reductions

Price

Sample Size

Online

CATI

“This methodology has the advantage of being more cost-effective than other

traditional data collections methodologies.”

Chris Nash, Research Manager Feedback Consumer

4. Online provides high control in running studies

All surveys are administered centrally meaning a 100% comparable structure in all countries can be guaranteed and changes can be effected in all countries simultaneously.

Results can be viewed in real-time, with online reporting.

Respondent activity and questionnaire ‘stumbling blocks’ can be quickly highlighted and corrected.

Provides insight about the profile of screen-outs.

5 Online provides unique use of Multimedia options

Questionnaires can incorporate visual and audio cues, enriching the survey experience and delivering more comprehensive results

Multimedia keep the respondent interested for long surveys

Multimedia helps to increase respondent engagement

Multimedia tools encourage instantaneous responses

5 Examples of online Multimedia options

Shelf Test Page Flip Image Slider

“The medium of online tracking means that we are able to show stills or video clips, which is extremely useful for measuring which executions

people might have seen”- Chris Nash, Research Manager

Feedback Consumer

…results will not be 100% consistent vs. an offline study

Online users are typically more familiar with IT and technology compared with telephone respondents.

Respondents tend to be more open and honest when answering open ended questions in private and at a time that is convenient to them.

The presence of an interviewer in offline methodologies automatically introduces the potential for interviewer bias

Unaided awareness questions may be less complete when comparing online studies to telephone.

Online has response bias towards those consumers with internet access however this is becoming less of an issue

However, overall trends will be consistent and similar conclusions will eventuate

Source internal validations study 2006 Brand testing

… Online panellists'’ engagement level is high and contributes to high quality survey

50% say the primary motivator for joining a market research panel was being able to voice opinions about products and services

74% say they participate in research for the chance to be heard, to have an impact, or to influence the decisions of companies

75% believe that acquiring knowledge about new products/services is another significant motivator for participants

Source GreenfieldOnline Ciao study 2006 50 completes in 10 countries

There is another benefit…

How switch to online?

Check the suitability of your topic for online research

Check whether your target group is accessible online

Do a cost comparison

Parallel run for a period

Demand consistency

Switch and enjoy

Offline tracking

Adjustment

Online tracking

Our experience with Online trackers

Tracking studies executed Attitude & Usage In Home Usage Testing Ad Tracking Concept Test Website Evaluation Product Positioning

Market served Travel & Tourism Telecommunications Beverage CPG Advertising Automotive Pharmaceutical

50 current on-going trackers10 dedicated Projects Managers with Tracker expertise

Summary

Providing more flexibility to allow fast turnaround changes and support strategic decisions

Having access to international and large sample size to better targets actual and future customers in their local environment

Lowering research cost while keeping the same quality of data

Benefiting from proven infrastructure for fast delivery and better control

Using multimedia capabilities to better capture respondent feedback and explore new research themes

Case Study: EasyJet Brand Tracker for GfK NOP

Background:

• Ciao were successful in the bid to run a large-scale international brand tracking study, which was previously being run by another online agency.

• In order to review consumers’ attitude towards the airline, it was necessary to establish a strategy by tracking the brand attitude of this product.

• “The survey is one if the largest and most complex online projects that we conduct - 17 countries, 64 markets with quotas for fliers and non-fliers in each market” – Zoë Laurance, AD, GfK NOP.

• Of this, Ciao covers 14 markets. The global reach of our proprietary panels ensures we only have to go to partners for 5 of these markets.

• n=28,500 completes conducted in 2006.

Methodology

• We are able to minimise problems with more difficult markets by prioritising them - if people use more than one airport to travel from, the lower incidence airport is prioritised.

• When we were asked to cover additional, difficult markets, we undertook a recruitment drive to ensure enough sample was available to achieve the required sample size.

• Providing GfK NOP with a dedicated project management team has meant that a complex project has become easy to manage – from both sides.

•Although GfK NOP are hosting this survey, our team check the script on each occasion to pick up any logic/sense errors, as well as routing/scripting errors. This ensures both teams are working closely together, towards the same goal.

Results

Attention to detail and a customer-focused approach ensure that we minimise panel burn and maximise efficiency.

“We have been using Ciao panellists for 14 of the countries (48 markets) and they have proved themselves to be highly professional business partners. Their management team provides constant support as well as help with script checking in the numerous languages required. Most importantly Ciao are very pro-active in making sure the required number of interviews are acquired to deadline”.