building a testing roadmap by hazjier pourkhalkhali - optimizely experience london 2014

37
BUILDING A TESTING ROADMAP Hazjier Pourkhalkhali Strategic Optimization Consultant

Upload: optimizely

Post on 28-Nov-2014

314 views

Category:

Presentations & Public Speaking


0 download

DESCRIPTION

Hazjier Pourkhalkhali is a strategic optimisation consultant at Optimizely. In his talk he explains who to create an optimisation roadmap. This process consists of 3 phases that he will discuss in his talk: - Structure your optimisation goals - Manage your testing roadmap - Find your maximum

TRANSCRIPT

Page 1: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

BUILDING A TESTING ROADMAP!

Hazjier Pourkhalkhali!Strategic Optimization Consultant!

Page 2: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

§ Work with clients on:!•  Optimization strategy!•  Operational management

and processes!•  Testing best practices!•  Industry trends and

research!

HAZJIER POURKHALKHALI!

Strategic Optimization Consultant, EMEA

Page 3: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

Structure Your Optimization Goals

Manage Your Testing Roadmap

Find Your Maximum

CREATING AN OPTIMIZATION ROADMAP!

Page 4: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

STRUCTURE YOUR OPTIMIZATION GOALS!

Page 5: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

SET BUSINESS GOALS!

•  What is the company-wide goal?!!

•  How does optimization play a part?!!

•  Think beyond conversions!!

Page 6: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

SET BUSINESS GOALS!

Conversions Revenue CTR

Page 7: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

Revenue

Revenue Per Visitor

Conversion Rate

Average Order Value

Visitors

THINK BEYOND CONVERSIONS!

Page 8: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

Revenue

Revenue Per Visitor

Conversion Rate

Length of Funnel

Completion Rate

Average Order Value

Quantity Price

Visitors

Acquisition Retention

Completion Rate

Page 9: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

Completion Rate

Emphasize the Primary

Call to Action

Wording / messaging

Location / size

Design / color /

iconography

Minimize Distractions

Establish a visual

hierarchy

Remove non-critical content

Limit number of choices

Communicate Unique

Selling Points

Select/target the right

USP’s

Refine the messaging

Communicate visually

Design Intuitive

Navigation

Use a clear, consistent

layout

Structure the right tabs and

order

Use iconography

Market Products

Effectively

Test ideal product visuals

Use the right review

systems

Find ideal description text / length

Build a Sense of Urgency

Show quantity left

Push temporary

offers

Promote buying before

set times

Goals

Strategies

Tactics

Page 10: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

MANAGE YOUR TESTING ROADMAP!

Page 11: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

DEVELOP A TESTING PROCESS!

Ideate Research Refine Plan & Run Review

Page 12: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

“Any time the Detroit Pistons score 100 points and hold the other team below 100 points, they almost always win.”-Doug Collins, NBA Coach!

Page 13: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR HYPOTHESIS!

Page 14: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

DEVELOP A TESTING PROCESS!

Ideate Research Refine Plan & Run Review

Page 15: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

DEVELOP A TESTING PROCESS!

Ideate Research Refine Plan & Run Review

Page 16: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

FIND YOUR MAXIMUM!

Page 17: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

EXPLORE RADICAL OPTIONS!

Page 18: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

CASE STUDY: ABC FAMILY / DISNEY!

Page 19: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

Page 20: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

“We’re going to turn this team around 360 degrees.”

-Jason Kidd, NBA Player!

Page 21: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

Page 22: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

Page 23: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

1. USE IN-PAGE ANALYTICS!

Page 24: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

2. USE FUNNEL VISUALIZATION!

Page 25: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

0.00%!

0.50%!

1.00%!

1.50%!

2.00%!

2.50%!

3.00%!

3.50%!

25-34! 35-44! 45-54! 55-64! 65+! 25-34! 35-44! 45-54! 55-64! 65+!

Industry Conversion Rate!

Client Conversion Rate!

3. GET GRANULAR ABOUT CONVERSIONS!

MEN! WOMEN!

Page 26: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

Page 27: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

USING QUALITATIVE DATA!

•  Run consumer surveys!!

•  Analyze marketing reports!!

•  Perform user case studies!!

•  Record user sessions!

Page 28: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

Page 29: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

HOME PAGE COMPARISON!

§ Why should users prefer your website § Who is your target audience? § What are the three main page goals? § Which content should users see first?

§ What is your edge? Growth area? § Which users should you also target? § How effectively are they pushed? § What content should be removed?

Page 30: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

BOOKING PAGE COMPARISON!

§ What steps should users complete? § What information are you displaying? § How do you visualize the flow?

§ What is the ideal flow? § When should you display information? § How can the process be more intuitive?

Page 31: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

Page 32: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

LOVEHOLIDAYS HOME PAGE!

§ How many visual steps does it take a customer to see your Primary Call to Action? § Are you emphasizing the right content with your visual layout? § Is key content currently being underutilized due to the design?

Page 33: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

LOVEHOLIDAYS BOOKINGS PAGE!

Page 34: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

REFINE YOUR WEBSITE!

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

Page 35: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

LISTENING TO THE CUSTOMER!

•  Read the most used search queries, FAQ pages!!

•  Send customer surveys to specific segments!!

•  Use Net Promoter Scores or alternate metrics to assess performance by segment, product, or service!!

•  Call your customers yourself / shadow customer calls!

Page 36: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

Structure Your Optimization Goals

Manage Your Testing Roadmap

Find Your Maximum

VOICE OF THE CUSTOMER

ANALYTICS QUALITATIVE DATA

HEATMAPS COMPETITIVE REVIEWS

BUILD YOUR TESTING ROADMAP!

Page 37: Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014