Transcript
Page 1: Convert Smarter, Not Harder - A/B Split Testing

Saturday, February 23, 13

Page 2: Convert Smarter, Not Harder - A/B Split Testing

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 3: Convert Smarter, Not Harder - A/B Split Testing

NOT HARDER.

#JDNC13 @SavvyPanda

CONVERT SMARTER,

Saturday, February 23, 13

Page 4: Convert Smarter, Not Harder - A/B Split Testing

NOT HARDER.Split Testing in Joomla.

#JDNC13 @SavvyPanda

CONVERT SMARTER,

Saturday, February 23, 13

Page 5: Convert Smarter, Not Harder - A/B Split Testing

LUKE SUMMERFIELD@SavvyPanda

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 6: Convert Smarter, Not Harder - A/B Split Testing

HUBSPOT INBOUND MARKETING CERT.

GOOGLE ADWORDS/ANALYTICS CERT.

HOOTSUITE CERT.#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 7: Convert Smarter, Not Harder - A/B Split Testing

HUBSPOT INBOUND MARKETING CERT.

GOOGLE ADWORDS/ANALYTICS CERT.

HOOTSUITE CERT.#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 8: Convert Smarter, Not Harder - A/B Split Testing

#JDNC13@SAVVYPANDA

SLIDESHA.RE/13B2GOU

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 9: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 10: Convert Smarter, Not Harder - A/B Split Testing

?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 11: Convert Smarter, Not Harder - A/B Split Testing

CROLEAN & AGILE

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 12: Convert Smarter, Not Harder - A/B Split Testing

CONVERSION RATE OPTIMIZATION

CRO#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 13: Convert Smarter, Not Harder - A/B Split Testing

GOAL OF

INTERNETMARKETING?

#JDNC13 @SavvyPanda

?

Saturday, February 23, 13

Page 14: Convert Smarter, Not Harder - A/B Split Testing

GOAL OF

INTERNETMARKETING?

#JDNC13 @SavvyPanda

?

Saturday, February 23, 13

Page 15: Convert Smarter, Not Harder - A/B Split Testing

2-WAYS TO

INCREASELEADS?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 16: Convert Smarter, Not Harder - A/B Split Testing

INCREASETRAFFIC

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 17: Convert Smarter, Not Harder - A/B Split Testing

INCREASECONVERSIONS

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 18: Convert Smarter, Not Harder - A/B Split Testing

?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 19: Convert Smarter, Not Harder - A/B Split Testing

via ebook: http://www.hubspot.com/an-introduction-to-ab-testing/#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 20: Convert Smarter, Not Harder - A/B Split Testing

E-COMMERCE

20-25%HIGHER

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 21: Convert Smarter, Not Harder - A/B Split Testing

LANDING PAGES.

30-40%HIGHER

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 22: Convert Smarter, Not Harder - A/B Split Testing

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 23: Convert Smarter, Not Harder - A/B Split Testing

CROLEAN & AGILE

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 24: Convert Smarter, Not Harder - A/B Split Testing

OPTIMIZE YOUR

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 25: Convert Smarter, Not Harder - A/B Split Testing

OPTIMIZEPRICING• Three tier pricing (current, bump, spike)

• Free shipping• Bundle pricing

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 26: Convert Smarter, Not Harder - A/B Split Testing

CROLEAN & AGILE

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 27: Convert Smarter, Not Harder - A/B Split Testing

LEAN &AGILE

WEBSITE DESIGN

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 28: Convert Smarter, Not Harder - A/B Split Testing

CREATE AN

?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 29: Convert Smarter, Not Harder - A/B Split Testing

HERE’S A SECRET...

#JDNC13 @SavvyPanda

YOU CAN’T

Saturday, February 23, 13

Page 30: Convert Smarter, Not Harder - A/B Split Testing

HERE’S A SECRET...

#JDNC13 @SavvyPanda

YOU CAN’T

Saturday, February 23, 13

Page 31: Convert Smarter, Not Harder - A/B Split Testing

CREATE AN

MVPminimum viable product

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 32: Convert Smarter, Not Harder - A/B Split Testing

MVP• Identify core features based on research & hypothesis

• Develop a base product• Gain users

#JDNC13 @SavvyPanda

Once your MVP is launched you can perform...

Saturday, February 23, 13

Page 33: Convert Smarter, Not Harder - A/B Split Testing

SPLIT TESTING ALLOWS FOR

VALIDATEDLEARNING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 34: Convert Smarter, Not Harder - A/B Split Testing

VALIDATEDLEARNING• Make hypothesis• Perform scientific testing (split testing)

• Collect data• One month sprints

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 35: Convert Smarter, Not Harder - A/B Split Testing

PRESERVER OR

PIVOT#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 36: Convert Smarter, Not Harder - A/B Split Testing

PIVOT ORPRESERVER?• Was hypothesis confirmed• What worked, what didn’t

• Deploy globally-or-• Pivot & refocus

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 37: Convert Smarter, Not Harder - A/B Split Testing

FOR

EXAMPLE

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 38: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 39: Convert Smarter, Not Harder - A/B Split Testing

WHAT IS

SPLITTESTING?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 40: Convert Smarter, Not Harder - A/B Split Testing

A/B TESTING

MULTIVARIATE

AND

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 41: Convert Smarter, Not Harder - A/B Split Testing

A/B TESTING• Two identical items• Testing only one variable• Champion vs Challenger

Goal = find optimal variations

Variation B

Variation A

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 42: Convert Smarter, Not Harder - A/B Split Testing

MULTIVARIATE•Test multiple variables simultaneously

•Running multiple A/B tests at the same time

•Must receive large traffic

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 43: Convert Smarter, Not Harder - A/B Split Testing

REMEMBER...

SPLIT TESTUNTIL YOU HAVE ADVOCATES.

PROTIP!

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 44: Convert Smarter, Not Harder - A/B Split Testing

WHAT

ITEMSCAN YOU TEST?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 45: Convert Smarter, Not Harder - A/B Split Testing

EVERYTHING!•Call To Actions•Landing Pages•Emails•Layouts•Pricing•Promotional Offers

... AND THE LIST GOES ON... (but the kitchen sink)

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 46: Convert Smarter, Not Harder - A/B Split Testing

WHAT

ELEMENTSCAN YOU TEST?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 47: Convert Smarter, Not Harder - A/B Split Testing

LANDING PAGE

•Offers•Copy•Form Fields•Layout•Image•Long vs Short

via ebook: http://www.hubspot.com/an-introduction-to-ab-testing/#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 48: Convert Smarter, Not Harder - A/B Split Testing

CALL TO ACTIONS

•Placement•Size•Color•Copy•Image•Benefit

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 49: Convert Smarter, Not Harder - A/B Split Testing

EMAIL

•Format•Timing•Sender•Subject Lines•Offer•Target Group

via ebook: http://www.hubspot.com/an-introduction-to-ab-testing/#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 50: Convert Smarter, Not Harder - A/B Split Testing

WILL IT HURT

SEO?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 51: Convert Smarter, Not Harder - A/B Split Testing

DUPLICATE CONTENT?

goo.gl/r45Xj

Google’s Recommendations

PRO TIPSUse Rel=Canonical or No-Index

on the A/B variations

If redirect, use a 302 (not 301)

bit.ly/P0gCR1

Matt Cutts: “nope.”

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 52: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 53: Convert Smarter, Not Harder - A/B Split Testing

KEY CONSIDERATIONS FOR

A/BTESTING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 54: Convert Smarter, Not Harder - A/B Split Testing

RUN ONE TEST AT A

TIME• Don’t overload • Prioritize & add on calendar• Stay focused• Create a 1 month “sprint” (busier site can do 1 week)

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 55: Convert Smarter, Not Harder - A/B Split Testing

TEST ONE VARIABLE AT

A TIME• Prioritize what to test• Allows you to track variable

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 56: Convert Smarter, Not Harder - A/B Split Testing

CHALLENGER VS CHAMPION

• Pit them against each other• Better perform = Champion

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 57: Convert Smarter, Not Harder - A/B Split Testing

CHALLENGER VS CHAMPION

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 58: Convert Smarter, Not Harder - A/B Split Testing

TEST BOTH BIG AND SMALL

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 59: Convert Smarter, Not Harder - A/B Split Testing

SMALL MAKES DIFFERENCE

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 60: Convert Smarter, Not Harder - A/B Split Testing

TEST THE ENTIRE FUNNEL

Customer

Advocate

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 61: Convert Smarter, Not Harder - A/B Split Testing

COLLECT ENOUGH

DATA 95% confidence rating

=Statistical Significance

http://super.hubspot.com/calculator/

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 62: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 63: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

3RD PARTY

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 64: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

J!CONVERT

#JDNC13 @SavvyPanda

• For Website• Virtuemart

FREE!

http://www.convert.com/features/

Add in JS to siteto make it work

Video:

Saturday, February 23, 13

Page 65: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

J!CONVERT

#JDNC13 @SavvyPanda

• Page Type - the view variable from the Joomla component in use on the page• Category ID - for Joomla com_content, the category id will be returned• Category Name - for Joomla com_content, the category name will be returned• Customer ID - Customer id number (when customer is logged in)• Custom Variable 1 - Joomla component name• Custom Variable 2 - User group id (if logged in)• Custom Variable 3 - for Joomla com_content, the article id will be returned• Custom Variable 4 - Joomla! Itemid number (menu id)

J!Convert - Plugin:• Page Type - VirtueMart product view, category view, checkout, cart or purchase

completion page• Category ID - VirtueMart category id number• Category Name - VirtueMart category name• Product SKU - VirtueMart product SKU• Product Name - VirtueMart product title• Product Price - VirtueMart base product price• Customer ID - Customer id number (when customer is logged in)

Convert - Virtuemart Plugin:

FREE!

Saturday, February 23, 13

Page 66: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

VISUAL WEB OPTIMIZER

#JDNC13 @SavvyPanda

By: Analytics for JoomlaMakes easier to add JS into your website

http://youtu.be/9pEU9MleWIIhttp://youtu.be/0S0IrbwpfzE

OPTIMIZLEY

Saturday, February 23, 13

Page 67: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

PRESS9 A/B TESTER

#JDNC13 @SavvyPanda

Easy JS Add innote: Joomla 1.5 Only :’-(

Saturday, February 23, 13

Page 68: Convert Smarter, Not Harder - A/B Split Testing

3RDPARTY

GOOGLE WEBOPTIMIZER

#JDNC13 @SavvyPanda

• Integrates with Adwords & Analytics

• Gives you a JS code to insert in head of the page you’re testing

FREE!

Saturday, February 23, 13

Page 69: Convert Smarter, Not Harder - A/B Split Testing

3RDPARTY

GOOGLE WEB OPTIMIZER

#JDNC13 @SavvyPanda

FREE!

Saturday, February 23, 13

Page 70: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 71: Convert Smarter, Not Harder - A/B Split Testing

EXAMINERESULTS

•What metrics were effected?•Did it match my hypothesis?•Were there any errors?

#JDNC13 @SavvyPanda

Iterate & Do Again!

Saturday, February 23, 13

Page 72: Convert Smarter, Not Harder - A/B Split Testing

THERE IS NO BAD TEST. AS LONG AS YOUR

LEARNING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 73: Convert Smarter, Not Harder - A/B Split Testing

WHAT IF YOU STILL HAVE

BADRESULTS?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 74: Convert Smarter, Not Harder - A/B Split Testing

LET’SIMPROVETHE CTA!

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 75: Convert Smarter, Not Harder - A/B Split Testing

#JDNC @SavvyPanda#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 76: Convert Smarter, Not Harder - A/B Split Testing

CRO IS ALL ABOUT INFLUENCING

CONVERSIONDECISION

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 77: Convert Smarter, Not Harder - A/B Split Testing

#JDNC @SavvyPanda http://www.slideshare.net/randfish/big-picture-cro

Saturday, February 23, 13

Page 78: Convert Smarter, Not Harder - A/B Split Testing

#JDNC @SavvyPandaSaturday, February 23, 13

Page 79: Convert Smarter, Not Harder - A/B Split Testing

IS IT THE RIGHT PRODUCT FOR THE RIGHT PEOPLE?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 80: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 81: Convert Smarter, Not Harder - A/B Split Testing

ACTION STEPS

1. DO MORE RESEARCH!SavvyPanda.com/BLOG

2. Perform your first test!

3. Ask Questions: SavvyPanda.com/ASK

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 82: Convert Smarter, Not Harder - A/B Split Testing

THANKS!

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 83: Convert Smarter, Not Harder - A/B Split Testing

QUESTIONS?LUKE SUMMERFIELD

#JDNC13@SAVVYPANDA

SLIDESHA.RE/13B2GOU

#JDNC @SavvyPandaSaturday, February 23, 13

Page 84: Convert Smarter, Not Harder - A/B Split Testing

http://www.flickr.com/photos/drachmann/327122302/sizes/l/in/photostream/http://www.flickr.com/photos/psit/4822614779/sizes/l/in/photostream/

http://www.flickr.com/photos/62337512@N00/2615993927/sizes/l/in/photostream/http://www.flickr.com/photos/ricardodiaz/3208220314/sizes/l/in/photostream/

http://www.flickr.com/photos/ter-burg/2381624640/sizes/l/in/photostream/http://www.flickr.com/photos/8113246@N02/4406950341/sizes/o/in/photostream/

http://www.flickr.com/photos/vintagedept/6358537847/sizes/l/in/photostream/http://www.flickr.com/photos/pennstatelive/6789813838/sizes/z/in/photostream/

http://www.flickr.com/photos/ianhaycox/128474639/sizes/m/in/photostream/http://www.robcottingham.ca/cartoon/archive/its-not-cheating-if/

http://www.flickr.com/photos/tonichu/458809478/sizes/z/in/photostream/http://www.flickr.com/photos/sonrisaelectrica/3695743740/sizes/l/in/photostream/

http://www.flickr.com/photos/clover_1/2259985318/sizes/l/in/photostream/http://www.flickr.com/photos/kalavinka/4617897952/sizes/z/in/photostream/

http://www.flickr.com/photos/aylaujp/543529949/sizes/z/in/photostream/http://www.flickr.com/photos/audiolucistore/7403731050/sizes/l/in/photostream/http://www.flickr.com/photos/marcosreis07/2997405848/sizes/l/in/photostream/http://www.flickr.com/photos/buckofive/6311309849/sizes/o/in/photostream/

PHOTO CREDITS:

#JDNC13 @SavvyPandaSaturday, February 23, 13


Top Related