optimizely experience - donorschoose.org

16

Upload: optimizely

Post on 01-Nov-2014

299 views

Category:

Documents


4 download

DESCRIPTION

This presentation was given at the Optimizely Experience New York City by Optimizely customer - DonorsChoose.org

TRANSCRIPT

Page 1: Optimizely Experience - DonorsChoose.org
Page 2: Optimizely Experience - DonorsChoose.org

Charlotte WeiskittelSenior Director, Product

Page 3: Optimizely Experience - DonorsChoose.org
Page 4: Optimizely Experience - DonorsChoose.org
Page 5: Optimizely Experience - DonorsChoose.org

TESTING QUEUE

Page 6: Optimizely Experience - DonorsChoose.org

ANALYSIS

Page 7: Optimizely Experience - DonorsChoose.org

STAR VS. HEART

• Heart led to 135% increase in favorites; small bump in conversion

• But not on mobile?

Page 8: Optimizely Experience - DonorsChoose.org

MONTHLY DONATIONS

Page 9: Optimizely Experience - DonorsChoose.org

REMOVE $500 AND $1,000

Removing biggest amounts from dropdown increased conversion by 58%.

Page 10: Optimizely Experience - DonorsChoose.org

PHOTO AND TAGLINE

1. A teacher spends $40 each month on classroom essentials.

2. Make giving a monthly habit.

3. Join the 3,500 people who support a classroom every month.

4. Help a classroom every month.

• Female teacher performed best with 3 of 4 taglines

• “Join 3,500 people…” did slightly better than the original, but it wasn’t significant

Page 11: Optimizely Experience - DonorsChoose.org

CHARGE YOUR CARD NOW – OR IN A MONTH?

Removing mention of the next month increased conversion 217%.

Page 12: Optimizely Experience - DonorsChoose.org

$50, $25 OR NO INCENTIVE• Conversion rate

- $50 incentive: 1.8%

- No incentive: 1.6%

- $25 incentive: 1.3%

• The no incentive group was the least likely to cancel after two months (8%)

• The no incentive group had the highest average monthly signup amount of $26

Page 13: Optimizely Experience - DonorsChoose.org

BUTTONS INSTEAD OF A DROPDOWN

• The buttons saw a 32% decrease in conversion compared to the dropdown

• “No thanks” as text converted 68% better, but at the expense of donors reaching the Thank You screen

• “Most popular” converted terribly and was paused mid-experiment

Page 14: Optimizely Experience - DonorsChoose.org

TESTING PHILOSOPHY

• Just start testing

• Clear the path for the tester

• Solve “I think…” debates

• Look at the results holistically, not just A vs. B

Page 15: Optimizely Experience - DonorsChoose.org
Page 16: Optimizely Experience - DonorsChoose.org