gateway enterprise metrics documents - t1… · understand the uses and functionality 3) tsg...

Gateway Enterprise MetricsBenchmarking Your GatewayThis report is based upon information we consider reliable, but its accuracy and completeness cannot be guaranteed. Information provided is not all inclusive. All information listed is as available. For internal use only. Reproducing or allowing reproduction or dissemination of any portion of this report externally for any purpose is strictly prohibited and may violate the intellectual property rights of The Strawhecker Group. © Copyright 2019. The Strawhecker Group ®. All Rights Reserved. DISCLAIMER: The Strawhecker Group (TSG) is not endorsed, sponsored by, or in any other way affiliated with the any companies or their logos illustrated in this presentation. The trademarks shown are registered and their own. This document has not been prepared, approved, or licensed by any entity displayed.

BENCHMARKING YOUR GATEWAY

BEST OF BREED API

REAL TRANSACTION METRICS

ECOMMERCE MERCHANT EXPERIENCE

2CONFIDENTIAL. FOR DISCUSSION PURPOSES ONLY. © COPYRIGHT 2019. THE STRAWHECKER GROUP. ALL RIGHTS RESERVED.

Why Are We Here?To explore the best methods of benchmarking payment gateways from the merchant, developer and performance perspectives.

Today’s Topics:

PRESENTATION TEAM

Steve Vickers | Director of Revenue | MODERATORA long-standing payments industry veteran, Steve Vickers brings more than a decade of expertise within the merchant acquiring space. He has held management

positions at JPMorgan Chase, TSYS, and First National Bank of Omaha. As Director of Revenue and Growth, Vickers is responsible for delivering new and innovative

solutions to the consulting services of TSG.

Al Novacek | GEM Operations Manager | SPEAKERAl Novacek, TSG’s GEM Operations Manager, has over 20 years of experience in the merchant processing, credit card, and IT fields. As the GEM Operation Manager Al

handles the day-to-day operations of TSG’s Gateway Enterprise Metrics (GEM) product.

John Jakobe| Market Research Analyst| SPEAKERJohn Jakobe, a Market Research Analyst, focuses heavily on keeping the pulse of the payments industry and has personally contributed to numerous TSG research

projects, and has also become an expert in analyzing and researching strategic ISV partners for some of the largest payment companies in the industry.

John Kirkpatrick | Senior Associate | Q/AJohn Kirkpatrick brings more than 29 years of leadership experience developing and implementing complex global business strategies for companies of all sizes using

his extensive knowledge of technology valuations, gateways, and back-ends. Before joining TSG, Kirkpatrick was the Chief Information officer for six years at TransFirst

Chuck Fillinger | Senior Associate | Q/AChuck Fillinger, has substantial experience in the Electronic Payments Industry with over 30 years of experience, previously with First Data Corporation. He has proven

results working with merchants within all vertical markets, ISVs and VARs, gateway providers and acquirers, providing enhanced payment processing solutions on a

national and global scale.


The Strawhecker Group (TSG) is a fast-growing analytics and consulting firm focused on the electronic payments industry. The companyserves the entire payments ecosystem, from fintech startups to Fortune 500 companies. The firm provides its clients with advisory services,research and analytics to help them plan and execute their strategic initiatives. Based in Omaha, a recognized payments industry hub, TSG isan established leader in this high-growth, ever-evolving space.

ABOUT THE STRAWHECKER GROUP (TSG)

ManagementConsulting

Buy/SellConsulting

AIM:Acquiring

Industry Metrics

GEM:Gateway

Enterprise Metrics

Market Intelligence Services


5

DEVELOPERAPI Set &

Developer ToolsAssessment

PERFORMANCEReal Transaction

Metrics

MERCHANTeCommerce Merchant Experience & Account Boarding Assessment

Did you know there was anestimated 80 million of failedcredit and debit transactions inthe U.S. in 2018 because oftechnology failures?

Gateway Enterprise Metrics (GEM) is the only gateway focused platform in the market that benchmarks gateways from the merchant, developer and performance perspective.

GEM benchmarks the leading payment gateways against their competitors in the market in three distinct ways:

WHAT IS GEM?


6

June 2016

TSG had received multiple requests from gateways, acquirers, and merchants to benchmark gateway performance and boarding practices.

December 2016

TSG launches the Gateway Enterprise Metrics (GEM) platform

January 2018

GEM platform represents 50% of US eCommerce volume

February 2018

TSG launches 2017 Gateway Awards:• Transaction Performance• Onboarding Process• Startup eCommerce

May 2018


Enhancements In-Progress

• More Robust API Benchmarking• Portal Access• International Transaction Benchmarking• Card Present – EMV transactions

March 2017


GEM MILESTONES


BEST OF BREEDAPI

From a developers perspective, TSGhas reviewed the documentation andfunctionality of 16 leading PaymentGateway APIs.

1) Is used to understand how a gateway’s API can affect the merchant, developer, and ultimately the consumer

2) This report utilizes API documentation to understand the uses and functionality

3) TSG analyzes and scores 13 items to benchmark gateway APIs against one another


“BEST OF BREED” API

GATEWAY

API

RESPONSE CODES

VERSIONING

“Best of Breed” API INDEX SCORE

1 2 3 4 5 6 7 9 10 11 12 13 14 15 16

40 43 49 49 37 49 48 40 46 43 44 39 45 47 28 43

28 28 18 18 29 35 34 30 13 15 5 13 7 0 15 0

10 7 10 9 8 0 0 0 8 8 8 0 0 0 3 0

78 78 77 76 74 74 72 70 67 66 57 52 52 47 46 43

The maximum score for each area is:

API = 60Response Codes = 30

Versioning = 10

The chart below is a high-level scoring of 16 leading U.S. gateways’ API offerings.

Each gateway was assigned an overall performance score called the“Best of Breed” API Index.

Braintree vs. Top 15 Anonymous Gateways


Ratings Table

CompanyCompetitive API Ranking

(10 max pts)

API Descriptions are Understandable

(10 max pts)

Ease to Find Documentation

(10 max pts)

Flow/Layout of Documentation

(10 max pts)

API Title Matches Functionality (5 max pts)

API Categories Assessment(5 max pts)

Ranking Standard APIs

(10 max pts)

Score(60 = Max)

6 3 10 8 5 5 3 40

API Score

Areas Scored Description of Area Scored Explanation of Score

Competitive APIs ExistThere are 12 types of APIs that TSG has deemed as competitive APIs that are beneficial to handle essential payment processing

Braintree has the following competitive APIs – Charge / Sale, Refund – full, Refund - partial, Settle, Void Auth, and Void – Settle. The following competitive APIs Braintree doesn’t seem to support at this time are Auth - full, partial and reversal, Capture, Void –Charge/Sale, and Void – Refund, resulting in a 6/10 score.

API Description are Understandable

Does the description describe what the APIs main functionality is and how it works within the gateway

Some APIs have detail on what the API is doing, but most have very little explanation

Ease to Find Documentation

Can the documentation be found easily via a web search using the gateway name and API, documentation, or Sandbox.

The API information was able to be found with searching for “Braintree” with “Developer”

Flow/Layout of Documentation

Does the flow and layout of the documentation make sense and is it in logical order

The APIs are not in a logical order.

API Title Matches Functionality

Does the general description of the API match the detailed description of the APIs functionality

The API title matches the functionality of the title in all the different API sections

API Categories Assessment

Are the APIs broken down into clear and concise areas The APIs are broken down in alphabetical order

Ranking Standard APIsStandard API areas = ACH, AVS, Customer, Gift Card, Pricing, Security, Subscription, Token, and Wallet

The standard APIs of Customer, Plan, and Subscription – this results in a 3/10 score

“BEST OF BREED” BRAINTREE API


Ratings Table

CompanyResponse Descriptions are

Understandable(10 max pts)

Ease to Find Response Codes

(5 max pts)

Response Codes Categorized to Match API

Categories (5 max pts)

Technical Staff Needed

(10 max pts)

Score(30 = Max)

10 5 5 10 30

Response Codes Score


Response Descriptions are Understandable

Do the error descriptions make sense to help explain the true issue and how to address and fix it

The response codes are self explanatory and they are broken down into approved and decline codes. They also specify hard or soft declines so one has a better idea if the error/issue can be resolved immediately or not. They are also broken down into authorization, settlement, and AVS and CVV sections

Ease to Find Response Codes

How easy was it to find the response codes within the documentation The response codes were easy to find within the documentation

Response Codes Categorized to Match API Categories

Are the response codes categorized into different areas appropriately The response codes are setup and matched to the API categories accordingly.

Technical Staff NeededWill technical staff or assistance be needed to resolve the responses that have occurred

Technical staff will not be needed to know how to address the response code and get it resolved



Ratings Table

CompanyEase to Find (5 pts max)

Logical Versioning and Tags

(5 pts max)

Score(10 = Max)

0 0 0

Versioning Score


Ease to Find Can versioning be found within the documentation No versioning can be found

Logical Versioning & Tags

Is the versioning all together in one location, with details of what changes were implemented with each version. Is the versioning tagged within the document where the version was implemented.

No versioning can be found



Company Overall Notes/Comments:

Score =70(100 total = Max)

Rank: (8th out of 16)

APIs = Braintree has approximately 50% of what are considered to becompetitive APIs and offers very few of what are considered to be standardAPIs. The APIs descriptions do not offer enough detail in most cases on thefunction of the APIs. The API documentation could be found fairly easily withgeneral searches on the web.

Score = 40 out of 60Tied for 12th out of 16

Response Codes = Braintree did an excellent job of breaking down its responsecodes properly. They are very descriptive and self explanatory. They are putinto appropriate categories. Utilizing the hard and soft declines with responsecodes is a huge benefit in being able to resolve the response codes.

Score = 30 out of 301st out of 16

Versioning = Versioning is a very helpful to developers and an important part oftrouble shooting while testing and to track what was available on a gatewayover the time. This helps all those that use the gateway to ensure they areusing the current documentation, examples and have full use of functionality.Also, clear documentation on what is new functionality and backwardcompatibility is beneficial as well for developers.

Score = 0 out of 10Last out of out of 16



Q & A BREAK

“Since joining GEM we have worked closely with TSG to make tangibleadjustments. The GEM team has helped us better understand andimprove our platforms and integrations by bringing forward a customervantage point. Their expertise has been critical during this time.”

Wally Mlynarski, Chief Product Officer, Elavon

THE MORE YOU KNOWSeparately, TSG does conduct an actual integration with GEM subscribers to re-evaluate and deliver a detailed assessment of API set, Dev Tools, sandbox and emulators.


REAL TRANSACTIONMETRICS

All metrics are calculated byutilizing real cards to complete realtransactions, just as a consumerwould experience at a merchant.Not simulated.

1) Shows the merchant’s experience with the gateway, which is not always the same as internal monitoring would show

2) Gateway performance is becoming increasingly important because of the proliferation of IP transactions

3) Failures, unrelated to the cardholder account, equal approximately 15M credit/debit transactions each month (or $1.2B in lost sales)


TSG sends real transactions from two locations and pings 24/7/365 from five

different U.S. locations


Each gateway receives a weighted score within each category based on their performance called the GEM Index

TSG Measures and Benchmarks Gateways Based on:

1) Response Time2) Gateway Access3) Gateway Availability4) Transaction Average Response Time5) Transaction Success Rate6) Authorization Failures


16

The best possible score is 100:• Gateway Access = 5 pts • Gateway Availability = 15 pts • Transaction Average Response Time =30 pts • Transaction Success Rate = 25 pts • Authorization Failures = 25 pts

GATEWAY

GATEWAY ACCESS

GATEWAY AVAILABILTIY

TRANSACTION AVERAGE RESPONSE TIME

TRANSACTION SUCCESS RATE

AUTHORIZATION FAILURES

GEM INDEX SCORE

1 2 3 4 5 6 7 8 9 10 11 12

5 3 5 5 5 5 0 5 4 5 5 5

15 15 15 15 15 15 9 15 12 15 15 15

30 30 30 18 12 18 30 18 6 0 6 6

25 25 20 25 25 15 15 15 25 25 15 20

25 25 25 25 25 25 20 20 25 25 25 20

100 98 95 88 82 78 74 73 72 70 66 66


January 2019 GEM Index


17


TRENDING: Gateway Response Time by Week (%)

08/13/18 – 02/16/19

Note: Data may be adjusted for trending purposes

0.075

0.1

0.125

0.15

0.175

0.2

0.225

0.25

0.275

0.3

0.325

0.35

0.375

0.4

0.425

0.45

Aug 13-19,

2018

Aug 20-26,

2018

Aug 27-Sep 02,

2018

Sep 03-09,

2018

Sep 10-16,

2018

Sep 17-23,

2018

Sep 24-30,

2018

Oct 01-07,

2018

Oct 08-14,

2018

Oct 15-21,

2018

Oct 22-28,

2018

Oct 29-Nov 04,

2018

Nov 05-11,

2018

Nov 12-18,

2018

Nov 19-25,

2018

Nov 26-Dec 02,

2018

Dec 03-09,

2018

Dec 10-16,

2018

Dec 17-23,

2018

Dec 24-30,

2018

Dec 31-Jan 06,2019

Jan 07-13,

2019

Jan 14-20,

2019

Jan 21-26,

2019

Jan 27-Feb 02,

2019

Feb 03-09,

2019

Feb 10-16,

2019

Top Gateway Bottom Gateway All Gateways

Best


18



0.5

0.75

1

1.25

1.5

1.75

2

2.25

2.5

2.75

3

3.25

3.5

3.75

4

4.25

4.5

Aug 13-19,

2018

Aug 20-26,

2018

Aug 27-Sep 02,

2018

Sep 03-09,

2018

Sep 10-16,

2018

Sep 17-23,

2018

Sep 24-30,

2018

Oct 01-07,

2018

Oct 08-14,

2018

Oct 15-21,

2018

Oct 22-28,

2018

Oct 29-Nov 04,

2018

Nov 05-11,

2018

Nov 12-18,

2018

Nov 19-25,

2018

Nov 26-Dec 02,

2018

Dec 03-09,

2018

Dec 10-16,

2018

Dec 17-23,

2018

Dec 24-30,

2018

Dec 31-Jan 06,2019

Jan 07-13,

2019

Jan 14-20,

2019

Jan 21-26,

2019

Jan 27-Feb 02,

2019

Feb 03-09,

2019

Feb 10-16,

2019


TRENDING: Transaction Average Response Time by Week (Seconds)

08/13/18 – 02/16/19

Best


19



-0.01

0.01

0.03

0.05

0.07

0.09

0.11

0.13

0.15

0.17

0.19

0.21

0.23

Aug 13-19,

2018

Aug 20-26,

2018

Aug 27-Sep 02,

2018

Sep 03-09,

2018

Sep 10-16,

2018

Sep 17-23,

2018

Sep 24-30,

2018

Oct 01-07,

2018

Oct 08-14,

2018

Oct 15-21,

2018

Oct 22-28,

2018

Oct 29-Nov 04,

2018

Nov 05-11,

2018

Nov 12-18,

2018

Nov 19-25,

2018

Nov 26-Dec 02,

2018

Dec 03-09,

2018

Dec 10-16,

2018

Dec 17-23,

2018

Dec 24-30,

2018

Dec 31-Jan 06,2019

Jan 07-13,

2019

Jan 14-20,

2019

Jan 21-26,

2019

Jan 27-Feb 02,

2019

Feb 03-09,

2019

Feb 10-16,

2019


TRENDING: Authorization Failures by Week (Aggregate %)

08/13/18 – 02/16/19

Best


Q & A BREAK

“After receiving the weekly GEM reporting on gateway transactionperformance (ours vs. the market), we made the strategic decision toallocate additional resources to help maximize our gateway’stransaction speed.”

Ted Cucci, President & CEO, Fluid Pay

THE MORE YOU KNOWTSG is currently testing international pings/transactions as well as exploring card-present EMV transactions


ECOMMERCEMERCHANTEXPERIENCE

For this exercise, TSG completes anactual (anonymous) process ofopening a new merchant accountto obtain the ability to accept cardsonline.

1) This process measures and benchmarks the experience from the merchant’s point of view and is compared against the industry’s top 14 providers

2) Helps understand the varying degrees of difficulty that startup, SMB eCommerce merchants face when attempting to begin processing online payments

3) TSG rates providers across seven different categories: website, shopping cart, application, underwriting, integration, cost and time to launch



Mystery Shopping ProcessTSG tests and logs the process of going from “cradle to grave” as a small, new startup merchant.

1) Website Launch: ability to purchase, register, and customize website

2) Shopping Cart: ability to purchase, integrate, and install

3) Sales Process: reflects the time, effort, and complexity of the sales process

4) Underwriting: scrutiny of website and company information, based upon items required

on application

5) Estimated Integration Time: estimated amount of time for integration to be completed

6) Total Cost: combined score based upon the four pricing categories• Website Costs: fee for website building services – referred by sales representative or marketed

partnership

• Gateway Costs: monthly gateway fee

• Processing Costs: cost to process transaction through gateway

• Other Costs: other costs incurred by merchant during sales/setup processes

7) Ease to Launch: overall time and difficulty22CONFIDENTIAL. FOR DISCUSSION PURPOSES ONLY. © COPYRIGHT 2019. THE STRAWHECKER GROUP. ALL RIGHTS RESERVED.

Entrepreneur

Accounting & Reporting

Shopping Cart

WebsitePayments

Shipping



For each acquirer, TSG utilized the website building service thatwas recommended by the acquirer’s sales representative. If awebsite service was not recommended, TSG utilized a servicethat was marketed by the acquirer as an integration option. If noservice was marketed or recommended, TSG utilized Shopify,Wix.com, or Ecwid.

Startup SMB Website for T-Shirt Store



THE SCORES1) Reflect the ease of acceptance for a startup, SMB eCommerce retail merchant via the digital sales channel from the merchant perspective

2) Reflect only the onboarding process of startup SMB eCommerce merchants

3) Reflect only the onboarding ease for the products/services described

4) Reflect only the process of digital sales channel available via each acquirer

Total Score – SMB eCommerce Mystery Shopping35 = Highest Possible Score (Easiest Onboarding from Merchant Perspective)

27



All ratings are from the merchant perspective, in regards to the overall level of difficulty experienced when attempting to accept credit cards online.

GATEWAYWEBSITE LAUNCH

SHOPPING CART APPLICATION UNDERWRITING INTEGRATION COSTTIME TO LAUNCH SCORE

(35 = MAX)

Company Here Rating Here Rating Here Rating Here Rating Here Rating Here Rating Here Rating Here Rating Here



● ● ● ●●

<1 Day● ● 27





Average 2.6 2.6 4.0 3.5 4.0 2.7 3.7 23.1

● Easy ● Fairly Easy ● Neutral ● Fairly Difficult ● Difficult5=Easy, 1= Difficult

• 3rd Party = (requires merchant to find this solution)• 3rd Party Integration = (requires third-party services that have already been integrated with the provider)• Seamless in-house or white-labeled solution =

●●

●



Company Website CostsGateway

CostsProcessing Costs Other Fees

Total 1 Month Cost(Assumes Monthly Credit Card Processing

Volume of $1,000 and 50 credit card transactions and Standard Interchange of

2.40% + 0.10 per transaction)

Estimated Annual All

Inclusive Cost

Annual Cost RankOut of 14

Company Here Data Here Data Here Data Here Data Here Data Here Data Here Data Here



Big Commerce: $29.95/month

$0 – No FeeFlat Fee: 2.9% + 0.30 per

transaction($44)

$0 – No Fee $73.95 $887.40 7th



All ratings are from the merchant perspective, in regards to the overall level of difficulty experienced when attempting to accept credit cards online.

PRICING


Required Information for Merchant Application

Company Here Company Here Company Here Company Here Company Here Company Here Company Here

Business Name - - - X - - - -

Address - - - X - - - -

Banking Information - - - X - - - -

Business Type (LLC, Sole, Corp, Gov) - - - X - - - -

Card Acceptance Method (Keyed vs. Swiped)

- - - - - - - -

Date of Birth - - - X - - - -

DBA - - - - - - - -

Email - - - X - - - -

Estimated Annual Volume - - - X - - - -

Estimated Average Ticket - - - X - - - -

Estimated Highest Ticket - - - X - - - -

Estimated Monthly Volume - - - - - - - -

Federal Tax ID - - - - - - - -

Full Social Security Number - - - - - - - -

Last Four of Social Security Number - - - X - - - -

Number of Employees - - - - - - - -

Personal Guarantee - - - - - - - -

Phone - - - - - - - -

Products/Services - - - - - - - -

Website - - - X - - - -

Years in Business - - - X - - - -

Days to Product Delivery - - - X - - - -

Industry (MCC) - - - X - - - -

Percent Ownership - - - X - - - -

Drivers License - - - - - - - -

Address Verification (utility bill, electric bill, etc.)

- - - - - - - -

Voided Check - - - - - - - -


UNDERWRITING X = Required


Required Website InformationFor Underwriting

Company Here Company Here Company Here Company Here Company Here Company Here Company Here

Card Brand Logos - - - - - - - -

Contact Information - - - - - - - -

Cost of Products Listed in USD

- - - - - - - -

Order Cancelation Policy - - - - - - - -

Privacy Policy - - - - - - - -

Return/Refund Policy - - - X - - - -

Shipping Policy - - - - - - - -

Terms and Conditions - - - - - - - -

Requires No Website Information(Not Included in Total Calculation) - - - - - - - -

34 = Maximum Number of Possible Xs

Total Underwriting Score - - - 16 - - - -

(Calculated by number of X’s)


UNDERWRITINGX = Required


Company Overall Notes/Comments Score: (35 = Max)Rank: (Out of 14)

Company Here Data/Comments Here Data Here



Application can be completed via an online form on Braintree’s website that takes only a matter of minutes to complete. The applicant is then notified of approval via email typically within 24 hours of initial application. The overall process is extremely straightforward. Leveraging BigCommerce allowed for smooth integration and a more seamless merchant experience than most legacy providers. Overall the entire process can be completed in a day or two.

27Rank: 5th




Q & A BREAK

“Through GEM we have been able to leverage a credible, third-partyplatform to highlight our strengths in comparison to the market. We areadjusting our marketing to illustrate our prowess to clients andprospects.”

Marco Leardini, President, EpicPay

THE MORE YOU KNOWThe average number of pages in an application is approximately 14, while the average number of days it takes the merchant to receive an application is two.


32

EASY CREDIBILITY

Awards Calendar• “The Developer/API Awards” – MARCH

• “The Performance Awards” – MAY

• “The Merchant Awards” – OCTOBER

Market Your ProwessGEM provides gateways with third-party credibility andallows them to market their performance publicly toprospects and current clients. Recognition from TSG’sGateway Awards provides further honor for gateways tohang their hat on.

Something From NothingGEM is not dependent on a gateway’s IT resources.Minimal interaction is required to board a gateway onthe GEM platform. Allocation of resources is at thediscretion of the subscriber and their performance goalsbased on GEM data.

RECENT WINNERS


THANK YOUQuestions about GEM? Contact Steve Vickers: [email protected]

This report is based upon information we consider reliable, but its accuracy and completeness cannot be guaranteed. Information provided is not all inclusive. All information listed is as available. For internal use only. Reproducing or allowing reproduction or dissemination of any portion of this report externally for any purpose is strictly prohibited and may violate the intellectual property rights of The Strawhecker Group. © Copyright 2019. The Strawhecker Group ®. All Rights Reserved. DISCLAIMER: The Strawhecker Group (TSG) is not endorsed, sponsored by, or in any other way affiliated with the any companies or their logos illustrated in this presentation. The trademarks shown are registered and their own. This document has not been prepared, approved, or licensed by any entity displayed.

gateway enterprise metrics documents - t1… · understand the uses and functionality 3) tsg...

Documents