![Page 1: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/1.jpg)
A Data-Driven Approach to Testing the Right Devices, Platforms & User Conditions
![Page 2: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/2.jpg)
Today’s Speakers
Eran KinsbrunerMobile Technical EvangelistPerfecto
Amir GhodratiSr. Manager of Marketing InsightsApp Annie
![Page 3: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/3.jpg)
Agenda
05/03/2023 3© 2015, Perfecto Mobile Ltd. All Rights Reserved.
01 Digital Test Coverage Overview
02
Introduction to Real User Condition Testing03
New Index Edition Insights
04 App Annie Coverage Perspective
05 Q & A
![Page 4: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/4.jpg)
Introduction to User Condition TestingBringing the End User Into The Test Lab
Using a retail App
1 2
Network QualityCellular, Wi-Fi
3
Varied Device Conditions
4
Multiple devicesSpecific profiles
5
Location
6
Resource Conflicts
7
Interacting with sensorsPeak time -
Millions of transactions
8
Simple Functional Testing Is Not Enough05/03/2023 © 2015,Perfecto Mobile Ltd. All Rights Reserved. 4
![Page 5: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/5.jpg)
The Test Coverage Conversation – What To Answer?
Which Devices & Browsers? Which OS Versions? How Many platforms are enough? Under what user condition to test my app? When should I refresh my test lab? Who is in charge of coverage? How to size my lab across projects and teams?
05/03/2023 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 6: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/6.jpg)
Mobile Test Coverage Method
![Page 7: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/7.jpg)
Mobile Device Coverage - Attributes• Device and OS popularity (market share/usage)• Screen sizes, resolution and other screen attributes such as pixel per inch (PPI)• Device age (launch date)• Quality related issues (e.g. Android 5.1.1/Samsung S6)• New and trending devices and platforms• Operating system version update rate (e.g. reference devices like Android Nexus get a
higher score)• Unique device properties important for testing purposes – chipset, CPU, memory• Audience demographics
05/03/2023 7© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Reference Devices/OS
Popular Devices/OS
Legacy Devices/OS
Emerging Devices/OS
![Page 8: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/8.jpg)
What’s new?• App Annie App Usage• India Index Coverage
Digital Test Coverage Index 5th Edition
![Page 9: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/9.jpg)
2016 Calendar and Forecast
05/03/2023 9© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 10: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/10.jpg)
Top Used Android Apps May 2016 (U.S. Example)
05/03/2023 10© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Installing and Launching highly used apps per
regions as pre-condition test step for your App
![Page 11: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/11.jpg)
Index 5th Edition General Insights
• iOS 10 (iPhone 7) & Android N• Beta Testing Importance• Samsung Market Recovery• iOS vs. Android Tablet Market Diffs
05/03/2023 11© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 12: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/12.jpg)
We help build better app businesses
delivers data and insights to succeed in
the app economy
![Page 13: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/13.jpg)
16 Offices & 450+ Employees Worldwide
Raised $157M in Financing
![Page 14: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/14.jpg)
Most Trusted Partner in the App Economy
And many more…
Social
Investors
Platforms/ Mobile
Additional Industries
Games
Media/ Entertainment
![Page 15: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/15.jpg)
Why Mobile Apps?
![Page 16: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/16.jpg)
App Downloads Will Reach Over 288B by 2020
![Page 17: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/17.jpg)
App Economy will reach $102B in 2020
![Page 18: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/18.jpg)
Entertainment Apps Will Grow to Over $6B in Revenue in 2020
![Page 19: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/19.jpg)
Emerging Countries Will Account for 40% of App Store Revenue by 2020
![Page 20: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/20.jpg)
Apps Are Eating the Web
![Page 21: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/21.jpg)
85% of Consumers’ Time Spent in Apps
9 min.
Top 10 Mobile Browsers
Other Apps
![Page 22: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/22.jpg)
Time Spent in New Categories is Growing
![Page 23: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/23.jpg)
Apps Are Succeeding Across Multiple Sectors
![Page 24: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/24.jpg)
Nearly All B2C Industries Turning to Apps
Sector Companies Sales and Marketing
Product/Service Usage
Customer Service
Consumer Packaged Goods (CPG)
— —
Consumer Devices
Transport
Retail
Media
Financial Services —
MatureApp Usage
EmergingApp Usage
![Page 25: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/25.jpg)
Apps Cover Every Aspect of Our Daily Lives
Eat Social Work Travel
Dating Entertainment
Learn
Shop
Games Pay News Health
![Page 26: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/26.jpg)
Quick Service Restaurants
![Page 27: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/27.jpg)
McDonald’s Japan Ties Up with Pokémon Go
X
![Page 28: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/28.jpg)
Retail
![Page 29: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/29.jpg)
Walgreens Engages With “Print From Facebook” Ad Impressions Boost
#1 Advertiser by Share of Supersonic Ad Impressions
#32 Advertiser by Share of Supersonic Ad Impressions
Android Pay adds Walgreens for first retail store loyalty card integration
Aug 01 Aug 07 Aug 14 Aug 211
100
200
300
400
500
Download Rank HistoryUnited States - Aug 1, 2016 - Aug 27, 2016
![Page 30: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/30.jpg)
Retail Banking
![Page 31: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/31.jpg)
Consumers Banking on Apps Continues To Grow
Total Sessions in the Top 10 Retail Banking Apps*Android Phone
*Top Apps by monthly active users in each age group
![Page 32: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/32.jpg)
High Engagement for Retail Banking Apps Among Younger Users
Daily Sessions in Top 10 Retail Banking Apps* Per User
Android Phone, H1 2016
*Top Apps by monthly active users in each age group
![Page 33: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/33.jpg)
Media & Entertainment
![Page 34: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/34.jpg)
On-Demand Music and Video Apps Grow in Share of Wallet
![Page 35: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/35.jpg)
Usage Patterns Show Local Preferences for Music & Audio Apps
![Page 36: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/36.jpg)
User Conditions Affect Your App Testing
Strategy
![Page 37: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/37.jpg)
Test Most Used Apps No Longer Available in the App Store
Most Used Retail Apps in Germany Android Phone, May 2016
![Page 38: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/38.jpg)
Prioritize Apps that Cater to Local Preferences
Most Used M&E Apps in the United States Android Phone, May 2016
![Page 39: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/39.jpg)
Pre-installed Apps are Important to Overall User Experience
Most Used M&E Apps in Brazil Android Phone, May 2016
![Page 40: A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions](https://reader035.vdocument.in/reader035/viewer/2022062905/587271531a28ab31498b6a75/html5/thumbnails/40.jpg)
http://info.perfectomobile.com/digital-test-coverage-index.html
Audience Give Away – Free Index Download