choose the right devices for testing this quarter
TRANSCRIPT
![Page 1: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/1.jpg)
Choose the Right Devices for Testing this Quarter
August, 2015
Eran KinsbrunerDir, Product MarketingMobile Technical EvangelistPerfecto Mobile
![Page 2: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/2.jpg)
Some Housekeeping before we start
Submit questions using the Q&A
panel.
Participate in the polls
Watch your email for a copy of the
recording and slides
Complete the survey following the presentation
![Page 3: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/3.jpg)
Agenda
• Framework and methodology• 2nd Edition index drill down and insights• Adding your own analytics• Heads-up – market calendar• Q &A
![Page 4: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/4.jpg)
Introducing Perfecto Mobile
Dominant leader & visionary
Strong Ecosystem
Perfecto @ a glance
Partnering with Enterprises to create better mobile apps faster with continuous quality
“Perfecto Mobile marks shift in mobile apps QA with Continuous Quality Lab”
4
Setting the bar for market success
• Founded in late 2006, Business HQ in Boston • Over 200 employees globally• Fortune 500 customer base
![Page 5: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/5.jpg)
The Continuous Quality Coverage Framework™ Answer the customer’s most common question:
“Which devices/form factors should I test to assure sufficient
market coverage?”
![Page 6: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/6.jpg)
It’s Fundamental all around
For the Business it’s market coverage
• Great end user experience
• Build requirement for IT
• Optimize user engagement & rating
For the Dev/QA it’s test coverage
• Optimize process
• Discover bugs early, mitigate risk
• Continuously test on what matters
![Page 7: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/7.jpg)
Digital Predator Or Digital Prey?
![Page 8: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/8.jpg)
Mobile Test Coverage Index – 2nd Edition Aug 2015
• Market Analysis • 4,000+ Devices• 460,000 Hours of Mobile
Cloud Testing
![Page 9: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/9.jpg)
New!
![Page 10: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/10.jpg)
Mobile Test Coverage Index – Q2 2015 Key Insights & Trends
iOS & Android Shares:• iOS dominates U.S• Android in Europe is as
follows:• Clear win in Germany • Samsung & Apple are
the same in UK• EU5 aggregated –
Android wins
Nexus Devices Share• Small both in U.S and
Europe• Must be included in each
Index!
Trends & Q3• Huawei is the 3rd smartphone
vendor worldwide • Its new Ascend P8 marked as
strong leader!• Key iOS & Android Releases in Q3
• Android M 6.0 ( LG & Huawei)• iOS 9 (iPhones 6S/6S
Plus/iPad Pro (12.9’’))• Legacy devices are critical (Samsung
S3 e.g.)
![Page 11: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/11.jpg)
Global Mobile Market Share – Q2 2015
Source: Strategy Analytics
Global Mobile Phone Vendor Marketshare (%) Q2 ‘14 Q2 ‘15
Samsung 22.3% 20.5%
Apple 8.2% 10.9%
Huawei 4.8% 7.0%
Microsoft 11.8% 6.4%
Xiamoi 3.5% 4.6%
Others 49.4% 50.6%
Total 100.0% 100.0%
One of the 2 new Google Nexus Devices
![Page 12: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/12.jpg)
85%
3% 2%
iOS 8iOS 7Earlier
Which OS versions and Screen sizes to include in the mix?JellyBeans & KitKat == ±74% distribution
Lollipop – Must OS in any Index
Legacy devices – still uses GingerBread & ICSAndroid Marshmallow (6.0) – Beta available today for testing on Nexus devices
• Minimum of 6 devices (Smartphones & Tablets)• * iOS 9 Beta – Must be
included
Minimum of 8 devices(Smartphones & Tablets)
![Page 13: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/13.jpg)
Index Aug-2015 Edition
![Page 14: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/14.jpg)
Poll
What is the minimal number of devices & OS’s mix (iOS/Android) which you currently test on?
![Page 15: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/15.jpg)
Coverage Target
The minimal recommended device list matched to relevant OS list
Additional devices and OS for enhanced 50% market coverage
Highest recommended coverage of Devices and OS’s with more legacy and new devices/OS’s included
80%50%30%
10-16Devices
17-25Devices
26-32Devices
![Page 16: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/16.jpg)
U.S Index Q2 2015
Nexus DevicesLegacy Devices
![Page 17: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/17.jpg)
UK Index Q2
![Page 18: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/18.jpg)
UK Index Q2
iPhones & Samsung – Top 5
Top Windows PhoneDevices
![Page 19: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/19.jpg)
Germany Index Q2
![Page 20: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/20.jpg)
Germany Index Q2 2015
Legacy & Critical
Emerging In EMEA
Samsung Dominates In Germany
![Page 21: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/21.jpg)
Sony Xperia M5Sony Xperia C5 Ultra
![Page 22: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/22.jpg)
Test Coverage Optimization Process2. Lab Sizing
Me
Analytics
Teams Projects
SDLC Cycle
Requirements
v
Market
My Space
Popular & emerging
The Index
1. Coverage
Industry trends & insights
![Page 23: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/23.jpg)
Which device types to include in the mix?
Reference Devices/OS
Popular Devices/OS
Legacy Devices/OS
Emerging Devices/OS
![Page 24: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/24.jpg)
v
Analytics-based profiling
Product/ marketing requirements
“ Look inside yourself and you Can see the universe.”- Brian Herbert
![Page 25: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/25.jpg)
Case Studies
• Large European Company– Preliminary Index overview– Analytics received & Analyzed– Enhanced Index/Coverage achieved(Merge &
Complement) with focus on:• New & Upcoming devices & OS’s• Android Tablets• Refresh Rate
![Page 26: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/26.jpg)
v
22%
64%
14%
VisitsAndroid iOS Blank
32%
56%
12%
LoginsAndroid iOS Blank
Transactions OS Breakdown
![Page 27: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/27.jpg)
Recommended List --------------
With 25% Device Refresh Rate (Quarterly)
![Page 28: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/28.jpg)
What does it take to cover the REALend user experience?
v
Device & Platform
Model
OS Version
Screen Size
Form Factors v
Environment
Location
Network
v
Conditions
Signal Strength
Load
Others
![Page 29: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/29.jpg)
Stay Engaged
• Mobile Test Coverage Download Page– http://go.perfectomobile.com/test-coverage-index/
• LinkedIn Group– https://www.linkedin.com/grp/home?gid=8358292
![Page 30: Choose the right devices for testing this quarter](https://reader036.vdocument.in/reader036/viewer/2022062401/58f217f81a28ab72738b4595/html5/thumbnails/30.jpg)
Thank You
Please Remember To Complete The Survey