![Page 1: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/1.jpg)
From Robotium to Appium: Choose Your Journey
Dmitry VinnikLead Software Engineer, Salesforce
![Page 2: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/2.jpg)
GoalsMobile End-to-End Testing: What, Why, How and When
Robotium vs Appium
Find Right E2E Tool For Your Team
What are our goals?
2
![Page 3: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/3.jpg)
Do you do manual testing?
3
Do you write automation?
![Page 4: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/4.jpg)
From the Top Level
4
How do we organize QA Effort?
Hint: It has 4 sides
![Page 5: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/5.jpg)
Agile Testing Quadrants
5
Testing Quadrants
From “Agile Testing: A Practical Guide for Testers and Agile Teams”by Lisa Crispin and Janet Gregory
![Page 6: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/6.jpg)
How do we usually test?Hint: It has 3 sides
6
Let’s go in more details
![Page 7: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/7.jpg)
Test Pyramid↑ Fidelity↓ Speed↑ Cost
↓ Fidelity↑ Speed↓ Cost 7
![Page 8: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/8.jpg)
Target PlatformsiOS
Android
Responsive Apps
Hybrid Apps
Target Platforms?
8
Android iOS
![Page 9: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/9.jpg)
Mobile is taking overMobile vs DesktopDesktop
Mobile
![Page 10: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/10.jpg)
Let’s see some dataBut “Mobile” is so broadAndroid
iOS
![Page 11: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/11.jpg)
Android is leadingFocus: Android
![Page 12: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/12.jpg)
Test Pyramid↑ Fidelity↓ Speed↑ Cost
↓ Fidelity↑ Speed↓ Cost 12
![Page 13: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/13.jpg)
Mobile Test Pyramid↑ Fidelity↓ Speed↑ Cost
↓ Fidelity↑ Speed↓ Cost 13
![Page 14: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/14.jpg)
Many E2E Testing Solutions
Calabash
UIAutomator MonkeyTalk
KIF
![Page 15: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/15.jpg)
Journey of Android E2E Testing
Android E2E Testing
Robotium Selendroid Appium
![Page 16: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/16.jpg)
Our Testing JourneyRobotium Selendroid
Appium
Selendroid
Appium
![Page 17: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/17.jpg)
Robotium: Architecture
RobotiumDevice
App Package
Test Package
Test Runner
![Page 18: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/18.jpg)
Robotium
Android Oriented
Blackbox Testing
User Centric ↓ Verbosity
![Page 19: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/19.jpg)
Robotium: Demo
Robotium
![Page 20: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/20.jpg)
Our Testing JourneyRobotium Selendroid
Appium
Selendroid
AppiumAppium
SelendroidRobotium
![Page 21: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/21.jpg)
Selendroid: Architecture
Selendroid
![Page 22: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/22.jpg)
Selendroid
Selenium Based
Multiple Devices
Gesture Support
Older Android API
![Page 23: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/23.jpg)
Selendroid: Demo
Selendroid
![Page 24: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/24.jpg)
Our Testing JourneyRobotium Selendroid
Appium
Selendroid
AppiumAppium
SelendroidRobotium
![Page 25: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/25.jpg)
Robotium vs Selendroid
Robotium vs SelendroidRobotium Category SelendroidRobotium Category Selendroid
Architecture
Robotium Category SelendroidActivity Architecture
Robotium Category SelendroidActivity Architecture App
Robotium Category SelendroidActivity Architecture App
Locator Strategy
Robotium Category SelendroidActivity Architecture App
By Android IDs
Locator Strategy
Robotium Category SelendroidActivity Architecture App
By Android IDs
Locator Strategy
By Selenium Locators
Robotium Category SelendroidActivity Architecture App
By Android IDs
Locator Strategy
By Selenium Locators
Gesture Support
Robotium Category SelendroidActivity Architecture App
By Android IDs
Locator Strategy
By Selenium Locators
Limitted Gesture Support
Robotium Category SelendroidActivity Architecture App
By Android IDs
Locator Strategy
By Selenium Locators
Limitted Gesture Support Extensive
![Page 26: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/26.jpg)
Our Testing JourneyRobotium Selendroid
Appium
Selendroid
AppiumAppium
SelendroidRobotiumRobotium Selendroid
Appium
![Page 27: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/27.jpg)
Appium: Architecture
AppiumDevice
Appium Client
Appium Server
Native Libraries App
![Page 28: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/28.jpg)
Appium
Selenium Based
Platform Agnostic
Language Agnostic
Developer Oriented
![Page 29: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/29.jpg)
Appium: Demo
Appium
![Page 30: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/30.jpg)
Appium: Four Pillars
AppiumProduction ->Test Ready
Loose Coupling
Standards Driven
Open Source
![Page 31: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/31.jpg)
Our Testing JourneyRobotium Selendroid
Appium
Selendroid
AppiumAppium
SelendroidRobotiumRobotium Selendroid
Appium
Selendroid
![Page 32: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/32.jpg)
Selendroid vs Appium
Selendroid vs AppiumSelendroid Category AppiumSelendroid Category Appium
Platform
Selendroid Category AppiumAndroid Platform
Selendroid Category AppiumAndroid Platform Any*
Selendroid Category AppiumAndroid Platform Any*
Android API Version
Selendroid Category AppiumAndroid Platform Any*
All* Android API Version
Selendroid Category AppiumAndroid Platform Any*
All* Android API Version Post API16
Selendroid Category AppiumAndroid Platform Any*
All* Android API Version Post API16
Advanced Web Tests
Selendroid Category AppiumAndroid Platform Any*
All* Android API Version Post API16
Limitted Advanced Web Tests
Selendroid Category AppiumAndroid Platform Any*
All* Android API Version Post API16
Limitted Advanced Web Tests Extensive
![Page 33: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/33.jpg)
Android is leadingBut iOS as important
![Page 34: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/34.jpg)
Our Testing JourneyRobotium Selendroid
Appium
Selendroid
AppiumAppium
SelendroidRobotiumRobotium Selendroid
Appium
SelendroidSelendroid
Appium
Robotium
![Page 35: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/35.jpg)
Robotium vs Appium
Robotium vs AppiumRobotium Category AppiumRobotium Category Appium
Coupling
Robotium Category AppiumTight Coupling
Robotium Category AppiumTight Coupling Loose
Robotium Category AppiumTight Coupling Loose
Device Support
Robotium Category AppiumTight Coupling Loose
Single Device
Device Support
Robotium Category AppiumTight Coupling Loose
Single Device
Device Support
Multiple Devices
Robotium Category AppiumTight Coupling Loose
Single Device
Device Support
Multiple Devices
Record & Play
Robotium Category AppiumTight Coupling Loose
Single Device
Device Support
Multiple Devices
Paid Plugin Record & Play
Robotium Category AppiumTight Coupling Loose
Single Device
Device Support
Multiple Devices
Paid Plugin Record & Play
Free, Desktop App
![Page 36: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/36.jpg)
Right Tool for the Right Problem
36
![Page 37: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/37.jpg)
Avoid Tool Mixups
37
No DDD
No Common Language
↑ Complexity
![Page 38: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/38.jpg)
How to Choose?
38
Github Repos
Twitter Activity
External Integrations POC
![Page 39: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/39.jpg)
But More Importantly
39
Flexibility
Use CaseUse Case
![Page 40: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/40.jpg)
Flexibility
40
Cost of Transition ROI
Ability to Replace
Ability to Customize
![Page 41: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/41.jpg)
But More Importantly
41
Flexibility
Use CaseUse Case
Flexibility
Use Case
![Page 42: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/42.jpg)
Use Case
42
Team Expertise
Application Framework
Test Infrastructure
![Page 43: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/43.jpg)
Scaling Up
43
BrowserStack
Devices
SauceLabs
OS Version
Going Forward
![Page 44: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/44.jpg)
Call For Action
Evaluate Test Architecture
Unify Test Strategy
Adapt to Change Experiment!
44
![Page 45: 1330 DmitryVinnik From Robotium to Appium Choose Your Journey … · 2019-11-27 · Advanced Web Tests Limitted Extensive. But iOS as importantAndroid is leading. Our Testing Journey](https://reader030.vdocument.in/reader030/viewer/2022041019/5ecd2c04c218a4188330b18f/html5/thumbnails/45.jpg)
Q/A
45