how to break your app - workshop - testbash 2015

37
1 26. März 2015 Customer Visual How to Break your App - Best Practices in Mobile App Testing Workshop Daniel Knott | @dnlkntt

Upload: daniel-knott

Post on 17-Jul-2015

999 views

Category:

Software


0 download

TRANSCRIPT

Page 1: How to Break your App - Workshop - Testbash 2015

1 26 Maumlrz 2015

Customer Visual

How to Break your App -Best Practices in Mobile App Testing

Workshop

Daniel Knott | dnlkntt

Who am I

bull Daniel Knott

bull Software Test Manager Mobile Tester AOE

bull Software Tester since 2008

bull Mobile Testing since the end of 2010

bull Author Blogger and Speaker

httpwwwadventuresinqacom

dnlkntt

httpwwwlinkedincompubdaniel-knott1a925993

httpswwwxingcomprofileDaniel_Knott

3 26 Maumlrz 2015

I Company Profile

Agenda

1 Current Status3 How to break your app

2 Exercise I

5 Summary and

Close Up

4 Exercise II

5 26 Maumlrz 2015

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

+19000 Android Devices

16 iOS Devices

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 2: How to Break your App - Workshop - Testbash 2015

Who am I

bull Daniel Knott

bull Software Test Manager Mobile Tester AOE

bull Software Tester since 2008

bull Mobile Testing since the end of 2010

bull Author Blogger and Speaker

httpwwwadventuresinqacom

dnlkntt

httpwwwlinkedincompubdaniel-knott1a925993

httpswwwxingcomprofileDaniel_Knott

3 26 Maumlrz 2015

I Company Profile

Agenda

1 Current Status3 How to break your app

2 Exercise I

5 Summary and

Close Up

4 Exercise II

5 26 Maumlrz 2015

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

+19000 Android Devices

16 iOS Devices

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 3: How to Break your App - Workshop - Testbash 2015

3 26 Maumlrz 2015

I Company Profile

Agenda

1 Current Status3 How to break your app

2 Exercise I

5 Summary and

Close Up

4 Exercise II

5 26 Maumlrz 2015

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

+19000 Android Devices

16 iOS Devices

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 4: How to Break your App - Workshop - Testbash 2015

Agenda

1 Current Status3 How to break your app

2 Exercise I

5 Summary and

Close Up

4 Exercise II

5 26 Maumlrz 2015

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

+19000 Android Devices

16 iOS Devices

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 5: How to Break your App - Workshop - Testbash 2015

5 26 Maumlrz 2015

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

+19000 Android Devices

16 iOS Devices

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 6: How to Break your App - Workshop - Testbash 2015

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

+19000 Android Devices

16 iOS Devices

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 7: How to Break your App - Workshop - Testbash 2015

Current Status | Some Numbers

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 8: How to Break your App - Workshop - Testbash 2015

Current Status | Mobile Testing is different

High User expectation

Lotrsquos of different devices with HW and SW

Users are on the move

Mobile Tools and Approaches

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 9: How to Break your App - Workshop - Testbash 2015

9 26 Maumlrz 2015

I Exercise I

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 10: How to Break your App - Workshop - Testbash 2015

Exercise I

Build up groups 2-5 person

Mind Map your challenges in mobile testing

20 minutes

Group discussion about the mind map

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 11: How to Break your App - Workshop - Testbash 2015

Exercise I

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 12: How to Break your App - Workshop - Testbash 2015

Challenges| How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the devices of your target group

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 13: How to Break your App - Workshop - Testbash 2015

Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt2048MB

bull Retina Full HD

Display gt= 5ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt=1024MB

bull Screen size lt= 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 14: How to Break your App - Workshop - Testbash 2015

Challenges | The User - KIFSU

Simple UseableFastItKeep

K I F S U

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 15: How to Break your App - Workshop - Testbash 2015

16 26 Maumlrz 2015

I How to break your app

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 16: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 17: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 18: How to Break your App - Workshop - Testbash 2015

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Specific Testing

bull Logout (English)

bull Ausloggen (German)

bull Deacuteconnexion (French)

bull Ccedilıkış yap (Turkish)

bull Выйти (Russian)

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 19: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770 Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 20: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 21: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 22: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 23: How to Break your App - Workshop - Testbash 2015

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Mobile Specific Testing

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 24: How to Break your App - Workshop - Testbash 2015

30 26 Maumlrz 2015

I Exercise II

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 25: How to Break your App - Workshop - Testbash 2015

Exercise II

Build up groups 2-5 person

Download a mobile app of your choice

Test it with provided scenarios

Note down the bugs

30 Minutes

Letrsquos talk about the bugs

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 26: How to Break your App - Workshop - Testbash 2015

Exercise II ndash My Bugs ndash Android Wordpress App

Using the app in bad network

conditions

Donrsquot show technical errors

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 27: How to Break your App - Workshop - Testbash 2015

Exercise II ndash My Bugs ndash Android Wordpress App

Provide user friendly error messages

Test app without backend

availability

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 28: How to Break your App - Workshop - Testbash 2015

Exercise II ndash My Bugs ndash Android Wordpress App

Language size

Test your app in different languages

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 29: How to Break your App - Workshop - Testbash 2015

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 30: How to Break your App - Workshop - Testbash 2015

Exercise II ndash My Bugs ndash Android Wordpress App

Localization problems

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 31: How to Break your App - Workshop - Testbash 2015

37 26 Maumlrz 2015

I Summary

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 32: How to Break your App - Workshop - Testbash 2015

Mobile Specific Testing | Summary

Mobile Testing is different compared to other software

Be creative and on the move while testing mobile apps

Be up to date Know your target group

Keep the mobile features in mind

Keep the high user expectations in mind

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 33: How to Break your App - Workshop - Testbash 2015

Thanks for your attention

wwwhandsonmobileapptestingcom

More information about mobile testing

can be found in my book

bdquoHands-On Mobile App Testingldquo

Soon available in a printed copy too

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 34: How to Break your App - Workshop - Testbash 2015

40 26 Maumlrz 2015

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 35: How to Break your App - Workshop - Testbash 2015

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 36: How to Break your App - Workshop - Testbash 2015

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 37: How to Break your App - Workshop - Testbash 2015