Continuous Deployment and Testing for Mobile AppsThe Cloud Revolution You’ve Never Heard Of
Mark Prichard
@CloudBees
2
Mark Prichard – My Back Pages
©2011 CloudBees, Inc. All Rights Reserved
• Cambridge University Computer Lab, 1990-1991
• Logica/SHL/CSC: 1991-2000– Integration/Middleware Specialist– Managing Consultant
• BEA Systems, 2000-2008– Senior Architect, EMEA– Director, Java Virtualization
• Oracle, 2008 -2012– WebLogic Platform PM– FMW Web Tier PM
• CloudBees, 2012– Senior Director of Product
Management
@mqprichard [email protected]
blogs.cloudbees.comClouds, Bees and Blogs
3
• Quick Introduction to CloudBees and PaaS• Building Apps in the Cloud• Continuous Integration for iOS and
Android• Gesture-aware touch testing• Multi-configuration mobile testing• Beta test distribution• Mobile + PaaS models• AWS and the Token Vending Machine
Today’s Agenda
4
• Free and complete for developers• Get started with just a couple of
clicks: all you need is a browser
www.cloudbees.com/signup
Step 1 - Sign Up with CloudBees
5
What’s a Platform?
• Something you can use to – Run your apps– Build your apps– Add services to your apps–Manage your apps
• Plaform-as-a-Service (PaaS) uses elastic, on-demand Cloud resources to do this
6
CloudBees Is a Platform Delivered As A Service
cloudbees.com
JenkinsMaster
Test
Stage
Build
Code
JenkinsExecutor
Forg
e R
ep
osit
ori
es
Git
SVN
mvn
Development Services
(DEV@cloud)
Developer and OperationsInteraction
End User Interaction
Runtime Services
(RUN@cloud)
CloudBees API
Grand Central Web
Console
SDK
SessionClustering
MySQL
Router
Application
PartnerEcosystem
6
©CloudBees, Inc. All Rights Reserved
7
Cloud Terminology
• Infrastructure-as-a-Service (IaaS)– Think: Amazon Web Services–What: Server Instances, Storage
Buckets etc
• Software-as-a-Service (SaaS)– Think: Salesforce.com–What: Packaged Applications (in the
Cloud)
• Plaform-as-a-Service (PaaS)–What: Managed Service for Custom
Apps
8
What is Platform-as-a-Service?
• We run your applications for you• We provide and manage all the
supporting infrastructure needed to run your apps
• We monitor and can scale out your apps
• We provide a full, enterprise-class build environment using Jenkins CI – the world’s #1 OSS continuous integration server
• You write the code and we do all the rest
9
Have You Met Jenkins?
• #1 OSS CI server• Easy to install/use• Extensible via 600+ plugins• Very widely adopted– 47K+ installations
• Very active community– Over 7 years of history, 440+ releases– 600+ plugins, 300+ developers
• CloudBees adds plugins for cloud builds
10
CloudBees Step-by-Stepcloudbees.com
JenkinsMaster
Test
Stage
Build
Code
JenkinsExecutor
Forg
e R
ep
osit
ori
es
Git
SVN
mvn
Development Services
(DEV@cloud)
Developer and OperationsInteraction
End User Interaction
Runtime Services
(RUN@cloud)
CloudBees API
Grand Central Web
Console
SDK
SessionClustering
MySQL
Router
Application
PartnerEcosystem
Multi-Tenanted
Dedicated
Amazon Web Services
10
©CloudBees, Inc. All Rights Reserved
11
What Platform-as-a-Service Is Not
• Commercial, packaged applications don’t usually run on a PaaS
• You don’t need to purchase any hardware or software licenses
• You won’t have to install anything – you just deploy your Java apps to the platform
• If you need to run applications in your own data center, PaaS may be the wrong model
12
Getting Started: CloudBees ClickStarts
©2012 CloudBees, Inc. All Rights Reserved
The easiest way to get started – and learn new technologies
13
cloudbees.com
What’s up with this new framework!
What Did I Just Do?
13
CloudBeesGit
Repo
Database
Build/Test
db:create
App
PartnerServicePartner
Service
CloudBees API
Grand Centra
l Web
Console
app:creategit clone
Jenkins job create
Bind
Bind
Trigger
Deploy
Wow! At yourservice
©2013 CloudBees, Inc. All rights reserved
14
cloudbees.com
Develop Locally, Build in the Cloud
CloudBeesGit
Repo
Database
Build/Test
App
PartnerServicePartner
Service
Bind
Bind
TriggerDeployI want to make
some changes!
Local GitRepo
git clonegi
t com
mit git push
Chan
ges
Wow! At yourservice
First Demo• Complete Application with its full lifecycle, in a
click ClickStart
• No resource other than a laptop, everything else is in the cloud
• No need to deal with IT either!
• You can create your own ClickStart-s if you want
• Templates, etc.
• Pay as you go (to production), scale as you need, full HA, etc. Not just a development workbench!
Second Demo: All Mobile!
• Complete Chess application for iOS & Android
• Covered:
• Where to store app, how to build, how to test, how to distribute, etc.
• NOT Covered:
• iOS/Android app coding itself
• WARNING: testing is especially important for mobile applications – most users won’t give it a second chances!
#fail #fail #fail
Typical flow/pipeline
CodeBuild App
Code
BuildTest
Deploy
TestBetaDeplo
y
GADeplo
y
• Get started fast!
• Team Work• Automatically
push new code to test
#fail
• Build on several targets: iOS, Android, etc.
• If it fails, stop
• Test is costly!• Easy-first, then
increase!• Basic test• Multi-device• Gesture• Etc.
• If it fails, stop
• Deploy in the field on real users
• Gather input• Retrieve
dumps• Etc.• If it fails, stop
• D-Day! • Push apps to
real-life users!• If it fails, stop
Step 1 - CODE• Typically using a mobile-specific environment/IDE
• Store code on Github or at CloudBees (SVN/Git)
• As soon as a code change occurs, validates!
• notification sent to Jenkins, initiate pipeline
• Idea!
• Use a ClickStart to “templatify” a typical mobile project
• License headers, splash screen, login, back-end REST API, etc.
Step 1 - CODE• You can look at a mobile ClickStart:
• Android: https://github.com/mqprichard/stockfishchess-android
• iOS: https://github.com/mqprichard/stockfishchess-ios-app
Step 2 - BUILD• Android
• Easy! Android_[SDK | NDK] available in the cloud, build on linux machine on DEV@cloud
• iOS
• Requires Mac OS X guest to build
• Not available (yet) at CloudBees
• Impossible?
Step 2 – iOS BUILD• Mac Build Attach your own Mac
Jenkins
Master
Jenkins Slave
DEV@cloud
Jenkins Slave
DEV@cloud
Jenkins Slave
DEV@cloud
Jenkins Slave
PRIVATE
Preparing a mobile build slave
• Install Android SDK and NDK, install git (if using it), wget, etc.
• Modify ~/.bash_profile
• Create ANDROID_SDK and ANDROID_NDK
• add A_S/tools and A_S/platform_tools to path
• Install Xcode
• Launch to accept license
• Go in preferences, install command line tools and emulator(s)
• Type “android” on command line
• Add SDK versions + System images (ARM EABI, etc.)
Step 2 – iOS BUILD• Install Jenkins Java CLI agent on Mac
• Launch:
• enjoy
java -jar jenkins-cli.jar -s https://partnerdemo.ci.cloudbees.com -i ~/.ssh/id_rsa customer-managed-slave
-fsroot ~/tests/jenkins/ROOT/ -labels android -labels xcode -executors 4 -name mobile-slave-sacha-laptop
http://wiki.cloudbees.com/bin/view/DEV/Customer+Provided+Slaves
Step 2 - BUILD• Good Reads
• Continuous Deployment for Mobile Apps with Jenkins: iOS Builds
• http://blog.cloudbees.com/2012/09/continuous-deployment-for-mobile-apps.html
• Continuous Integration for Mobile Apps with Jenkins: Android Builds
• http://blog.cloudbees.com/2012/09/continuous-integration-for-mobile-apps.html
• http://www.youtube.com/user/CloudBeesTV
Step 2 - BUILD• Next:
• Details of an iOS build
Replay: http://youtu.be/DinMVVKHwTU
• Details of an Android Build
Replay: http://youtu.be/EOogyOv79NE
Step 3 - TEST• Lots of different testing is possible
• Launching an emulator is level-0 of testing
• SOASTA TouchTest:
• http://youtu.be/ej21BHCxEaI
• http://blog.cloudbees.com/2012/11/continuous-integration-for-mobile-apps.html
SOASTAWrapper
TouchTest - Setup
AppSOASTA
SaaS
register
iOSiOS
iOSregister
TouchTest - Record
SOASTA
Wrapper
App
SOASTASaaS
deploy iOS
Recordgestures
TouchTest – Replay/test
SOASTASaaS
iOSiOS
iOS
Upload App & Replay
Scriptedgestures
RecordResult
Send backResult
CloudBees
Jenkins
InitiateTests
Build Matrix• Testing mobile application requires testing on
lots of different devices, form factors, etc.
• Create one build job per form factor/generation?
• No!
• Jenkins Build Matrix!
Jenkins Build Matrix
http://wiki.cloudbees.com/bin/view/DEV/Matrixed_Jenkins_Android_Builds
Build Matrix – Problem!• Build matrix are very powerful!
• But testing can become costly!
• Fail-Fast
• Organize your testing as a pipeline
• Cheap first, fail-fast
• Expensive as late as possible
Jenkins Promoted Builds
• Build on several targets: iOS, Android, multiple versions, etc.
• If it fails stop• If it succeeds,
PROMOTE BUILD
#fail #fail #fail
BasicTests
Matrix Tests
QA Approva
l
Release
Mgt#fail
Git notif
• Perform basic testing• Mono
device• Cheap
testing
• Deploy application onto Beta Testers’ devices• Zubhium,
TestFlight, Appaloosa
• QA receives notification of promoted build
• Perform QA validation• Code coverage,
etc.• If not OK stop• If OK,
MANUALLY APPROVE
• Real users testing
• Crash dumps• User reports• Kill switch• Etc.
Zubhium
AndroidEmulators
http://blog.cloudbees.com/2012/11/another-look-at-jenkins-promoted-builds.html
• CuckooChess• Earlier, simpler version of
DroidFish – no NDK, so builds are quicker
• Code and Instructions
• We’ll show you how to:• Include the Zubhium SDK• Automate push to Zubhium• Support crash reporting/feedback• Add a deliberate bug!
Quick Demo: Beta Testing with Zubhium
© 2013 CloudBees, Inc. All Rights Reserved
import com.zubhium.ZubhiumSDK;
public class CuckooChess extends Activity implements GUIInterface {
private ZubhiumSDK zubhiumSDK = null;
private final String zubhiumAppKey = "cbbb3f3ef6369131a62b47a96d3ab8";
@Override
public void onCreate(Bundle savedInstanceState) {
super.onCreate(savedInstanceState);
zubhiumSDK = ZubhiumSDK.getZubhiumSDKInstance(this, zubhiumAppKey);
AND</manifest>
<uses-permission android:name="android.permission.INTERNET"/>
<uses-permission android:name="android.permission.ACCESS_NETWORK_STATE"/>
</manifest>
Adding Zubhium SDK is easy
© 2013 CloudBees, Inc.All Rights Reserved
The Build Pipeline
©2012 CloudBees, Inc. All Rights Reserved
Push to Zubhium
©2012 CloudBees, Inc. All Rights Reserved
iOS Beta Testing – TestFlight and Appaloosa
Mobile + Server?• Makes PaaS value even more obvious
• Use existing Java assets on the back-end
• Communicate through HTTP/etc.
iOS
CloudBeesPaaS
Java App
DB
On-Premise Java App
DB
HTTPS SSL/VPN/HTTPS/etc.
Private Datacente
rApp on
PaaS
To the Internet
VPCApp on
PaaSTo the
Internet
“Legacy”On-
premises resources
Data Copy ?
Private Datacente
rApp on
PaaS
To the Internet
VPCApp on
PaaSTo the
Internet
“Legacy”On-
premises resources
Data Copy
1
2
3
AWS!• Amazon Web Services (AWS) provides plenty
of high-quality services
• Can they be used by mobile phones applications?
RDS DynamoDB SimpleDB ElastiCache
IAM Data Pipeline Flexible Payment S3
Glacier Simple Workflow Simple Queue Simple Notification
Simple Email Etc.
AWS – Not easy• Not advised to let Mobile app directly access
AWS
• AWS account key would need to be embedded and distributed to all users (!)
• Users stepping on each others, ouch!
• Solution?
“Token Vending Machine”
• Mobile app “registers” on a server app and…
• Anonymous OR Identity-based TVM available
• Requests a “token” to the server app
• Limited in SCOPE (S3, Notification, Email, etc.)
• Limited in TIME
• Mobile app uses token to use AWS in a constrained fashion
• Easy!
“Token Vending Machine”
CloudBeesPaaS
TVMApp
AWS S3
1. Request Token
AWS IAM
1.1 Request TokenUsing private AWS Key
2. Uses AWS Service using Token
Want your own TVM?• Easy! Try our TVM ClickStart
• Just put your AWS Key in the TVM and get going!
http://blog.cloudbees.com/2012/12/token-vending-machine-clickstarts-and.html
Conclusion• Next.gen software development is all about
TIME-TO-MARKET and FAST ITERATION
• Mobile applications make it even harder!
• No second chance, wide range of devices
• You cannot win by building your own FACTORY
• Use a PaaS – Focus on added-value
• Try it now! Onward!
