![Page 1: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/1.jpg)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Peter Caron, HERE Technologies
18 May 2017
Migrating and Running Continuous Integration Systems at Scale in AWS
![Page 2: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/2.jpg)
Introduction
Challenges of CI/CDMoving to a CloudTransition to AWS
“We are no longer a map company, but a data company”
HERE is one the world’s leading map data companies and is now delivering the next generation of mobility and location-based services.
Edzard OverbeekCEOHERE
![Page 3: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/3.jpg)
Portfolio
Challenges of CI/CDMoving to a CloudTransition to AWS
HERE software serves map, traffic and location data to a variety of target platforms
• HERE Open Location Platform (OLP)
• Embedded Automobile Navigation
• Enterprise Extensions• SDKs and Mobile Apps• HERE Location Services
![Page 4: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/4.jpg)
Challenges of CI/CDMoving to a CloudTransition to AWS
HERE needed a build system that could scale to meet our needs to develop and test complex, heterogeneous products and services.
Our Challenge
![Page 5: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/5.jpg)
Agenda
Challenges of CI/CDMoving to a CloudTransition to AWS
Challenges of CI/CDMoving to a CloudTransition to AWS
![Page 6: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/6.jpg)
6
BeforeMerge Hell
Build Systems • Dozens of machines under the
desk or for each team• Incompatible build servers• VM-based build systems in
different DCs• Incompatible workflows• No metrics
Results~5+ Builds per month40K+ Tests / cycle1000+ VMs on VMWare~1 Deployment/month00s Acceptance tests/month
Jenkins Serversin Data CentresV
JenkinsUnder
the Desk
![Page 7: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/7.jpg)
After
Standardised Integration Testing
Automation
Common Builds and Infrastructure
(JaaS)
3
Metrics and Reporting /AWS optimisation
6
4Release Coordination
1
CD Orchestration Automation
R&D Workstream Ways of Working
2
5
![Page 8: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/8.jpg)
AWS Services in Production
Region #1
EC2 instances
JenkinsMaster Amazon EFS
AmazonS3
Spot Instances
AWSDevice Farm
Amazon Cloud Watch
Amazon VPC
Region #2
EC2 instances
JenkinsMaster
Common CI Systems – CCI (Jenkins)140K+ Builds per day25M+ Tests per day
CI for Micro-services – (CI as a Service)130 Products and services
CD Platform Pipelines (GoCD as a Service)40 Services668 Unique pipelines600+ Instances on AWS 40+ Deployments/month00s Acceptance tests/day
![Page 9: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/9.jpg)
Moving CI / CD Toolsets and Infrastructure to AWS …
It was a simple lift and shift from our local infrastructure
• Git• Gerrit• Jenkins• Artifactory• GoCD• Splunk
![Page 10: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/10.jpg)
Not exactly!.
… and everything worked well from Day 1
![Page 11: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/11.jpg)
Steps to Success Plan
to Grow
Changethe
Culture
Monitorthe
System
Organise DevOps
![Page 12: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/12.jpg)
Plan to Grow
• Get your Workflow right• Know your Capacity and
Limits• Focus on Testing• Set Expectations Internally• Know your Fallback options• Monitor changes (costs)
![Page 13: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/13.jpg)
Change the Culture
• Start small, iterate• Do CI right before introducing AWS• Infrastructure as Code• Understand your changes • Measure Results and Adapt
![Page 14: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/14.jpg)
… and what could we have done better?
• Capacity is always underestimated.• Costs will be high at first• Trust your developers and listen to their
complaints• Moving to the Cloud is not an answer• Plan a fallback• People will use the system• One size does not fit all• Track your costs closely
What did we learn?
![Page 15: Migrating and Running Continuous Integration Systems …aws-de-media.s3-eu-west-1.amazonaws.com/images/AWS_Summit_B… · Migrating and Running Continuous Integration Systems at Scale](https://reader034.vdocument.in/reader034/viewer/2022051803/5b00ad5f7f8b9a256b905df8/html5/thumbnails/15.jpg)
@HERE Technologies Today
We’re building the best location-based products in the world! To do that, we need to have the best development systems in the world.
Next Steps
Infrastructure as CodeBuild on Secure DevOps modeDeployment OrchestrationCompletely self-service pipelinesSoftware Defined Environments