puppetconf 2017: adobe advertising cloud: lean puppet workflow to support multi-cloud &...
TRANSCRIPT
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting InfrastructureNicolas Brousse | Director of Engineering, Operations
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Increased Complexity and Faster Changes
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Tesla remotely extends range of vehicles for free in Florida to help owners escape Hurricane Irma
4
Source: Electrek.co
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Tesla Over-The-Air Software Update
5
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Any connected device need to handle updates
6
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Connected Home gets more sophisticated
7
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Likewise Enterprises Infrastructure Complexity increase
8
• IaaS / PaaS (AWS, Azure, GCP, IBM, Oracle…)
• Cloud Productivity Apps (G Suite, Office 365, AWS...)
• CRM
• Private Cloud (OpenStack, VMware...)
• Containers Orchestration (K8s, Mesos, Swarm, Nomad...)
• Bare-metal servers, mainframes (IBM Z 2017)
• Edge Computing
• Quantum Annealer (D-Wave)
Next Quantum Computers?
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Patching (very) quickly matters
10
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
The Adobe Advertising Cloud
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Technical Challenges
12
Latency Requirement<50ms @ 95th percentile
High Volume Traffic+100 billions request a day
Huge Datasetsbillions of object to store
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
> 6,000 servers
> 10,000 Puppet code deployments a year
> 40,000 Application deployments a year
1 Puppet Master
13
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Bare-metal Infrastructure Automation
Fully automated deployment
Rack-And-Roll Infrastructure
Puppet Hiera and eYAML
15
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Bare-metal Infrastructure Automation – Rack…
16
Buy Build
BurnTest
ShipRack, Bolt, Powered onConnect to Network
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
And Roll…
17
Jenkins API TFTP PXE boot API puppet
Log centralization Monitoring and Metrics IdM & IDS
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Containers Environments
18
git jenkins
docker
terraform puppet K8s
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Cloud Bursting
19
git
jenkins
terraform
puppet
puppet
jenkins
Application DeploymentInfrastructure Deployment
git
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Configuration Management is not deadIt’s complicated and diverse
21
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Key Take Aways
§ Acknowledge the reality of complex infrastructure in the enterprise world
§ Understand your Infrastructures models§ Strongly Immutable§ Weakly Immutable§ Mutable
§ Prevent and detect configuration drift + allow patching
§ Holistic understanding of your product lifecycle§ Infrastructure As Code (multiple tools involved)§ Feature Toggles§ Beta Percentage Rollout§ Blue / Green Deployments§ Mean Time to Release Changes at scale
22