mesosphere and percona server for mongodb · mongodb storage engines, including the wiredtiger,...
TRANSCRIPT
![Page 1: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/1.jpg)
Peter Schwaller, Senior Director Server Eng. (Percona)Taco Scargo, Senior Solution Engineer (Mesosphere)
Mesosphere and Percona Server for MongoDB
![Page 2: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/2.jpg)
PHYSICAL INFRASTRUCTURE
MICROSERVICES, CONTAINERS, & DEV TOOLS
VIRTUAL MACHINES PUBLIC CLOUDS
DATA SERVICES, MACHINE LEARNING, & AI
Security & Compliance
Application-Aware Automation
MultitenancyHybrid Cloud Management
100+ MORE
DatacenterEdge
Datacenter and Cloud as a Single Computing Resource Powered by Apache Mesos
20+ MORE
Unified hybrid cloud operationsSecurely manage cloud, datacenter, and edge infrastructures from a single control plane
4
Mesosphere DC/OS
Intelligent resource poolingOptimize workload density for highest utilization with resource guarantees
3
Broad workload coverage
Run today & tomorrow’s applications including traditional J2EE, containers, analytics & ML
1
Application-aware automationAutomate workload-specific operating procedures to “as-a-Service” anything from Kubernetes to data services
2
![Page 3: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/3.jpg)
Mesos Architecture
3 3
Mesos Master
Mesos Master
Mesos Master
Mesos AgentMesos Agent Service
Cassandra Executor
Cassandra Task
Cassandra Scheduler
Container Scheduler
Spark Scheduler
Spark Executor
SparkTask
Mesos AgentMesos Agent Service
Docker Executor
DockerTask
Spark Executor
SparkTask
Two-level Scheduling
1. Agents advertise resources to Master2. Master offers resources to Framework3. Framework rejects / uses resources4. Agent reports task status to Master
![Page 4: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/4.jpg)
Stateful Problems
4
● Preparation before the main task
● Runtime execution against state
○ once
○ scheduled
○ user-defined arguments
○ maintenance
![Page 5: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/5.jpg)
Stateful Problems
5
● Conditional recovery scenarios
○ Cassandra: replacing a dead node or dead seed node
○ HDFS: replacing a dead name node
○ HDFS: replacing a dead journal node
● Conditional deployment scenarios
○ HDFS: deployment
![Page 6: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/6.jpg)
DC/OS Commons SDK
6
DC/OS
Documentation
Tools and Utilities
Apache Mesos API
Platform Feature Integration
Mongo Kafka Elastic
Finite State MachineExecution PlansAutomated Recovery
Universe PackagingApp ConfigurationNetworking & DiscoveryStorageSecurityMonitoring
Offer EvaluationResource AccountingTask Reconciliation
Developer EnvironmentIntegration Test Framework
Developer GuideTutorials & Code SamplesAPI Reference
Best Practices
Services
SDK
Platform
![Page 7: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/7.jpg)
7
DC/OS SDK
● A declarative orchestration abstraction for Apache Mesos and DC/OS.
● An Apache Mesos scheduler factory.
Use Cases● MongoDB! ● Kubernetes● Kafka● Cassandra ● Elastic● HDFS● EdgeLB● many more...
![Page 8: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/8.jpg)
8
DC/OS SDK Features
● Rolling configuration / software updates
● Separate deployment / update plans
● Easy Mesos feature consumption
○ CNI, rlimits, readiness checks, running and finished
goal states, discoverability of dns, persistent volumes,
security features (proprietary) …
![Page 9: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/9.jpg)
9
DC/OS SDK Features
● Horizontal scale out● Vertical scaling● Service discovery● Virtual Networks (CNI)● Readiness checks● Health checks● Custom recovery● Persistent volumes● Resource sets● Operator friendly tools (API)
● Sidecars● Placement constraints● Configuration templating● Rolling updates (configuration)● Rolling upgrades (binaries)● GPUs● Fine-grained plan control● Secrets (EE)● Security (EE)● TLS provisioning (EE)
![Page 10: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/10.jpg)
10
Percona Server for MongoDB
COMMUNITY EDITIONFree and open source
ENTERPRISE
MongoDB Community Edition plus:● Red Hat identity management
certification● Kerberos & LDAP authentication● Auditing● SNMP support● Encrypted storage engine● In-memory storage engine● Platform certifications: Windows,
RedHat/CentOS, Ubuntu, Amazon Linux
● Commercial licenses, warranty, and indemnification
Subscription ($)Free and open source
Percona Memory Engine
Hot Backups
LDAP Authentication
Database Auditing
Log Redaction
COMMUNITY EDITION
![Page 11: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/11.jpg)
11
Percona Server for MongoDB on DC/OS
● Simple installation of MongoDB via UI or CLI
● Single-command installation for rapid provisioning
● Multiple MongoDB Replica Sets within a single DC/OS cluster
● Storage volumes for enhanced data durability, known as Mesos Dynamic Reservations and Persistent Volumes
● Support for all Percona Server for MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines
● Auto-configuration of MongoDB Replica Set Configuration
● Auto-configuration of system-level users for backups and user management
● CLI actions for Add/Update/Remove of MongoDB Users
● Logical backup support with Amazon Web Services S3 remote upload
● Support for auto-deploy of Hidden Replica Set Member for zero-impact backups
● Percona Server for MongoDB Auditing support
![Page 12: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/12.jpg)
12
![Page 13: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/13.jpg)
13
![Page 14: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/14.jpg)
14
![Page 15: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/15.jpg)
15
Use PSMDB on DC/OS!
1.Install DC/OS (https://dcos.io/install) or contact [email protected] an evaluation license for the DC/OS Enterprise edition
2.Search the DC/OS Catalog for percona-server-mongodb
3.Install the percona-server-mongodb package
4.Provide feedback to [email protected]
NOTE: Replica sets today, sharding in the future
![Page 16: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/16.jpg)
16
Resources
Documentation:
https://docs.mesosphere.com/services/percona-mongo
SDK
https://github.com/mesosphere/dcos-commons
https://mesosphere.github.io/dcos-commons/developer-guide/
https://docs.mesosphere.com/services/ops-guide/
![Page 17: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/17.jpg)
18
Thank You Sponsors!!
![Page 18: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica](https://reader034.vdocument.in/reader034/viewer/2022050504/5f95d7e673deea62e93485b2/html5/thumbnails/18.jpg)
Thank You!