glusterd-2.0: whats happening? - kaushal madappa
TRANSCRIPT
![Page 1: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/1.jpg)
GLUSTERD-2.0WHAT'S HAPPENING?
![Page 2: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/2.jpg)
WHAT IS GD2?
![Page 3: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/3.jpg)
GD2New management system for Gluster-4.0
Not backwards compatible
From scratch rewrite, written in GoBetter scalability, integration and maintenance
![Page 4: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/4.jpg)
GLUSTER-4.0Feature parity with GD1StabilizeRecoveryPreliminary automatic volume creationMerge into GlusterFS treeNo migration support
![Page 5: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/5.jpg)
GLUSTER-4.1+Stabilize moreDocument everythingSupport migrationFully automatic volume managementAutomatic cluster formationCentralized logging and tracing
![Page 6: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/6.jpg)
WORK DONE TILL NOW
![Page 7: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/7.jpg)
GD2 AT THE MOMENTBasic cluster managementBasic volume managementCLI
![Page 8: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/8.jpg)
TODOS
![Page 9: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/9.jpg)
IMPORTANT TODOS FOR 4.0Implement rest of the commandsPreliminary automatic volume managementRecovery steps
![Page 10: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/10.jpg)
BASIC CLUSTER MANAGEMENT
![Page 11: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/11.jpg)
BASIC CLUSTER MANAGEMENTExpand and shrink clusterAutomatic store/etcd managementHTTP API serverGRPC server
![Page 12: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/12.jpg)
AUTOMATIC STOREEmbedded ETCDAutomatic ETCD cluster formation
auto scaling with elastic algorithm
External ETCD clusters supported
![Page 13: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/13.jpg)
HTTP API SERVERHTTP1 API serverReST likeJSON request and responseInitial TLS supportPort 24007
![Page 14: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/14.jpg)
GRPC SERVERInternal communicationsCluster managementTransactionPort 24008
![Page 15: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/15.jpg)
BASIC VOLUME MANAGEMENT
![Page 16: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/16.jpg)
BASIC VOLUME MANAGEMENTCreate, start, stop, delete volumes
Distribute, Replicate, Dist-Rep
Flexible transaction engineDynamic volume setFlexible volgenDaemon managerSunRPC server and client
![Page 17: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/17.jpg)
TRANSACTION ENGINERuns steps across the cluster
only where required
Supports undo on failureFree form sequence of steps
![Page 18: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/18.jpg)
FLEXIBLE VOLGENGraph structure defined using text filesGeneric graph building functionsMinimal specialized functions when required
![Page 19: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/19.jpg)
DYNAMIC VOLUME SETBuild options table at runtime from xlatorsExtended xlator options table and struct(A few) Xlators updated to add new informationNew keys for many options (mainly new prefixes)
![Page 20: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/20.jpg)
DAEMON MANAGERSingle framework for managing daemonsDefines a daemon interfaceStart, stop, communicate with daemons
![Page 21: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/21.jpg)
SUNRPCPure Go SunRPC/XDR server and clientUsed for clients
fetch volfile, portmap
Used for daemons
fetch volfile, daemon communication
Port 24007
![Page 22: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/22.jpg)
CLI
![Page 23: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/23.jpg)
CLI`glustercli`Uses HTTP management APIManagement API packageBasic commands implementedSome changes to syntax
![Page 24: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/24.jpg)
SYNTAX CHANGESChanges to improve parse-abilityOnly slight changes to existing syntaxBuilt-in old to new translator
![Page 25: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/25.jpg)
MANAGEMENT API PACKAGEGo packageImplements GD2 HTTP APIAvailable for external users
![Page 26: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/26.jpg)
OTHER STUFFStructured loggingPluginsE2E test frameworkRPMs
![Page 27: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/27.jpg)
THE END
![Page 28: GlusterD-2.0: Whats Happening? - Kaushal Madappa](https://reader036.vdocument.in/reader036/viewer/2022062401/5aacf6fa7f8b9a003b8b4615/html5/thumbnails/28.jpg)
P.S.GD2 is developed on Github
https://github.com/gluster/glusterd2
Questions/queries?
Find kshlm, ppai, aravindavk on #gluster-dev