3-17097 scte arris vcmts.chicago arris virtualized ccap.pdf · virtualized ccap september 2017 the...

Copyright2017– ARRISEnterprises,LLC.Allrightsreserved

VirtualizedCCAPSeptember2017TheARRISproductroadmapscontainedhereinarefordiscussionpurposesonlytodemonstrateourthoughtsbehindtheevolutionary developmentoftheARRISproductofferings.ARRISisnotobligatedtodevelopthesoftwareorhardwarewiththefeaturesandfunctionalitydiscussedinthesematerials


NextGenerationCableAccess


What’sComingInTheAccessNetwork?

September2017 3

TechnologicalBifurcation

ArchitecturalBifurcation

ExponentialBandwidthGrowth MSODecisions,

Decisions,Decisions

IncreasedCompetition

Revolutionvs

Evolution

CentralizedvsDistributed

VirtualvsAppliance-based

DOCSIS/EPON/GPON/Wireless

RPHY/RMACPHY

FiberDeeper?


I-CoreHFCAccessNetworkArchitecture(2nd Evolution)– NoAnalogVideo!

29September2017 4

I-CORE

OOBMAC

VODMAC

BCEQMAC

DOCSISCMTSMAC

EthDWDM

EthDWDM

RPHY

RPHY


vCMTS isJusttheiCORE ImplementedinSoftware!

29September2017 5

OOBMAC

VODMAC

BCEQMAC

DOCSISCMTSMAC

EthDWDM

EthDWDM

RPHY

RPHY


ItLooksLikeThisandNeedsLotsofHelp!

29September2017 6

DOCSISCMTSMAC

EthDWDM

EthDWDM

RPHY

RPHY

• Thei-Coredoesalotofthingsthatwetakeforgrantedlike:– Handlescalingandfailurerecovery– Somenetworkingandroutingfunctions– OOB,encryption,andvideo


VirtualizationBackground

September2017 7


Containers,Clusters,andClouds


• Why?• Terms• Computer(baremetal)• VirtualMachine• Docker/ContainersonBareMetal• DockeronaVirtualMachine• KubernetesClusteronBareMetal• TheCloud

Agenda

September2017 9

KubernetesCluster

VirtualMachineDocker

BareMetal

VirtualDocker

VirtualKubernetes

CloudDocker

Cloud

CloudKubenetes


WhyContainersandClouds?

• Baremetalishardtoconfigure,manage,andmaintain

• Cloudsandclustersprovidescalabilityandtheabilitydistributeapplicationsgeographically• Virtualizationprovideshardwareindependence• Containersoffercleanandsimpleapplicationandmicroservicepackagingandmanagement.

Thesetechnologieshelptomakesoftwaremoremanageable,scalable,andresilient

September2017 10


• Underlined termsarenew.• Boxeswithayellowbackgroundarenew• Boxeswithadashedbordermaynotbepresent

Key

September2017 11

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistroAPP

APP

APP

APP

APP


• Baremetalmeansaregularoldcomputer• Terms– App:AnyLinuxbasedapplicationorservice.ExamplesincludeApache,Nginx,nDVRrecorder,VDE,orvCMTS.

– LinuxDistro:TheLinuxdistribution.Forexample,Ubuntu,Centos,Debian,CoreOS,orYocto

– LinuxKernel:TheCore oftheoperatingsystem.InvariantpartofLinux.ProvidesbasicO/Sservices:memorymanagement,CPU/processmanagement,filesystems,storage,etc.

– HAL/DeviceDrivers: Hardwareabstractionlayer.Allowsthekerneltointeracthardwareinacommonway.

– Hardware: Physicaldevices,forexample,theCPU,memory,storage,USB,etc.

Computer(baremetal)

September2017 12

Hardware

HAL/DeviceDrivers

LinuxKernel/OSCore

LinuxDistroAPP

APP

APP

APP

APP


LinuxDistros

September2017 13

Hardware

HAL/DeviceDrivers

LinuxKernel

Ubuntu

APP

APP

APP

APP

APP

Hardware

HAL/DeviceDrivers

LinuxKernel

Centos

APP

APP

APP

APP

APP

Hardware

HAL/DeviceDrivers

LinuxKernel

CoreOS

APP

APP

APP

APP

APP


LinuxDistros

September2017 14


• Baremetalmeansaregularoldcomputer• Terms– App:AnyLinuxbasedapplicationorservice.ExamplesincludeApache,Nginx,nDVRrecorder,VDE,orvCMTS.

– LinuxDistro:TheLinuxdistribution.Forexample,Ubuntu,Centos,Debian,CoreOS,orYocto

– LinuxKernel:TheCore oftheoperatingsystem.InvariantpartofLinux.ProvidesbasicO/Sservices:memorymanagement,CPU/processmanagement,filesystems,storage,etc.

– HAL/DeviceDrivers: Hardwareabstractionlayer.Allowsthekerneltointeracthardwareinacommonway.

– Hardware: Physicaldevices,forexample,theCPU,memory,storage,USB,etc.

Computer(baremetal)

September2017 15

Hardware

HAL/DeviceDrivers

LinuxKernel/OSCore

LinuxDistroAPP

APP

APP

APP

APP


• Thispictureshowsonecomputer runningvirtualmachinesoftware

• Brands:KVM,VMware,Xen,etc.• Terms– App:AnyLinuxbasedapplicationorservice.Examples

includeApache,Nginx,nDVRrecorder,VDE,orvCMTS.– LinuxDistro:TheLinuxdistribution.Forexample,

Ubuntu,Centos,Debian,CoreOS,orYocto– LinuxKernel: InvariantpartofLinux.ProvidesbasicO/S

services:memorymanagement,CPU/processmanagement,filesystems,storage,etc.

– Hypervisor:Avirtualmachinemonitor.ItmaybepartofLinux(kvm)orproprietary(VMware)

– HAL/DeviceDrivers:Hardwareabstractionlayer.Allowsthekerneltointeracthardwareinacommonway.

– VirtualHardware: Hardwaresimulatedinsoftware.– Hardware: Physicaldevices,forexampletheCPU,

memory,storage,USB,etc.

• LinuxDistro(withdashedborder)maynotbepresentifanon-Linuxbasedhypervisorisused.

VirtualMachine

September2017 16

Hardware

HAL/DeviceDrivers

LinuxKernel/Hypervisor

LinuxDistro

VirtualHardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

APP

APP

APP

APP

APP

VirtualHardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

APP

APP

APP

APP

APP


• DockerissoftwarethatrunsontopofLinux

• Brands:Docker,Rocket• Terms– Docker:Containermanagementsoftware.– App:AnyLinuxbasedapplicationorservice.LinuxDistro:TheLinuxdistribution.Forexample,Ubuntu,Centos,Debian,CoreOSorYocto

– LinuxKernel: InvariantpartofLinux.ProvidesbasicO/Sservices:memorymanagement,CPU/processmanagement,filesystems,storage,etc.


– Hardware: Physicaldevices,forexampletheCPU,memory,storage,USB,etc.

Docker/ContainersonBareMetal

September2017 17

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

LinuxDistro

APP

LinuxDistroAPP

APP

Docker


• ThisistheVirtualMachine+Docker• Terms– App:AnyLinuxbasedapplicationorservice.Examples

includeApache,Nginx,nDVRrecorder,VDE,vCMTS.– Docker:Containermanagementsoftware.– LinuxDistro:TheLinuxdistribution.Forexample,

Ubuntu,Centos,Debian,CoreOS, orYocto.– LinuxKernel: InvariantpartofLinux.ProvidesbasicO/S

services:memorymanagement,CPU/processmanagement,filesystems,storage,etc.

– Hypervisor:Avirtualmachinemonitor.ItmaybepartofLinux(kvm)orproprietary(Vmware)


– VirtualHardware: Hardwaresimulatedinsoftware.– Hardware: Physicaldevices,forexampletheCPU,

memory,storage,USB,etc.

• LinuxDistro(withdashedborder)maynotbepresentifanon-Linuxbasedhypervisorisused.

DockeronaVirtualMachine

September2017 18

Hardware

HAL/DeviceDrivers

LinuxKernel/Hypervisor

LinuxDistro

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

LinuxDistro

APP

LinuxDistro

APP

APPDocker

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

LinuxDistro

APP

LinuxDistro

APP

APPDocker


• KubernetesallowyoutomanageaclusterofDockermachines

• DockerissoftwarethatrunsontopofLinux• Terms– Kubernetes:Containerclustermanagementsystem.

– Docker:Containermanagementsoftware.– App:AnyLinuxbasedapplicationorservice.LinuxDistro:TheLinuxdistribution.Forexample,Ubuntu,Centos,Debian,CoreOS,orYocto

– LinuxKernel: InvariantpartofLinux.ProvidesbasicO/Sservices:memorymanagement,CPU/processmanagement,filesystems,storage,etc.


– Hardware: Physicaldevices,forexampletheCPU,memory,storage,USB,etc.

KubernetesClusteronBareMetal

September2017 19

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

LinuxDistro

Kubernetes

LinuxDistro

APP

APPKubernetes

Docker

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

LinuxDistro

Kubernetes

LinuxDistro

APP

APPKubernetes

Docker

Hardware

HAL/DeviceDrivers

LinuxKernel

LinuxDistro

LinuxDistro

Kubernetes

LinuxDistro

APP

APPKubernetes

Docker


Cloud(e.g.OpenStack)

• Managesaclusterofvirtualmachinesandcomputingrecourses• Terms– VM– virtualmachine– Hypervisor:Avirtualmachinemonitor.MaybepartofLinux(kvm)orproprietary(Vmware)– BlockStorage:Astoragesystemthataccessinformationin“blocks.”Thisisbasicallyatraditionalfilesystem.Afileismadeupofaseriesofblocks.Randomaccessisallowed.

– ObjectStore: (e.g.SwiftorCEPH)Astoragesystemthataccessesinformationatthe“object”level.(e.g.theWHOLEfile).Randomaccessisnotallowed.

September2017 20


• Leftasanexerciseforthereader

KubernetesintheCloud

September2017 21


• AmazonWebServices(AWS)• MicrosoftAzure• GoogleCloudPlatform

CommercialClouds

September2017 22


• VirtualMachinetechnologyallows“anyoperatingsystem”torunonacomputer– ExamplesincludeKVM,VMware,Xen

• Containertechnologiesisalightweightalternativetovirtualmachinesoftware,butisconstrainedtoasingleLinuxkernel.– ExamplesincludeDockerandrkt (Rocket).

• AClusterorCloudisacollectionofcomputerthatamanagedasacommonresource.– ForvirtualmachinesexamplesincludeOpenStackandVSphere

– ForContainersexamplesincludeKubernetesandDockerStorm

TakeAwayConcepts

September2017 23

KubernetesCluster

VirtualMachineDocker

BareMetal

VirtualDocker

VirtualKubernetes

CloudDocker

Cloud

CloudKubenetes


SDN&NFV


WhatisSDN andNFV?

• SDNseparatesdataandcontrolandmanagementplanetoenable:– Asoftwareprogrammablenetwork– Acentralizedcontrollerwithdynamicmanagementandprovisioning– Reuseofparitycontrolfeaturesovermultipleaccesstechnologies– Dynamiccreation,modificationanddeletionofservices

• NFVdecouplesSWfromHWtoenable:– UsingCOTShardwareandopensoftware– Dynamicresourceandservicemanagement– Reuseofparityforwardingfeaturesovermultipleaccesstechnologies– Definingefficientnetworkandservicechains

29September2017 OverviewofPONTechnologiesandSystemArchitecturesforSCTE 25


WhataretheDriversbehindSDN/NFV?(1of2)

• ElasticityandScalabilityEnablebySystemModularity(DisaggregationofCCAP&OLT)– Disaggregation:SeparationofHardwareandSoftwareFunctionalBlocks

• (PHY,MAC/PHY,TrafficManagement/ServiceGateway,SwitchFabric/Backplane,Control,WAN/NSILink)– SeparationofControlandDataPlanes– Separatingthenetworkfunctionsallowsplacementofcapacitywhereandwhenneeded

• (IOcapacityforaccesslayerlikePON,P2PEthernet,DOCSIS,etc.whereandwhenneeded)

• AgilityEnablingTimeToMarket– ServiceCreationandProvisioningAutomation– End-to-endAnalyticsassistsindeterminingresourceservicecapacity– Consistentservicesandfeaturesacrossvendorsandaccesstechnologies(DOCSIS,PON,Ethernet,Wireless)

• OpenPlatformEcosystem– NoProprietarySystemVendorsoftwareorprotocols– SystemVendor,NetworkOperators,andCommunitydevelopfeatures/applications– AutomateOAM&P– Interoperability– Innovation



WhataretheDriversbehindSDN/NFV?(2of2)

• ReduceCAPEX– COTSswitches,servers,storage,computeelements– Reducedheadendestate,powerandcooling– Abilitytoscaleperdemandandintegrateonlyneededfunctions– Newpricingoptionsusinglicensespersubscriber,throughput,featuresenable(pay-as-you-grow)– OpenSoftwareplatformsfrommultiplevendors

• ReduceOPEX– Reducedheadendpowerandcooling– Zerotouchprovisioningandprogrammablenetworksandserviceswithreducedcomplexity– End-to-endvisibility,analyticsandserviceassuranceorchestration– Dynamicandefficientresourcemanagement(selfhealing/optimizingnetworks)– StandardAPIs,controlandmanagementinterfaces

• AgileServicesandNewBusinessModels– Abstractedservicemodelsandautomatednetworksforshortenedserviceintegration– EnhancedQoEandcustomerandbusinessportals– Cloudbasedapplicationsandabstractedservicemodelsforbusinesstobusinessservices– Centralizedcontrolofdistributedfunctionsdirectedandcomposedbyservicespecificrequirements



Kubernetes


Kubernetes

• Kubernetesisarobustopensourcesoftwareplatformformanagingthedeployment,scalingandlifecycleofapplicationcontainers

• Kubernetesisafield-provenorchestrationsolutionforverylargescalesystemscomprisedofhugenumbersofcontainers

• Kubernetesfeatures– Automaticallyplacescontainersonnodesbasedontheiridentifiedresourcerequirementsandconstraints– Provideshighavailabilitybymonitoringnodestodetectfailuresandre-loadingcontainersontonewnodes– Deliversbothrollingupgradesandrollbackforapplicationswhileensuringcontinuousup-timeoperation

• Kubernetesoftenshortenedtobe“K8s”inliterature– Kfollowedby8lettersandans.

29September2017


KubernetesConcepts

• Node =aphysicalorvirtualmachinewhereapplicationcontainersmayberun• Pod =asetofoneormoreapplicationcontainersthataremanagedcollectivelyasagroup• Kubelet =theKubernetesagentthatrunsonaNodeandensuresthatthePods(applicationcontainers)thatshouldbepresentontheNodearerunningandhealthy

• Label =asemantictagusedtoidentifyPodcharacteristicsandcontrolhowPodsaremappedontoNodes– MaylabelaPodwithanameandaversionnumbertoeasilydetermineitsroleandspecificapplicationversionsrunninginthePod

– CanlabelaNodetoidentifykeycharacteristicsthatmayberequiredtoruncertainPodsandthenlabelthePodtoonlyrunonmatchingNodes

• Service =asetofoneormorePodsthatcanbereliablyaccessedexternallytoprovideafunctiontootherPods– Bydefault,asPodsarecreatedanddestroyedtheirIPaddressesmaychange– IdentifyingaPodaspartofaServiceensuresthatitcanbeconsistentlyaccessedatalltimes

30September2017


Pods

• AKubernetespodisagroupofoneormorecontainerswhichareco-locatedonagroupofcores onthesamemachine,canshareresourcesandhaveauniqueIPaddress.

• Theprimaryreasontodecomposeintocontainersasmuchaspossibleisformodularity– Acontainercanbeswappedoutwithadifferentversion– Acontainercanbereusedinadifferentpod– anindependentreusablecomponent

• Separatecontainerscanshareresourceslikememory• ApodistheatomicunitofschedulinginaKubernetescluster.• Apodhasasetofdatavolumeswhoselifeislongerthanthatofthecontainers.– Anythinginthecontaineristransient.– PersistentdatamustbeinexternalNetworkAttachedStorage.

• Anamespaceissharedamongallthecontainersinapodtoconnectthemtogetherviaalocalhosttomakeconfigurationmuchsimpler.Differentcontainerswithinapodcanallseeeachotheronlocalhostbecausetheysharethesamenetworknamespace.

September2017 31


PuttingItAllTogether

September2017 32


High-LevelMSOSDN/NFVArchitecturefor10GEPON

SwitchFabric

10GEthernetusingDWDMwithMACsec

ServerFarms

S-LeafSwitch LeafSwitch(ToR)

SpineSwitch SpineSwitch

40G– 100GEthernet

WDM

LeafSwitch(ToR) CoreRouter

10G/40G100G

vRouter

vCCAP

vCPE DHCP

TFTP

RADIUSOtherVNFs

OtherPNFs

SDNController

ServiceandResourceOrchestration

ApplicationLayer

OSS/BSSSubscriber/ServiceDatabaseNetworkInventory Policy

Analytics/Service

Assurance/Business

Intelligence

OtherServices/Applications

IPVideoApps

UnderlayandOverlayController

ServiceManager

VideoServer

Controllers

IP-HSDApps

Business/MEFApps

SwitchRouter

Controllers

RADController

ServiceOrchestrator

vManagervCoreVNFM

vCoreEMS

SDN-O NFV-OOrchestratorCommon GlobalService-OvManagerLifeCycleManager

33September2017

vCoreCCAPCore

LeafSwitch(ToR)100GEthernet

P-OLT(PhysicalOLT)PNF(PhysicalNetworkFunctions)

10G/40G100G

RPHY

WDM

S-LeafSwitch

WDM


LogicalFunctionsinaCCAPCORE

CCAPCORE

DOCSISCore SCTE55-1CoreVideoCore SCTE55-2

Core

September2017 34


DisaggregatedFunctionsinavCORE

vCore SoftSCTE55-1CoreSoftVideoCore SoftSCTE55-2

Core

• AvCMTS isonlypartofthesolution

September2017 35


vCore Architecture:Combineddataandcontrolplanes

September2017 36

vCoreControlPlane

vCoreDataplane

DOCSISMACDomainControl

PacketCableARP/NDProxy CableSrc Verify

MACLearning

IPv6PrefixDelegation DHCPRelayTFTPRelay

L2VPNMgrMulticastMgmt

VideoEdge(SDV/VoD/Bcast)

IKE/IPsec

RPDMgmt(GCP,L2TPv3)

Routing&Forwarding

LACP(LAG)

ICMP

PacketClassification

IngressACL

ProtocolThrottling

ServiceFlowQoS

USMapper

CCFPacketReassembly

USBondingResequencing

DSDEPIencapsulation

USUEPIdecapsulation

L2VPNFWD

VLANEncapsulation

VideoQoS

DSFramer

VideoEncryption

EgressACL

MulticastReplication

Policing

Shaping Telemetry

ProactiveNetworkMaintenance

PacketSniffer

ChannelLoadBalancing

BPIencryption

VideoTiming


SGmobility

• Thenumberofcoresassignedtoacontainercouldbereducedsignificantlyduringperiodsoflowutilization(e.g.nighttime).– Otherworkloadscouldberunonthefreedupcores– Alternatively,allSGsinacontainercouldbemovedtoanothercontaineronadifferentserversothatthecurrentcontainer(andsubsequentlytheserver)couldbeshutdown.

• MovinganSGtoadifferentcontainerisdisruptivetoin-progresspacketflows– AllSGdataneedstobecopiedintoanewcontainer– AllpacketqueuesassociatedwiththeSGneedtobedrainedbeforethenewcontainertakesover– Theswitchingoveroftrafficstreamsinswitches,drainingofpacketqueuesforSFs,restartingofschedulinginthenewcontainer,etc,issynchronizedbyvManager

• Forredundancy,eachSGinacontainercanbesparedbyadifferentPODsothebasicmobilityunitisanSG

September2017 37


vCore Sparing

• vCorePODsparingconsistsofasparevCoreKubernetesPODthatisconfiguredtoshadowanactivevCoreKubernetesPOD.

• EachsparevCoreKubernetesPODcollectsandprocesscheckpointmessagesfromitsactivepartner.

• Thisarrangementallowsforstateandservicestobemaintainedacrossfailures– In-transitmediapacketsmightbelostforabrieftimeduringanactiveswitch;butalldevicesremainupandstable

• Thisarrangementcanfacilitate:– Hitlessupgrade:Shutdownspareonoldrelease;bringupnewspareonnewrelease;allowallcheckpointupdates;switchoveractivevCorefromoldreleasetonewsparecopyonnewrelease;shutdownoldreleaseandbringupspareofnewreleaseinitsplace;allowallcheckpointupdates;optionally,switchactivevCorebacktooriginalnode;shutdownformerlyactiveandrecreatespare.

– LoadBalancing:MovementofvCoresforLoadBalancingcanbeaccomplishedthruvCoreSparing– EnergyManagement:MovementofvCoresforEnergyManagementcanbeaccomplishedthruvCoreSparing

• SparevCorePODscanbeplacedonadedicatednodeoronnodessharedwithactivePODs.

September2017 38


TheDiurnalUtilizationCyclewithvCorescalingGeneralTrend

5:00PM 7:24PM 9:48PM 12:12AM 2:36AM 5:00AM 7:24AM 9:48AM 12:12PM 2:36PM 5:00PM

BROAD

BANDUT

ILIZAT

ION

TIMEOFDAY

• vCoretellsvManagerreachingthroughputthreshold.• vManagerrequestsadditionalcoresfromVIM• VIMgrantsapprovalforadditionalcores(Δ seconds)• vManageradjustscontainertoutilizeadditionalcores

• vCoretellsvManagerofovercapacitythreshold.• vManageradjustscontainertoreducecores• vManagernotifiesVirtualInfrastructureManager(VIM)

ofadditionalcoresforinventory

September2017 39

ThankYou!

September2017 40

3-17097 scte arris vcmts.chicago arris virtualized ccap.pdf · virtualized ccap september 2017 the...

Documents