Adaptive Network Middleware CSC (Communication Service Concierge)Ryutaro Kawamura (NTT Laboratories)10.23.03

Outline

HistoryWhat is CSCRelationship between OSGi and CSC

Requirements -> OSGi specificationRelated activities in NTT and Japan

Digital Home-Network Forum in JapanECHONET Consortium

History

CSC project was started in 1999.CSC is network middleware.

Not only for “Gateway” but also “end-to-end communication”.

CSC uses software component functionalities based on Java technologies; we developed the functionalities byourselves.We found out about OSGi in 2001, and decided to replace our original functionalities with the OSGi framework.As a result, OSGi is an important part of our middleware.Also, OSGi itself is very useful for NTT’s service handling.

CSC and OSGi framework

CSC internally uses OSGi framework.

CSC　　OSGi

CSC(Communication Service Concierge)

Motivation of CSC development• Available network technologies are quickly diversifying.

– Remarkable in the access line (Fiber, ADSL, WLAN, etc.).– Suffering from frequent upgrades.

• Application software and user's objective / requirements also do.

• As a result, everything is diversifying.• This is causing many network problems.

• NW middleware will adaptively bind these two areas and enable their independent growth. NetworksNetworks

Network MiddlewareNetwork Middleware

ApplicationsApplications

Typical problem 1 : Nomadic Computing

AirportStation

PrivateHome

PublicHot Spot

Business Office

Ethernet

MobileEthernet

802.11b

802.11a 3G, PHS

802.11b, bluetooth

•Available access lines are …? Which one is best?•Frequent protocol upgrades for new services.

Typical problem 2: video stream transmission

HomeNW, NANetwork Provider

ASP

•Bottlenecks are distributed in end-to-end commun.•Not only access link.

•Heterogeneity of NW and appliances accelerates this trend.

Congestion in Home LANComplicated Setting up Congestion

in the InternetCongestionin iDC

OverloadedServer

Requirements for NW middlewareLoosely coupling network technologies and applications to permit their independent evolution

Adaptation to rapid change in both network technologies and user requirements

Customizability to accommodate diverse user preferences

Seamless support of end-to-end of communication

OS independent

Small processing requirements and footprintReasons to select Java and OSGi

Loosely coupling network technologies and applications to permit their independent evolution

Adaptation to rapid change in both network technologies and user requirements

Customizability to accommodate diverse user preferences

Seamless support of end-to-end of communication

OS independent

Small processing requirements and footprint

What is CSC?Adaptive network middleware for communication.Arranges and optimises end-to-end communications by

coordinating various kinds of network resources.Distributed and user centric network control platform.

Application Application

Network

Network Appliance Communication flow

Root

PI PI

CSC

PI PI

CR

CR

CR

PI

PI: Plug-in Module, CR: Commun. Resource

CR

PIInfo.(requirements)

Download PIs

coordinate CR

PI

CR

Network Appliance

Plug-in module server

Plug-in module

Communication resource

CR

Two Important concepts

CSC tries to coordinate communication as outside intervention

Keep Loosely coupling networks and applicationsCSC is not mandatoryKeep CSC invisible to the application and networks

Best-effort orientedPursues improvement rather than a rigorous guaranteeBecause, the possibilities of resource coordination are restricted in the Internet

CSC design principles

• Component structure

• Plug-in module distribution

• Operating system independent and small footprint

• Security

• Support of existing applications

Basic concept for communication control in CSC

Application ApplicationNetwork

NA(Server)NA(Client)

Resource Control Logic Control

Communication flow

CSC

PI PI

PIProcess control

Processcontrol

Bandwidth controlPI

Format conversion

PI PIencodedecode

•Encryption•Compression•Synchronization•QoS control•Mobility control•…..

CRM(Commun. Resource

Management)

CLM(Commun. Logic

Management)

CSC structure and OSGi

Java VM

Application

Operating System (including built-in protocols)

Hardware / Network

CR

CR

CR

download

Plug-in module server

CRM

CLMCLM Core

CLMMCRM Core

OSGi

CRMM

CRM: Commun. Resource ManagementCLM: Commun. Logic ManagementCR: Commun. ResourceCRMM: CRM ModuleCLMM: CLM Module

CLMM

CRMM CRMM

CLMM CRMM

CSC architecture overview

Application Application

Network

NA(Server)NA(Client)

Commun. flow

NE(router,GW)

CRM Core

CRMM(root) CRMM CRMM

CRMCRM CoreCRMM CRMM

CLM Core

CLMM CLM Core

CLM Core

CLMM

CLMM

CR CR CR

CRMM CLMM Plug-in module server

CLMMCLMM

OSGi OSGi

CLM

CRM CoreOSGi

CRMM CRMM

CRM: Communication Resource Management• Framework to coordinate the resources distributed along the

end-to-end• CRM Core formulates the distributed object environment• CRM modules have semantics of resource control• Security functionalities are key issues• OSGi is utilized in CRM Core

Application Application

Network

NA(Server)NA(Client)

Commun. flow

CRM Core

CRMM(root) CRMM CRMM

CRMCRM Core

CRMM CRMM

CLM Core

CLMM CLM Core CLM

Core

CLMM

CLMM

CR CR CR

CLMMCLMM

OSGi OSGi

CLM

CRM CoreOSGi

CRMM CRMM

CLM: Communication Logic Management• Control the communication

data directly• CLM module examples

– encryption, compression, QoS monitoring, shaping, policing, synchronization, packet filtering, dynamic transcoding

• Uses socket abstraction for the API to the applications

• Data is processed sequentially in each CLMM in the chain

Java socket API

Application

CLMCore

Java socket API(CSC socket API)

downstream chain

upstream chain

data stream

CLMM

CLMM

CLMM

CLMM

CLMM

Performance evaluation of CLM

GigE

AP

GigE-SW

CLMM

PC PC

AP

PC SpecPentium4, 2.4 GHz, memory 1GBOS: Windows XP Pro.

200

cp

ulo

ad

(%

)

AES(s)

AES(s)

Gzip(r)Gzip(s)

no-module(r)no-module(s)JavaSocket(r)JavaSocket(s)

5 10 20 50 1000

20

40

60

80

100

bandwidth(Mbps)

AES(r)

AES(r)Gzip(r)

Gzip(s)

no-module(r)

no-module(s)

JavaSocket(r)JavaSocket(s)

)

Cammelia(r)

Cammelia(r)

Cammelia(s)

Cammelia(s)

Bandwidth （Mbps）

CPU load （％）

s: senderr: receiver

CLMM

senderreceiver

Test CLM modules(1) Compression (Gzip)(2) Cipher

• AES• Camellia

Example 1: Nomadic Appliance

AirportStation

PrivateHome

PublicHot Spot

Business Office

Ethernet

Mobile

Ethernet

802.11b

802.11a 3G, PHS

802.11b, bluetooth

Example2: ASP

Application Application

Network

CRM CoreCRMM

CRM CoreCRMM

CLM Core

CLM Core

CLMMCLMM

subscriber ASP

CRMM(root)

CRMM CLMM

Plug-in module server

download

download

Push the modules to subscribers

E.g. Encryption

E.g. Decryption

Example 3: QoS control for video stream transmission

Application Application

NE(router)

CRM CoreCRMM(root) CRMM

CRM CoreCRMM CRMM

CLM Core

CLM Core

CLMM

CR

CLMM

CRM CoreCRMM

bottleneckServerPC,Internet TV, etc

NW resource control (packet priority)

Change video source quality

Observe transmission

quality

CR

Example 4: Home Security / Automation

HR

PC

AV

White goodsGW

Sensor

Data centerHGW

•Remote control•Alarm

•Remote control•Alarm

•Home Control•Home Control

•Module download•Remote management

•Module download•Remote management

CRM Core

CRMM CRMM CRMMCRMM

CRM Core

CRMM

CRM Core

CRMM

CRM CoreCRMM

CRM Core

CRMM

Some appliances support CSC

Target: Power Mgt., Security, Healthcare, Remote Mgt., Home Automation, Telematics, …

Communication Network

Plug-in Module Providers

•Service arrangement•Increase User satisfaction•Fast provisioning •Efficient NW resource allocation•Unattended service provisioning

•Time to market service provisioning •E.g. Special Encryption for secure transaction

•Automatic configuration of user appliance

•Application/Hardware quick implementation by reusing CSC modules

•Automatic configuration of communication appliances•No Technical knowledge or experience•Easy upgrade to new internet services

Vendors

User

Plug-inModule

NetworkProvider

ASP (Application Service Provider)

Relationship between CSC and OSGiCSC (Communication Service Concierge)

Adaptive and distributed network middleware for “end-to-end” communication.Proprietary NTT productInternally uses OSGi Framework (CRM)

OSGi (Open Service Gateway Initiative)

Gateway oriented centralized control model.Standardized specification in OSGi alliance.

CSC　　OSGi

Requirements to OSGi SpecificationSecurity Functions

Bundle mgt. on remote framework with security.Authentication between frameworks and/or bundles.

Bundle with digital signature(s).Need to simplify the complicated security framework for framework security by Java Security and bundle security by PermissionAdmin.

Service call between remote bundlesService export/use between bundles running on other frameworks.Should be completely the same as those in local bundles.

Charter• Design networks for IT and Network appliances at home.• Define a Digital Home-network System that well uses

communications and broadcasting services• Promote standardization of system components and development of

new technologies

Related activities in NTT Lab. and Japan (1)Digital Home-network Forum in Japan

Establishment• 1999.7 as a private forum• 66 companies or organizations (2003.8)

ScopeApplication / Total Architecture / Home Gateway / Middleware / Hardware, Links / Cabling and Construction

◆ Class of System ComponentHA (Home Access): Home GatewayHB (Home Bridge): Intelligent HubHC (Home Client): IP Consumer ElectricsHD (Home Device): Consumer Eclectics

◆ Logical ElementPS (portal Services)LC (Layer-1/2 Converter)BP (Boundary Point)EP (End Point)

EP

Proprietary technology domainIP technology domain

Home Client Class (HC)

Home Device Class(HD)

Home Access Class(HA)

Home Bridge Class(HB)

LCCommunications Network

Broadcast Network

IP Protocol Individual Proptcols

TVSTB AV-HDD D-VHS

DVD Digital AVPlane

PCPlane

Tel・FAXPlane

Home Appliance

Plane

PC Printer DSCDVC

Semicon Audio

Cordless PhoneCordless FAX

Video Phone

Air-CONMicrowave-

Oven Light Browser

Monitor-CameraRefrigeratorHealth-checker

EP

EP

EP

LC

Access NetworkGateway

PS LC

C-GWBP

STB

BPPC

BPTel／FAX

BPController

B-GW Based on ITU-T SG9 StudySystems Architecture of the Forum

OSGi is one way to add adaptability and customizability to the

gateways.

Establishment1997 established.106 companies or organizations (2003.4).

CharterDefine multiple layer protocol structure and control object thatallow interconnection to the devices/services using different protocols (incl. non-IP protocols).Designed for detached homes, collective housing, shops, and small office buildings. Open APIs and protocols

Scopeenergy conservation, home security, home health care, white goods networking,…

Related activities in NTT Lab. and Japan (2) :EHONET Consortium (http://www.echonet.gr.jp)

Related activities in NTT Lab. and Japan :Vision of EHONET

OSGi is one way to add adaptability and customizability

to the gateways.

ECHONET gateway/router

Power line

Broadband access

NW terminator

Home appliance Network

Related activities in NTT Lab. and Japan :Scope of EHONET development

Echonet Communications

Absorption of Protocol Differences

Layer3-7

Layer1,2

Power Line

Low-power

RFCable IrDA Lon

Service Middleware

Communication Middleware

Transmission media

Lower-levelCommunications IFs

Application Softeware

ConclusionNTT has developed adaptive middleware CSC for smart communications.

OSGi is an important part of CSC.

CSC is seeking to become a de facto standard or open specification.

Also, OSGi itself is very useful for NTT’s service handling.

ReferenceH. Maeomichi et. al, “A QoS Management Framework based on COP oriented Communication Resource Coordination,” ACM/IFIP/USENIX Middleware 2003.(http://www.cs.wustl.edu/~corsaro/papers/RM2003/p23-hiroyuki.pdf)A. Tsutsui et. al, “An Adaptive Communication Middleware for Network Service Coordination,”IEEE CCNC 2004.

Thank youQuestions?

Contact Info.: Ryutaro Kawamura

Senior Manager, NTT Cyber Solutions Laboratories kawamura.ryutaro@lab.ntt.co.jp