mobile convergence communicator (mcc) - … convergence communicator mcc system software mcc...

37
2007. 4. 17. Tae Joon Park Embedded S/W Research Division / ETRI Mobile Convergence Communicator (MCC)

Upload: hoangtuyen

Post on 25-Jun-2018

231 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

2007. 4. 17.

Tae Joon ParkEmbedded S/W Research

Division / ETRI

Mobile Convergence Communicator (MCC)

Page 2: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

2Embedded S/W Research DivisionEmbedded S/W Research Division

Contents

Concept of Mobile Convergence

Mobile Convergence Communicator

MCC System Software

MCC Applications

Page 3: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

Concept of Mobile Convergence

Page 4: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

4Embedded S/W Research DivisionEmbedded S/W Research Division

Concept of Mobile Convergence

Office Desktop Home Server Car ServerConvergence into a mobile deviceConvergence into a mobile deviceConvergence into a mobile device

Mobile ConvergenceComputing

EmailGroupware

Remote Desktop

StreamingFile View

Seamless Connect

Hands FreeI/O Redirection

Car Security

Page 5: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

5Embedded S/W Research DivisionEmbedded S/W Research Division

Requirements of Mobile Convergence

Technologies

Operating System

Integrated A/V managementDual-core IPC (Inter-Processor Communication)Embedded file systemAPIs for mobile resource use

(ex. system configuration, communication, multimedia, broadcasting)

UI & Middleware

Mobile remote desktopI/O redirection for multimediaMulti-point touch screenRemote management of operating system and applicationsRouting for inter/intra network of mobile devicesSeamless handover between CDMA and WLAN

Development tools

Per thread resource usage analysis & monitorPrelinking / preloadingMulti-core supported debuggingAnalysis & optimization for DVS (Dynamic Voltage Scaling)

Communication CDMA, HSDPA, WiBroWLAN, Bluetooth

Applications

Mobile officeMobile broadcastingMobile co-browsingMobile entertainment

Page 6: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

6Embedded S/W Research DivisionEmbedded S/W Research Division

Applications of Mobile Convergence

Mobile Convergence

Robots Telematics m-IPTV PMP SmartPhone MCC

Optimization of characteristics of mobile devicesOptimization of characteristics of mobile devices

Target supported lightTarget supported light--weight graphic systemweight graphic system

Kernel auto configuration & installationKernel auto configuration & installation Appliance platform supported middlewareAppliance platform supported middleware

Mobile routing between Inner and OuterMobile routing between Inner and Outer

Independent environment of target CPUsIndependent environment of target CPUs

Office Desktop Home Server Car Server

Page 7: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

MCC : Mobile Convergence Communicator

Page 8: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

8Embedded S/W Research DivisionEmbedded S/W Research Division

Technologies within MCC

Technologies within MCC

Operating SystemCustomizable kernelAutomatic kernel installation & configurationDevice drivers for MCC

UI & Middleware

Frame buffer-based light-weight window systemLight-weight 2D/3D/Vector graphic libraryScalable UI for various resolution typesAd-hoc based plug-and-play (UPnP) for mobile devices

Development tools Integrated development environmentFrame buffer based GUI builder

Applications Robots, Telematicsm-IPTV, PMP, SmartPhone

Page 9: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

9Embedded S/W Research DivisionEmbedded S/W Research Division

Overall Architecture

Hardware PlatformHardware Platform

RealReal--time Operating Systemtime Operating SystemPower

ManagementReal-time Scheduling

Resource Management

Mobile Convergence ServicesMobile Convergence ServicesMobile Convergence ServicesMobile Office Mobile CobrowsingMobile

Entertainment

Comm. & Broadcasting Management

TelematicsM-IPTV/PMP RobotsSmartPhone

Mobile Device Support

Dual-core Support

Integrated Development Environment

Thread Analysis & Monitoring

User InterfacesUser Interfaces

MiddlewareMiddleware

Acceleration supported Window Manager

Mobile Remote Desktop I/O Redirection

Auto Investigation & RegistrationMobile Routing

Embedded S/WDevelopment ToolEmbedded S/WEmbedded S/W

Development ToolDevelopment Tool

Frame Buffer Window System Vector Graphic Library Adaptive Graphic

Resource Scalable UI

Standard Wireless Service

Mobile Web Services Dynamic Resource Management AgentRemote Upgrade

Smart Car

Page 10: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

10Embedded S/W Research DivisionEmbedded S/W Research Division

Target H/WDiskOnChip

IDE HDDMiniSD

LCD

T-DMBBluetooth(Headset)

USB 2.0

Console

PMICAudio Touch

WLANCDMA

KeyB/D

Camera

2700G5

GPS

Flash

Qplus kernel – 2.6.15.7

ALSA DD FrameBuffer DD V4L DD Network Protocol Stack

LCD, Battery Control Interface

File System

Power ManagementPPP

Library Stack

Glibc 2.3.2

ALSA Lib

X-Window

GTK 2.6GDB Agent

6.3.90

Telephony Lib - Voice Comm.- SMS Comm.- PPP Connection - (phone daemon)

WIPI Client Env.(WIPI 2.0.1 Engine)

HCT Agent HAL

Runtime Engine

WIPI C WIPI Java

Window ManagerApplication Manager

ETRI solution lib.………

CrossTool Chain

gcc-3.4.3glibc-2.3.2

binutils-2.15.91.0.2

for SystemDeveloper

BootloaderBlob

2.0.5-pre3

for ApplicationDeveloper

• X-Window• GTK+• Multimedia

ETRI’s solutions for MCC

WIPI App. Mobile Office MobileEntertainment

MobileBroadcasting

MobileCollaboration

Media Player

Image Viewer

UPnP Stack

E-mail Client

File Viewer

Remote esktop

StreamerChannel

Client Channel

Video LAN Client

WIPI Game

Jlet

Clet

JTAG(OpenICE)

Development

Tool

TB2.2.11

Esto1.4.1

TelAppDialerSMS

System Apps

Setting Apps

MCC Software Architecture

Flash Player

Web Share engine

Video streamer

Audio streamer

Page 11: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

11Embedded S/W Research DivisionEmbedded S/W Research Division

Major Features of MCC (1st Generation)

HardwareDual processor architecture (PXA270 & MSM5500)3.5 inch TFT-LCD touchscreenSliding QWERTY keyboard

Operating system for MCCKernel & device drivers

XFreeDesktop for MCCTAPI (Telephony API) for KTF CDMA

Page 12: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

Operating System for MCC (Qplus)

Page 13: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

13Embedded S/W Research DivisionEmbedded S/W Research Division

Overall Development Environment

Target

Target Agent

EVM

FireFox, Mplayer, Gstreamer,…

System Call Interface

Power Management

Fast Boot Device Drivers

Real-time Scheduler

GTK

Tiny-X

Standard Library

FFS/MMFS

Host Platform (Linux or Windows)

Remote IDE

Remote Monitor Remote Debugger

GUI Builder

Power ConsumptionTool

Real-timenessAnalyzer

D/D Development Tool

Targ

et B

uild

er

HOST TARGETEthernet, Serial/USB, JTAG,…

Target (Qplus)Host (Esto)

Page 14: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

14Embedded S/W Research DivisionEmbedded S/W Research Division

Overview of Qplus

Linux-based embedded S/W platformQplus system and solutions

Qplus SystemBootloaderLinux kernel 2.6.x and standard C librariesBSP (For various graphic chips and boards)MMFS (Multi-Media File System) / FFS (Flash File System)Light-weight window system and graphic libraries

Qplus SolutionsTarget Builder: Qplus kernel configuration toolApplications: Web Browser, Media Player, and more

Page 15: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

15Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (1/7)

Linux-based kernelLinux kernel version: 2.6.15.7Optimized footprint on MCC specifications

Kernel, device drivers, standard C libraries, graphic libraries, and basic applications

Real-time featuresPreemptive kernel and lock-breakingGuarantees of 50 usec latency

Power managementPower management based on power consumption pattern

FastbootDirect boot from NOR or NAND flash memory

Various device driversRapid device driver support via ETRI’s collaborators

Page 16: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

16Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (2/7)

Lightweight GUILightweight window system based on DirectFBGUI builder based on lightweight window system

Various applicationsMedia player optimized on MCCLightweight web browser

Target system configurationTargetBuilder: Qplus reconfigurationEsto: Target loading

Page 17: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

17Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (3/7)

Supported Hardware

Arch CPU Target OS

VIA-Cyrix Family(Samuel, Ezra, Nehemia, Eden ESP, Eden-N)

Intel Pentium Family, Celeron Family

Intel PXA27x Family

Samsung S3C2400, S3C2440

AMD Alchemy Family(Au1000, Au1100, Au1200, Au1500, Au1550)

PowerQUICC

Qplus CE 2.3X86

Boyo

Qplus MEARM

Qplus ME

MIPS Via Collaborator

PPC Via Collaborator

Page 18: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

18Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (4/7)

Real-time SchedulingKernel mechanism and scheduler support for max. latency of 50 usec

Ingo Molnar’s real-time preempt patch has been appliedThread-based ISR (Interrupt Service Routine)Most of kernel codes are based on mutex-lock

Max. latency(usec)

Min. latency(usec)

Avg. latency(usec)

Vanillakernel

7021.25 2.81 7.89

Qplus kernel 36.83 5.58 7.16

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Pre

eptio

n L

ate

ncy(

mse

c)

Page 19: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

19Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (5/7)

Power ManagementPower management on system level

Auto suspendResume on Power On

Power management utilitiesBattery status monitorBacklight

Page 20: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

20Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (6/7)

Remote System ManagementOverall system upgrade within 30 seconds

Partial upgrade within an object

Fastboot within 15 seconds

Host Upgrade ServerMCC

Upgrade registration

Stores patches Upgrade catalog request

Upgrade catalog transmission

Upgrade request

DownloadDownload

UpgradeUpgrade

RebotRebot

[Upgrade Process]

User permission on upgrade

Page 21: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

21Embedded S/W Research DivisionEmbedded S/W Research Division

Qplus in Detail (7/7)

Lightweight window systemFrame buffer based window systemWindow system is as small as 5MBMultiple windows managementLightweight Hangul IME (Input Method Editor)

Window style setting snapshot

Page 22: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

22Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (1/10)

Target BuilderProfile-based system configuration tool

Both kernel, libraries, and applications

Multiple partition supportWarning on partition size overflowInter-partition package dependency checkRelocation of package installation path (RPM)

[Multiple partition setting]

[Relocation of package installation path]

[Profile Wizard]

Page 23: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

23Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (2/10)

ESTO (Embedded S/W Toolkit)Target cross compiling environment

ARM, x86, MIPS, and more

Remote debugging on dual core processorPower consumption analysis in terms of both voltage and current

[Debugger for dual core processor][power consumption analysis]

JTAG

Page 24: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

24Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (3/10)

Debugger for dual core processorNew perspective for dual core processor debuggingNew debugging engine for multi-core processorDevelopment of ICE facility for multi-core processor debuggingTarget agent for various processors

[Selection and setting screen snapshot] [Debugging snapshot]

Page 25: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

25Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (4/10)

Support PlatformsTarget : X86, ARM, XScale, MIPS, PowerPCHost : Linux, Windows

FeaturesIntegrated development environment based on EclipseRemote and non-stop debuggingEconomic firmware debugging with JTAG technologyRemote monitoringPower analysis and optimizationEasy device driver developmentEasy GUI design

Page 26: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

26Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (5/10)

IDEProject Management

Creation, configuration, and buildingMakefile managementQplus package import/export

DevelopmentSource code editing facilities

– Syntax highlighting, automatic formatting, class browsing, etc.

Project Build & Remote Execution Configuration

Page 27: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

27Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (6/10)

DebuggerRemote Debugger

Remote debugging starts with just one button clickNonstop-debugging with tracepoint and replay

– For time-sensitive applications

JTAG-based Debugger A cost-effective way to debug applications on a target system

– Needs only a cheap JTAG adaptor Supports full C source level debuggingSupports both breakpoint & tracepoint

Call stack view

Source view

Console view

Variables view

Source outline

Registerview

Call stack view

Source view

Console view

Variables view

Source outline

Registerview

Snapshot of Debugger

Page 28: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

28Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (7/10)

GUI Builder (gDesigner)

Desktop PC / Notebook PC

Simulation

window

Widget insertion

Widget property editing

Design window

Hardware button

event testing

Desktop PC / Notebook PC

Simulation

window

Widget insertion

Widget property editing

Design window

Hardware button

event testing

Page 29: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

29Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (8/10)

Target Monitoring ToolConcurrent multiple-target monitoringVarious target resource monitoring

CPU, memory, process list, process memory map, kernel module, etc.

GUI based kernel event traceRemote tracing of system call and library function

Target Browser

Process List

CPU/Kernel Infomation

CPU/Memory Usage

Target Browser

Process List

CPU/Kernel Infomation

CPU/Memory Usage

Page 30: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

30Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (9/10)

Optimization and Analysis ToolOptimizing Application

By using loop transformation such as loop distribution, loop interchange, loop unrolling, and scalarization

Analyzing Power of Embedded ApplicationTogether with performance and code size

GUI-Based Integration of Optimizing and Analyzing

Multi-meter & Target System Optimization & Analysis Tool

Page 31: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

31Embedded S/W Research DivisionEmbedded S/W Research Division

Development Tools in Detail (10/10)

Device Driver Development ToolSpecialized Toolset for Device Driver development

Driver Development IDEDriver module building & installation

Driver Project WizardSkeleton code generation from the driver requirement specification including device name & id, driver type, bus type, entry-point names, etc.

Device Test WizardHardware resource access program routine generation & test

Target DevicesPCI, USB, I2C, etc.

Page 32: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

MCC Applications

Page 33: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

33Embedded S/W Research DivisionEmbedded S/W Research Division

Mobile Office

Mobile OfficeConverging office computing environment into MCC

E-Mail browsingOffice file viewer

Event transmission

Refresh remote screen

Office PC

MCC Server

E-mail Notification

View document

Check E-mail

SendmailE-mail transmission

Email and View Documents

Mobile Remote Desktop Service

Sharing remote screen

Page 34: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

34Embedded S/W Research DivisionEmbedded S/W Research Division

Mobile Entertainment Center (1/2)

Sharing multimedia contents on remoteRunning local/remote multimedia contentsImage/Audio/Video Auto-discovery of remote multimedia contents via UPnP AV spec.Lightweight Flash engine for MCCNew Flash UI for MCC

UPnP AV MediaRenderer

MediaPlayer

UPnP AVControl Point

Flash User Interface

QPlus ( Embedded Linux )

UPnP AV MediaServer

ContentsInfo. Manager

HTTP StreamingServer

User Interface

Windows

Flash Engine for Mobile Devices

Page 35: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

35Embedded S/W Research DivisionEmbedded S/W Research Division

Mobile Entertainment Center (2/2)

Remote A/V Media Sharing Service

Networks

MCC(QPlus)PC(Windows)

Streaming Server Media PlayerStreaming

1. Register contents 2. Discover PC and content lists

3. Display contents/thumbnails

4. Request contents streaming

Page 36: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

36Embedded S/W Research DivisionEmbedded S/W Research Division

Mobile Cobrowsing

Sharing web screen

• URL Change• Scrolling• Scripting• Voice Chat

• URL Change• Scrolling• Scripting• Voice Chat

Page 37: Mobile Convergence Communicator (MCC) - … Convergence Communicator MCC System Software MCC Applications Concept of Mobile Convergence Embedded S/W Research Division 4 Concept of

37Embedded S/W Research DivisionEmbedded S/W Research Division

Thank you&

Q&A