mobile media trends - khronos group · © nvidia corporation 2007 advantages of media acceleration...

Mobile Media Trends

ETF, Orlando, March 2007

© NVIDIA Corporation 2007

Mobile Media Demand

Volu

me

FeaturesCamera Audio 3MP+ Video TV UI 3D gaming

Media processing becoming increasingly central to mobile phones as handsets evolve

into general compute devices

Time

Accelerated, composited, 3D user interfaces could be the

“killer app” that causes every phone to adopt media

acceleration


New Breed Mobile Applications

Breakthrough software will not treat HH as small consoles/PCs

MobilityNavigation with GPS location

awarenessConnectedness

Unique information flow and social interactions – portals to WoW, YouTube, Second Life, MySpace, Cyworld

Multiple sensorsCameras for video and images,

sound – Augmented Reality

Handsets will need sophisticated mixed media acceleration

A GPS phone processesOpenMAX video to recognize and

overlay landmark information over high-quality OpenVG maps


Java Roadblocks

GLBenchmark – direct port of identical Java benchmark

Measured by Kishonti

Java (fps)

OpenGL ES (fps)

Native Advantage

Nokia N93 18.6 77.8 x4.2X5.1Sony Ericsson M600 6.0 30.6

Un-acceleratedJava

AcceleratedJava

AcceleratedNative

Simple 2D Games

Higher quality games

Seamlessly accelerated mixed-media JavaCompelling native mixed-media applications

Accelerated UI

x2-20 Performance

x3-5 Performance

Java is enabling only 20% of 3D graphics and media

performance to be realized

Java is enabling only 20% of 3D graphics and media

performance to be realized


FragmentationEvery handset is unique to program

Differences in OS, Java and media functionalitySevere platform fragmentation exists today

ISVs need 100s (even 1000s) of source variants of each title

Symbian 7, 8, 9, UIQ, S60PocketPC / Windows Mobile / WinCEMany Linux variants (and growing)

Java MIDP-1, MIDP-2, JSR fragmentation

Numerous RTOS with no consistently defined OS abstraction or media

portability – Nucleus, Synergy etc.


Open Standard Media Acceleration

Royalty-free open standard for advanced media acceleration

Advanced, Compositing

UI

Games and Game EnginesGames and

Game EnginesGames and Game Engines

Flash PlayersFlash PlayersFlash / SVG

Players & Text

TV and Video StacksTV and Video

StacksTV and Video Stacks

GPU GPUGPU GPU

Applications are portable to any OpenKODE-enabled

platform

Platforms can use any OS and GPU vendor


Media Accelerator SiliconGPU / DSPs / CPUs

Kernel Operating System (e.g. Rex, Symbian OS, Windows Mobile, Linux, Nucleus, Synergy)

Native and Java ApplicationsUI/Game/Flash/Video Engines

Software Platform (e.g. J2ME, Brew, UIQ, S60, WIPI)

OpenKODE = “DirectX for Handheld”

OSAbstraction“OpenKODE

Core”

2D/3D Vector 2D Streaming Media Enhanced AudioMediaAPIs

Trans-API ‘Plumbing’ for Mixed Media “EGL”

Full API set for NATIVE media applications

AL

NativeProvisioning

Except its an open standard, cross-platform, royalty-free and streamlined for handheld devices


Advantages of Media Acceleration

0.36 0.14

1.85

17.8

02468

1012141618

ARM9 32-Bit RISC at400MHz

DSP at175MHz

APA 512MiMagic 6

POWER EFFICIENCY

Faster Performance at Higher QualityHardware delivers at least 10 times the performance of

software – even on low-cost systems with low-end CPUs

Less PowerHardware accelerators exploit parallelism in a media pipeline to give a x10 increase in power

efficiency over software

Better User ExperienceSmaller screens need more advanced

graphics processing per pixel


Market Penetration of Native APIsMillions of unitsJon Peddie Research

Handheld Multimedia Devices report

0

100

200

300

400

500

600

700

800

900

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

MM phonesNon 3D MM phonesNative API based phones


NVIDIA Application Processors

- NVIDIA recently acquired PortalPlayer

- Already launched first application processor

- GoForce 6100 is first member of application processor family

Ultra-Low Power Super Integration

Full Software Platform Hardwired Performance


GoForce 6100 Application Processor

Ultra-low power video and audio playback

250 MHz ARM1176JZ-S

Hardwired Media co-processor

H.264 VGA Decode

VC-1 QVGA decode

Up to 10 mega-pixel camera

Fully integrated, high quality analog audio subsystem

Integrated USB 2.0/OTG PHY

Integrated TV encoder + DACs

2D Graphics Acceleration

Support for multiple DRM formats

Cyclone, WinCE


NVIDIA Mobile Media Solution

Java Graphics BindingsSVGt Player

JavaJVM

NativeInstaller

UI

OS Agile, Multi-threaded

Native Media API Stack

Range of GPUs and Application Processors

Growing Network of

Media Framework Component

Partners

Support, SDKs, Tools

Complete integrated package of tested and optimized media solutions to

reduce handset OEM’s time to market

Complete integrated package of tested and optimized media solutions to

reduce handset OEM’s time to market

http://tao-group.com/


Thank You!

Come to the Khronos session this afternoon for more details on all the Khronos handheld standards – including OpenKODE


Continued momentumNew devices for 2007

O2 XDA FlameGoForce 5500

MOTORAZR V3xxGoForce 4800

Modeo DVB-HGoForce 5500

MOTORAZR MaxxGoForce 4800

Kyocera W52KGoForce 5500


Strategic Investment

Founded in 1997San Jose, CA80 employeesLow Power graphics devices

Founded in 2000Pune, India200 employeesEmbedded multimedia SW

Founded in 1994Helsinki, Finland37 employeesEmbedded graphics SW

Founded in 1999HQ San Jose, CA268 employeesPersonal media devices

Imaging

TV

Audio

Video

HH GPU

Apps Proc

3D2D

Vector Graphics

Aug 2003

Mar 2006

Mar 2006

Jan 2007

Drivers/BSP

HH GPU

Drivers

mobile media trends - khronos group · © nvidia corporation 2007 advantages of media acceleration...

Documents