multimedia evolution public for web approved · 2 the arm vision a world in which all electronic...

25
1 Multimedia Evolution Ian Smythe Director of Marketing Media Processing Division

Upload: hahuong

Post on 10-Sep-2018

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

1

Multimedia Evolution

Ian Smythe

Director of Marketing

Media Processing Division

Page 2: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

2

The ARM Vision

A world in which all electronicproducts and services are based onenergy-efficient technology fromARM®, making life better foreveryone

Page 3: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

3

Consumer Entertainment Drivers

Page 4: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

4

Revolution in Content Consumption

Growth in connecteddevices in the home

Major change in howcontent and servicesare consumed

Killer apps are socialnetworking and videosharing

Personalized contentdriving increasedneed fortransactional security

Petabytes per month

Sources: Cisco VNI Q4 2009: Futuresource Consulting

% of Homes withIP Enabled Devices

Page 5: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

5

Enabling the Change

Infrastructure

Global adoption of 3G with2.8Bn subscribers and ~45%penetration by 2014

Evolution of mobile broadbandaccess from 2G to LTE+

Services moving to the cloud

Enabled by multi-serviceIP networks

OEM innovation driving widerange of products into themarket

Page 6: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

6

The PCInternet

The MobileInternet

The Internetof Things

Minicomputer

Mainframe

Page 7: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

7

Mobile is winning... It’s amazing tome that the smartest developers noware writing apps for mobile beforethey write for Windows or Apple Macdesktop operating systems.

Eric Schmidt – Google CEO, July 2010

Page 8: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

8

Mobile Phone demands

Personalizedcompute platform

Advanced video, console qualitygaming

Navigation with augmented reality

Secure transactions

All-day battery life

On the Move – 2014 Mobile

Mobile Computing demands

Support for richinternet applications

Secure transactions

Continual innovationin UI and form factors

High speed wireless data access

All-day battery life

Page 9: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

9

Mobile 1956: H Osborne of AT&T

Page 10: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

10

1924: Google and 1935 Twitter

Page 11: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

11

Social Media – changing the world

Page 12: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

12

THE IMPACT OFIMMEDIATE ACCESS ONMULTIMEDIA EVOLUTION

Page 13: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

13

GPUs Everywhere

Anything with a screen

Software is a necessity

Graphics acceleration is key

Page 14: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

14

Graphics demands increasing

More complex effects require more processing...

Same number of output pixels, but more work done for each pixel

For example, a dual core ARM Mali™-400 MP can perform 20 shader operationsper cycle

...in addition to texture filtering, blending, anti-aliasing...

…realtime contrast, brightness and saturation adjustment with YUV texturing to275MPix/s

YUV texturing to ”pull”video into graphics

pipeline

...including realtimecontrast, brightness and

saturation adjustment

Per-pixel depth of fieldeffects

Per-pixel diffractioneffects

Page 15: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

15

Insatiable Performance Requirement

WVGA WXGA 1080p

Screen resolution: 4.3x increase in number of pixels

>40x increase in graphics processing

Increasing content complexity: >10x increase in processing per pixel

OpenGL ES 1.1 Samurai OpenGL ES 2.0 Taiji Desktop(Complexity=1) (Complexity=5) (Complexity=10)

With power budget suitable for handheld.

Page 16: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

16

The Gaming Experience

Complex content (geometry,texture data, etc…)

Smooth gameplay throughhigh framerates

Improved anti-aliasingtechniques

Realistic environments, waterreflections, shadows, bumpmapping, environmentmapping, etc...

Page 17: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

17

The UI Experience

User interfaces exploit MaliGPU

Overlay and alpha blending

Complex Transitions

Animated icons

Applicable for phones, TVs,set top boxes, car dashboards - anything with ascreen

Page 18: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

18

A World of Infinite Content

Internet everywhere

Broadcast, pay-per-view, pre-recorded, web content, usergenerated content, video conferencing…

Almost infinite array of content

How to personalize and simplify access?

How to draw consumers to directed advertising?

Good, intelligent user interface design

Critical for any screen-based solution

Page 19: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

19

ARM Graphics Architecture

Design principles

Tile-based deferred rendering is the rightchoice for power-efficient design

Multicore delivers true performance scalability

Focus on compute performance for advanced content

Common ISA and software driver across a family of GPUs

Delivering industry leadership

Performance, memory bandwidth, area and power efficiency

Constant innovation

New GPU product on regular tick – 2x increase in performance / year

Common software driver to protect software investment

Improved performance per core in each generation

Increased architectural efficiency (performance/area and power)

Page 20: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

20

1.0

1.5

2.0

2.5

3.0

3.5

4.0

1 2 3 4

Re

lati

veP

erf

orm

an

ce

Number of cores

Multicore performance at1080p

OpenGL ES 2.0 OpenGL ES 1.1

Mali-400 MP

World’s 1st embedded multicore GPU

Khronos OpenVG® 1.1, OpenGL® ES 2.0 support

Separate vertex (geometry) and fragment (pixel)processing for maximum parallel throughput

Industry-leading memory bandwidth efficiency

Level 2 cache reduces memory bandwidth andsystem-level power consumption

Multicore performance scalability

1 to 4 fragment processors

Near-linear performance scaling in real systems

Delivers in excess of 1G visible* pixels/s

Single, optimized software driver for allconfigurations

*No artificial overdraw assumptions

Multicore Performance Scalability

Page 21: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

21

Mali & Stereoscopic 3D

ARM have already demonstrated Stereoscopic 3D on bothMali-200 and Mali-400 platforms at HD 720p

Demo details: Mali renders the entire world twice per frame at 30 frames per second

Mali-200 driving HD720p, 1280x720 horizontal split

Triangle count 16,000 (8,000 per eye) / frame

Average pixel shader complexity : 2-6 cycles per pixel draw,5% - 10% overdraw

No changes to Mali driver stackrequired to achieve stereo 3D

Essentially Stereoscopic 3Drepresents an increasedperformance load on the GPU asmore pixels need to be processed

Page 22: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

22

Summary

Bewildering array of content available

Increasingly complex content and more and more interaction

Good UI design allows personalization and simplifies accessto content

GPU is a must-have for connected screens

Use of 3rd dimension & the “Apple effect” for UI

HD screens demand very high pixel throughput & bandwidth

ARM’s partners deploying GPUs today in wide range ofdevices

Bringing the multimedia evolution to you

Page 23: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

23

See Mali demos from our partners

Amlogic: Android™ 2.2 Quake demo

STM: Sti7108 demo

Arphic: 3D font demo on SmartQ

Brogent: 3D UI on SmartQ

Digimax: Bare eye Stereoscopic 3D TV

Rightware: UI demo

TAT: UI demo

Come and see us:

Mali-400 tablet demo (TAT)

SmartQ raging thunder 2,

Stereoscopic game “BruteForce”

Want to know more?

Page 24: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

24

...or go to Mali Developer Center

Full range of Mali developer resources

Tools, Development boards, Demos, Examples, Tutorials

www.malideveloper.com

Page 25: Multimedia Evolution public for web approved · 2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM®, making

25

QUESTIONS