call for participation to the chinese mobile industry · © copyright khronos group, 2012 - page 13...
TRANSCRIPT
© Copyright Khronos Group, 2012 - Page 1
Call for Participation to the Chinese Mobile Industry
Beijing, March 2012
Neil Trevett President, The Khronos Group
Vice President Mobile Content, NVIDIA
© Copyright Khronos Group, 2012 - Page 2
Urgent Mobile Market Opportunity!
China - Explosive domestic mobile
market growth - Intends to increase leadership
in global mobile markets
Khronos - Defining open global mobile
technology standards - Driving mobile
device capabilities
OPPORTUNITY FOR CHINA TO DRIVE DIRECTION OF GLOBAL MOBILE TECHNOLOGY
© Copyright Khronos Group, 2012 - Page 3
Khronos Connects Software to Silicon
APIs enable software developers to turn silicon
functionality into rich end user experiences
Embedded and Mobile 3D
Advanced Audio
Parallel Computing
Camera, Images and Streaming Media
Khronos creates OPEN STANDARD APIs for advanced hardware acceleration
Graphics, video, audio, compute, visual and sensor processing
15 ACTIVE APIs
© Copyright Khronos Group, 2012 - Page 4
Why are Khronos Standards Key? • Khronos APIs define core mobile device functionality
- Low-level “Foundation” functionality needed on every platform
• Khronos standards have strong industry momentum
- Shipping on billions of devices
- Shipping on multiple OS
• They are FREE
- No royalties
Khronos standards drive mobile market growth by expanding device capabilities
Tianyu
HTC ZTE
© Copyright Khronos Group, 2012 - Page 5
Khronos History
2000 2003 2004 2005 2006 2008 2009 2011
Embedded and Mobile 3D
Advanced Audio
Parallel Computing
Camera, Images and Streaming Media
3D Digital Asset Exchange format
Vector 2D
Cross platform desktop 3D
Plugin-free 3D Web Content
Web Compute
Hardware accelerated vision functions
OpenVL
Unified Sensor and Input Processing
Over 100 Members 15 Active Standards
Surface Management
© Copyright Khronos Group, 2012 - Page 6
Board of Promoters
Over 100 members – any company worldwide is welcome to join
Apple
© Copyright Khronos Group, 2012 - Page 7
Board of Promoters
Over 100 members – any company worldwide is welcome to join
Khronos has 30% Asian
Membership
© Copyright Khronos Group, 2012 - Page 8
Board of Promoters
Over 100 members – any company worldwide is welcome to join
Apple
The Khronos Board of Directors has made Chinese industry participation a priority and committed
significant financial and staffing resources!
© Copyright Khronos Group, 2012 - Page 9
Khronos and China • Participation in Khronos standardization
will help Chinese companies to compete
in the global mobile market
• Avoid costs and market confusion caused
by fragmentation
• Khronos needs Chinese company
participation to help grow market
opportunities for all
• Key Chinese companies:
- Silicon vendors
- Mobile OEMs
- Mobile carriers Khronos hosts first DevU in
China at PC Expo Beijing and meeting with Mayor of Tianjin
October 2004
China Mobile Terminal Industry Development Forum Shanghai
November 2005
Mobile Entertainment World Shanghai November 2007
DevU Beijing – Tsinghua University Dec 2010
Outreach to Chinese Industry Beijing and Shanghai
March 2012
Khronos Group are Gold Sponsors of the China Game
Developer Conference on July 25-27, 2012 in Shanghai
Khronos China
Outreach
© Copyright Khronos Group, 2012 - Page 10
The Value of Khronos Participation
Gather Industry Requirements for future
silicon acceleration
Draft Specifications Confidential to
Khronos members
Publicly Release Specifications and Conformance Tests
Companies Release Products
Have a voice in how key standards
evolve to suit your business
needs
Develop products in
parallel with spec drafting
for faster time to market
See an early window into the
future of the industry technology
roadmap before products are developed
Products are aligned with global market needs and trends
The Khronos standardization process is proven to RAPIDLY generate industry consensus on future hardware acceleration functionality to EFFICIENTLY create new market opportunities
Members can ship products faster than
non-members
© Copyright Khronos Group, 2012 - Page 11
Khronos Working Group Process
Working Groups (WGs) One working group per API
Promoter Members - Participation and vote in WGs - Board seat for strategy, budget and spec ratification
Contributor Members - Participation and vote in WGs
Academic Members - Participation in WGs
Ratified Specifications
Conformance Tests and Adopters Program
SDKs, Sample, Ref Cards and Man Pages
Adopters Build conformant implementation and products
Developers Develop applications using the APIs
$$$ $
$
Members
Wider Industry
© Copyright Khronos Group, 2012 - Page 12
Khronos Cooperative Model
Khronos Specification Conformance Tests
Khronos standards have significant value - 100s of
man years invested by industry leading experts
Khronos creates open, royalty-free API standards
Khronos Members agree not to assert IP claims against other Members or Adopters
for CONFORMANT IMPLEMENTATIONS
• Solid legal framework for industry cooperation • ‘By the industry for the industry’ • Open to any company to join
• How does Khronos make money? • It doesn't! • Khronos fees cover costs of
creating, deploying and promoting specs and tests
© Copyright Khronos Group, 2012 - Page 13
Khronos Conformance Process
• Implementers of Khronos specifications are not covered under the Khronos
IP framework unless their products are submitted and pass conformance!
• Khronos administers an Adopters Program for each API
- Adopters program provides full test access and trademark license for small fee
Company executes Adopters
Agreement and pays fee (usually
US$10K for unlimited products)
Port and execute tests on products to generate test
results
Upload test results to Khronos private
web-site. Peer Review by
members/Adopters
Successful Review of results enables products to use
Khronos trademarks and to be listed on Khronos website
Company implementing Khronos spec
wishes to use the trademark
Example: “We implemented OpenGL ES”
Full use of logo and
trademark
Full use of logo and
trademark with small disclaimer
Restricted use trademark (not
logo) with disclaimer language
Adopter Benefit
© Copyright Khronos Group, 2012 - Page 14
Khronos API Ecosystem Evolution
New API technology first
evolves on high-end platforms
Mobile is the new platform for
apps innovation. Mobile
APIs unlock hardware and
conserve battery life
Apps embrace mobility’s
unique strengths and need
complex, interoperating APIs
with rich sensory inputs
e.g. Augmented Reality
Diverse platforms – mobile, TV,
embedded – means HTML5 will
become increasingly important
as a universal app platform
DESKTOP
MOBILE
INTEROP, VISION AND SENSORS
WEB
© Copyright Khronos Group, 2012 - Page 15
10 Years of OpenGL ES! • OpenGL for embedded and mobile devices
- Eliminates redundant and legacy features
- Adds extensions to make it mobile-friendly
• The dominant 3D API for mobile devices
- Widely adopted for STB, DTV, automotive,…
- Hundreds and hundreds of millions shipped
• Runs high-end content and engines
- UE3, Unity, Unigine, Rage
© Copyright Khronos Group, 2012 - Page 16
Augmented Reality – the Next Big Thing
Camera video stream sent to the compositor
3D Augmentation Rendering
3D augmentations composited with video stream
Camera Tracking
Camera images used to track the
camera’s location and
orientation
Camera-to-scene transform locks the 3D rendering to the real world
© Copyright Khronos Group, 2012 - Page 17
Augmented Reality Functionality
Camera Processing
3D Rendering and Video Composition
Audio Rendering
Application on CPU
Positional and GPS Sensor Data
Computer Vision and Tracking
Position
and Tracking
Semantics
Control Camera, Preprocess and generate
video streams
Video TAP to CPU
Synchronization and sensor
fusion
Video stream to GPU
Positional Sensors
Camera EGLStream
Much more flexibility than just “overlay augmentations
over background”
OpenVL
© Copyright Khronos Group, 2012 - Page 18
Android Native API Adoption
OpenGL ES OpenGL ES 2.0
Shipping - Android 2.2
OpenSL ES OpenSL ES 1.0
Shipping – Android 2.3
OpenMAX AL OpenMAX AL 1.0
Shipping - Android 4.0
EGL EGL 1.4
Shipping under SDK
OpenCL Not yet adopted
StreamInput Working group will ship spec in 2012
OpenVL Working group will ship spec in 2012
© Copyright Khronos Group, 2012 - Page 19
Extended Native APIs on Android • Native APIs can be shipped as NDK extensions before Google Adoption
- Do not break/change existing Google APIs
• Khronos APIs have strong momentum in the silicon community
- Evangelize Google to adopt into standard platform
• Extended APIs can be used by:
- Bundled apps, Market apps with API selection
- Multiple APKs behind single multi-APK SKU
Standard Android SDK
and NDK
Extended NDK for
Key use cases
Evangelize Google and ISVs to
adopt enabling APIs
E.g. video, camera, imaging,
sensor and composition APIs
© Copyright Khronos Group, 2012 - Page 20
HTML5 – Cross OS App Platform • Increasing diversity of devices
creates a demand for a true cross OS
programming platform
• BUT need more than “more HTML”
Rich Experiential Processing Multi-core CPUs
Rich 2D and 3D GPU GPU Computing
Multiple HD cameras Image and vision processing
Video encode/decode Audio encode/decode
Inertial and positional sensors
How can the Browser rapidly assimilate such diverse functionality?
Traditional Web-content
© Copyright Khronos Group, 2012 - Page 21
Leveraging Native API Investment into HTML5 • HTML5 evolving into cross-platform programming platform
- Gradually exposing complete system capabilities
• Opportunity to synergize Web and native APIs development
- Leverage native API investments, reduce developer learning cycles
• Khronos and W3C creating close liaison
Native APIs shipping or working group underway
JavaScript API shipping or working group underway
WebVL? Vision
Processing
WebAudio Advanced JavaScript
Audio
WebMAX? Camera
control and video
processing
Possible future JavaScript APIs
Device and Sensor APIs
Device Orientation
Working Groups
Native
JavaScript
OpenVL
Canvas
© Copyright Khronos Group, 2012 - Page 22
Khronos Members
Enhancing Educator Efforts
KITE Educators
Students
Industry Best Practices
Khronos-related courseware and exams
Skilled Employees
Khronos does not teach courses … … Khronos assists Educators in teaching Khronos APIs
Courseware For Review
© Copyright Khronos Group, 2012 - Page 23
In Summary • The Khronos standardization process has defined mobile hardware
acceleration and helped create multi-billion dollar markets
• Aligning the Chinese and global mobile markets will further expand market
opportunities and avoid fragmentation for the benefit of all
• Chinese companies will benefit significantly from Khronos participation and
standards development will reflect Chinese industry requirements
• Khronos has identified Chinese industry participation as a priority
Connecting Software to Silicon