interactive multimedia applications based on itu-t h.762 lime
TRANSCRIPT
Interactive Multimedia Applications
based on ITU-T H.762 LIME
Fernando Masami Matsubara
Mitsubishi Electric Corporation
19 July 2011
Rio de Janeiro, Brazil
Workshop on
“Harmonization of Web and IPTV technologies”
LIME Background• Enhanced content / datacasting, interactivity
• Internet ubiquity, faster broadband access
• Early attempts: web browsers in TVs– lean forward problem
– inadequate user interface
• Standards: – W3C CSS TV
– CEA-2014
– BML: used extensively in Japanese Digital TV (ARIB/ISDB)
– LIME: ITU-T Recommendation H.762 • consented in 2009
• builds on BML
• targets IPTV
LIME design considerations:
(1) Synchronization among multiple sources
(2) Simplification of navigation (no mouse)
(3) Rendering tailored to TV
Contextual
Information
Live
TV
EEDDAA BB
NetherlandsNetherlands
JapanJapan
DenmarkDenmark
CameroonCameroon
NET JPN DEN CMR P W D L G
1-0 2-0 6 2 0 0 3
0-1 1-0 3 1 0 1 0
0-2 2-1 3 1 0 1 -1
0-1 1-2 0 0 0 2 -2
Group C
C
Menu MyPageStandings Players
NewsNews
WeatherWeather
TrafficTraffic
On-demand portalOn-demand portal
Blue YellowRed Green
Overview of ITU-T Recommendations for IPTV
G.1080: IPTV QoE
G.1081: Performance Monitoring
X.1911 Req & arch for IPTV security
H.622.1: Req & Arch for
IPTV Home networks
H.750: Metadata for IPTV Services
H.701: Content Error-Recovery
H.770 : IPTV Service discovery
Architecture, requirements, network
Security and Content Protection
Quality of Experience
Home networking Applications and end-systemsH.721: IPTV Terminal (Basic)
H.761: Ginga-NCL
H.762: LIME
4
H.763.1: Cascading style sheets for IPTV services
H.740: Application Event Handling
Y.1901 IPTV Service Requirements
Y.1910 IPTV Functional Arch
Y.sup5 IPTV Service use cases
Y.2007: NGN Capability Set 2
Y.sup7 NGN Release 2 Scope
G.1082: Improving robustness of IPTV performance
ITU-T H.762
LIME for IPTV
ITU-T IPTV Standards
IPTV domains
ITU-T IPTV end-end solution
Content
provider
Service
provider
Network
provider
End userGateway H.700 Series
H.721
IPTV set-top box
TV
Mobile
HEWLETTPACKARD
PC
Web server
provides LIME
documents
User agent
renders LIME
documents
IPTV Terminal w/LIME support
Audio output
Video output
Remote
SCP
client
Presentation
Network I/F
Application Client Functions
IPTV Terminal Transport Functions
Content Delivery Client
Functions
SCP Client Functions
Audio/Video/
Data decode EPG AV
Player MAFR user
agent
ECG Channel selection
UDP TCP
IP
Phy / Link
IGMP/MLD
RTP/FEC
Descrambling
Decryption
TTS to TS conv.
Navigation data flow
Control data flow
Data flow
Demux
RTSP
HTTP/TLS
License/key flow
From H.721
Appendix II
LIME HTML Extensions
• bevent and beitem
Event control. Events sent from the station to the
receiver to trigger an action. E.g. synchronize
contextual data with main content stream (e.g.
sports statistics).
• body& invisible
switches off the document to let main service
(usually a TV program) undisturbed
• onfocus/onblur attributes of div& p& span&
object& address the lack of a mouse
LIME Script Profile
Subset of ECMAScript in LIME-script profile
is limited to eight objects
– global
– Object
– Function
– Array
– String
– Boolean
– Number
– Date
LIME CSS Profile
• Extended properties for
– Color
– Resolution
– Aspect ratio
– Navigation assuming a remote controller
EEDDAA BB
NetherlandsNetherlands
JapanJapan
DenmarkDenmark
CameroonCameroon
NET JPN DEN CMR P W D L G
1-0 2-0 6 2 0 0 3
0-1 1-0 3 1 0 1 0
0-2 2-1 3 1 0 1 -1
0-1 1-2 0 0 0 2 -2
Group C
C
Menu MyPageStandings Players
NewsNews
WeatherWeather
TrafficTraffic
On-demand portalOn-demand portal
Synchronized contextual data
from LIME server
Linear TV
Interactivity via focus selection
Blue YellowRed Green
Interactivity via color buttons
LIME document
LIME datacasting example
Transition from a Linear TV program to another
program while datacasting is enabled
LIME datacasting example
Conclusions
• LIME design requirements targeted specifically at IPTV
• LIME profiles address:
– Presentation restrictions (e.g. color, font appropriate for displaying on a TV)
– Navigation without a spatial UI device
– Synchronization of contextual data with IPTV content
• LIME is lightweight yet powerful enough