HbbTV Test Suite

The foundation of interoperability

Ian Medland, DTG TestingChair of HbbTV Testing Working Group

imedland@dtg.org.uk

Conformance testing

Are you the one?

150+ FreeviewHD tests

2 passed without retest

HbbTV test suite

• Why do we need it?

• What is it?

• How is it made?

• How is it used?

• How can I get involved?

Why do we need it?

• Minimum interoperability standards on

which to build services

• Industry specified, reviewed, approved and

maintained

• Basis for all platforms using HbbTV

– Often with local additional test requirements

What is it?

• Over 950 Test Cases

• Provides wide coverage of the HbbTV

specified and profiled APIs and content

formats

• Designed for automated execution and

results submission

What is it?

0

200

400

600

800

1000

1200

1400

1600

May-12 Nov-12 May-13 Nov-13 May-14 Nov-14 May-15 Nov-15 May-16

HbbTV Test Suite number of test cases

How is it made?

Requirements Specification

•Test Case Assertions

•By Domain Specialists

• Feedback to Specification

Submission

•Unplanned Submissions (mod. CC BY-NC-ND)

•Commercial TMP (Commercial)

Implementation Approval

•Commercial TMR

•Testing Group

•Test Events

Publication

• Includes a Test Harness

•Approved and Additional Test Cases

•NorDig and OIPF included

Maintenance

•Test Challenge

•Update Releases

How is it used?

• Typically manufacturers can self-certify

• Registered Test Centres

– Independent conformance testing

– Currently five registered

• Manufacturer testing

– Integrate with development and QA processes

How is it used?

• HbbTV logo

• Platform operators

– Evidence of testing

– Spot checks

How can I get involved?

I’m in!

How can I get involved?

• We rely on continuous involvement to

enhance the product

• Feedback from application authors and

platform operators

– Interoperability problems

– Scenarios or test case implementations

How can I get involved?

• Review test cases

• Testing events

• Contribute on the mailing list

• Working Group telco every 2nd Wednesday

afternoon