•high efficiency image file format - apple inc. efficiency image file format iso...
TRANSCRIPT
![Page 1: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/1.jpg)
#WWDC17
© 2017 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.
Davide Concion, Apple/Image Compression Team
•High Efficiency Image File Format
Media
Session 513
![Page 2: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/2.jpg)
•De facto standard for image compression—JPEG •Requirements for a new format •HEIF—The answer •HEIF anatomy •The codec of choice—HEVC
![Page 3: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/3.jpg)
•De facto standard for image compression—JPEG •Requirements for a new format •HEIF—The answer •HEIF anatomy •The codec of choice—HEVC
![Page 4: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/4.jpg)
JPEG > De facto Standard for Image Compression
Hundreds of millions of JPEG images are captured, created, uploaded, and shared daily
![Page 5: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/5.jpg)
JPEG > De facto Standard for Image Compression
Hundreds of millions of JPEG images are captured, created, uploaded, and shared daily
Limitations • Compression • Auxiliary images • Animations
![Page 6: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/6.jpg)
JPEG > 1992
JPEGJPEG standard
ITU/MPEG standard
1992
![Page 7: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/7.jpg)
JPEG > 1992
JPEGJPEG standard
ITU/MPEG standard
1992
JPEG2000 JPEG XR
MPEG1 MPEG2 MPEG4 AVC HEVC
2000 20091996
1999
2003 2013
![Page 8: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/8.jpg)
JPEG > 1992
JPEGJPEG standard
ITU/MPEG standard
1992
JPEG2000 JPEG XR
MPEG1 MPEG2 MPEG4 AVC HEVC
2000 20091996
1999
2003 2013
HEIF
2015
![Page 9: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/9.jpg)
•De facto standard for image compression—JPEG •Requirements for a new format •HEIF—The answer •HEIF anatomy •The codec of choice—HEVC
![Page 10: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/10.jpg)
Requirements for a New Format
![Page 11: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/11.jpg)
Requirements for a New Format
State-of-the-art compression
![Page 12: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/12.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
![Page 13: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/13.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
![Page 14: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/14.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
![Page 15: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/15.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
![Page 16: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/16.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
![Page 17: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/17.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
![Page 18: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/18.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
Multiple-image
![Page 19: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/19.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
Multiple-image
Multi-resolution
![Page 20: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/20.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
Multiple-image
Multi-resolution
Tiles
![Page 21: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/21.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
Multiple-image
Multi-resolution
Tiles
Rich metadata
![Page 22: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/22.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
Multiple-image
Multi-resolution
Tiles
Rich metadata
Other media types
![Page 23: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/23.jpg)
Requirements for a New Format
State-of-the-art compression
HW acceleration
Deep and wide color
4:4:4 color sampling
HDR
Auxiliary images
Animation, burst, and playback intent
Multiple-image
Multi-resolution
Tiles
Rich metadata
Other media types
Extensible
![Page 24: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/24.jpg)
•De facto standard for image compression: JPEG •Requirements for a new format •HEIF—The answer •HEIF anatomy •The codec of choice—HEVC
![Page 25: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/25.jpg)
HEIF > Standard
High Efficiency Image File Format
![Page 26: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/26.jpg)
HEIF > Standard
High Efficiency Image File Format
ISO standard—ISO/IEC 23008-12 (June 2015—Version 1) • http://mpeg.chiariglione.org/standards/mpeg-h/image-file-format
![Page 27: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/27.jpg)
HEIF > Standard
High Efficiency Image File Format
ISO standard—ISO/IEC 23008-12 (June 2015—Version 1) • http://mpeg.chiariglione.org/standards/mpeg-h/image-file-format
Version 2 of the spec should be made public soon
![Page 28: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/28.jpg)
HEIF > Standard
High Efficiency Image File Format
ISO standard—ISO/IEC 23008-12 (June 2015—Version 1) • http://mpeg.chiariglione.org/standards/mpeg-h/image-file-format
Version 2 of the spec should be made public soon
Reference model from MPEG • http://mp4ra.org
![Page 29: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/29.jpg)
HEIF > Standard
High Efficiency Image File Format
ISO standard—ISO/IEC 23008-12 (June 2015—Version 1) • http://mpeg.chiariglione.org/standards/mpeg-h/image-file-format
Version 2 of the spec should be made public soon
Reference model from MPEG • http://mp4ra.org
GPAC/MP4Box has recently added basic support for HEIF • https://gpac.wp.imt.fr
![Page 30: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/30.jpg)
HEIF > Container
HEIF specifies a structural format(a “container”)
HEIF container
mdat—Media Data
EXIF
image data
thumbnail
meta — Information about items
ftyp—Declares the brands in the file
![Page 31: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/31.jpg)
HEIF > Container
HEIF specifies a structural format(a “container”)
Derived from ISO Base Media File Format(ISOBMFF - ISO/IEC 14496-12),based on Apple QuickTime • MP4, timed media • MPEG-21, digital items
HEIF container
mdat—Media Data
EXIF
image data
thumbnail
meta — Information about items
ftyp—Declares the brands in the file
![Page 32: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/32.jpg)
HEIF > Container
HEIF specifies a structural format(a “container”)
Derived from ISO Base Media File Format(ISOBMFF - ISO/IEC 14496-12),based on Apple QuickTime • MP4, timed media • MPEG-21, digital items
Any compression codec can beincluded in a HEIF file
HEIF container
mdat—Media Data
EXIF
image data
thumbnail
meta — Information about items
ftyp—Declares the brands in the file
![Page 33: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/33.jpg)
HEIF > Container
HEIF specifies a structural format(a “container”)
Derived from ISO Base Media File Format(ISOBMFF - ISO/IEC 14496-12),based on Apple QuickTime • MP4, timed media • MPEG-21, digital items
Any compression codec can beincluded in a HEIF file
HEIF container
mdat—Media Data
EXIF
image data
thumbnail
meta — Information about items
ftyp—Declares the brands in the file
meta — Information about items
![Page 34: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/34.jpg)
HEIF > File Extension
Payload Extension—single image Extension—sequence
HEVC .HEIC .HEICS
H.264 .AVCI .AVCS
Any Codec .HEIF .HEIFS
![Page 35: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/35.jpg)
HEIF > File Extension
Payload Extension—single image Extension—sequence
HEVC .HEIC .HEICS
H.264 .AVCI .AVCS
Any Codec .HEIF .HEIFS
.HEIC
.AVCI
.HEIF
![Page 36: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/36.jpg)
HEIF > File Extension
Payload Extension—single image Extension—sequence
HEVC .HEIC .HEICS
H.264 .AVCI .AVCS
Any Codec .HEIF .HEIFS
.HEIC
.AVCI
.HEIF
.HEIC
.AVCI
.HEIF
![Page 37: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/37.jpg)
•De facto standard for image compression—JPEG •Requirements for a new format •HEIF—The answer •HEIF anatomy •The codec of choice—HEVC
![Page 38: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/38.jpg)
HEIF Anatomy
•Items •Roles of images •Image properties •Properties association •Image sequences •Tiles
![Page 39: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/39.jpg)
HEIF Anatomy > Items
![Page 40: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/40.jpg)
HEIF Anatomy > Items
AVC
HEVC
HEVC
![Page 41: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/41.jpg)
HEIF Anatomy > Items
AVC
HEVC
HEVC
PrimaryDerived Image
![Page 42: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/42.jpg)
HEIF Anatomy > Items
AVC
HEVC
HEVC
PrimaryDerived Image
EXIF
XMP
MPEG-7
![Page 43: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/43.jpg)
HEIF Anatomy > Items
Properties
Initialization
Size
Mirror
…
…AVC
HEVC
HEVC
PrimaryDerived Image
EXIF
XMP
MPEG-7
![Page 44: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/44.jpg)
HEIF Anatomy > Items
Properties
Initialization
Size
Mirror
…
…AVC
HEVC
HEVC
PrimaryDerived Image
EXIF
XMP
MPEG-7 cdsc
dimg
![Page 45: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/45.jpg)
HEIF Anatomy
•Items •Roles of images •Image properties •Properties association •Image sequences •Tiles
![Page 46: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/46.jpg)
HEIF Anatomy > Roles of Images
Primary Representative image
Master Full-resolution displayable image
Thumbnail Smaller resolution
Auxillary Alpha plane or a depth map
Hidden Not for display
Derived ‘grid’, ‘iden’, ‘iovl’
Equivalent Alternative images
HEIF container
pitm - Primary Item Box
meta - Information about items
iref - Item Reference Box
dimg - Derived Image
auxl - Auxiliary Image
thmb - Thumbnail
cdsc - Content describe
![Page 47: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/47.jpg)
HEIF Anatomy
•Items •Roles of images •Image properties •Properties association •Image sequences •Tiles
![Page 48: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/48.jpg)
Decoder configuration Codec initialization
Image spatial extents Width and height
Pixel aspect ratio Pixel aspect ratio
Colour information ICC profile
Relative location Position of the reconstructed image
Auxiliary images properties Type of auxiliary image
HEIF Anatomy > Image Properties > Descriptive
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
colr—Colour Information
ispe—Image Spatial Extents
hvcC—HEVC Decoder Conf.
![Page 49: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/49.jpg)
HEIF Anatomy > Image Properties > Transformative
Clean aperture Cropping of image
Image rotation 0, 90,180,270 degrees rotation
Image mirroring Image mirroring
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
irot—Rotation
clap—Clean Aperture
imir—Mirroring
![Page 50: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/50.jpg)
HEIF Anatomy
•Items •Roles of images •Image properties •Properties association •Image sequences •Tiles
![Page 51: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/51.jpg)
ipma—Item Properties Association
item 1—association property 1 property 2
item 5—association property 3
item 6—association property 4 property 5
HEIF Anatomy > Image Properties > Association
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
hvcC—Decoder configuration 2
hvcC—Decoder configuration 1
ispe—spatial extent 1 width: 500 height: 500
ispe—spatial extent 2 width: 1000 height: 1000
ispe—spatial extent 3 width: 320 height: 240
HEIF container
![Page 52: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/52.jpg)
ipma—Item Properties Association
item 1—association property 1 property 2
item 5—association property 3
item 6—association property 4 property 5
HEIF Anatomy > Image Properties > Association
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
hvcC—Decoder configuration 2
hvcC—Decoder configuration 1
ispe—spatial extent 1 width: 500 height: 500
ispe—spatial extent 2 width: 1000 height: 1000
ispe—spatial extent 3 width: 320 height: 240
1
2
3
4
5
HEIF container
![Page 53: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/53.jpg)
ipma—Item Properties Association
item 1—association property 1 property 2
item 5—association property 3
item 6—association property 4 property 5
item 1—association property 1 property 2
HEIF Anatomy > Image Properties > Association
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
hvcC—Decoder configuration 2
hvcC—Decoder configuration 1
ispe—spatial extent 1 width: 500 height: 500
ispe—spatial extent 2 width: 1000 height: 1000
ispe—spatial extent 3 width: 320 height: 240
1
2
3
4
5
HEIF container
![Page 54: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/54.jpg)
ipma—Item Properties Association
item 1—association property 1 property 2
item 5—association property 3
item 6—association property 4 property 5
item 5—association property 3
item 1—association property 1 property 2
HEIF Anatomy > Image Properties > Association
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
hvcC—Decoder configuration 2
hvcC—Decoder configuration 1
ispe—spatial extent 1 width: 500 height: 500
ispe—spatial extent 2 width: 1000 height: 1000
ispe—spatial extent 3 width: 320 height: 240
1
2
3
4
5
HEIF container
![Page 55: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/55.jpg)
ipma—Item Properties Association
item 1—association property 1 property 2
item 5—association property 3
item 6—association property 4 property 5
item 6—association property 4 property 5
item 5—association property 3
item 1—association property 1 property 2
HEIF Anatomy > Image Properties > Association
HEIF container
iprp—Item Properties
meta—Information about items
ipco—Item Property Container
hvcC—Decoder configuration 2
hvcC—Decoder configuration 1
ispe—spatial extent 1 width: 500 height: 500
ispe—spatial extent 2 width: 1000 height: 1000
ispe—spatial extent 3 width: 320 height: 240
1
2
3
4
5
HEIF container
![Page 56: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/56.jpg)
HEIF Anatomy
•Items •Roles of images •Image properties •Properties association •Image sequences •Tiles
![Page 57: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/57.jpg)
HEIF Anatomy > Sequences
‘moov’ box—‘trak’ box—‘pict’ handlerHEIF container
meta—Information about items
ftyp—Declares the brands in the file
mdat—Media Data
moov—Movie Box
track—video track—sound track—pict
![Page 58: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/58.jpg)
HEIF Anatomy > Sequences
‘moov’ box—‘trak’ box—‘pict’ handler
Tracks have roles too
HEIF container
meta—Information about items
ftyp—Declares the brands in the file
mdat—Media Data
moov—Movie Box
track—video track—sound track—pict
![Page 59: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/59.jpg)
HEIF Anatomy > Sequences
‘moov’ box—‘trak’ box—‘pict’ handler
Tracks have roles too
Controlling the playback • Edit list • Looping
HEIF container
meta—Information about items
ftyp—Declares the brands in the file
mdat—Media Data
moov—Movie Box
track—video track—sound track—pict
![Page 60: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/60.jpg)
HEIF Anatomy > Sequences
‘moov’ box—‘trak’ box—‘pict’ handler
Tracks have roles too
Controlling the playback • Edit list • Looping
Inter prediction
HEIF container
meta—Information about items
ftyp—Declares the brands in the file
mdat—Media Data
moov—Movie Box
track—video track—sound track—pict
![Page 61: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/61.jpg)
HEIF Anatomy
•Items •Roles of images •Image properties •Properties association •Image sequences •Tiles
![Page 62: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/62.jpg)
HEIF Anatomy > Tiles
Tiles • rloc • grid
![Page 63: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/63.jpg)
HEIF Anatomy > Tiles
Tiles • rloc • grid
Why tiles? • Parallelism • Memory • Cropping
![Page 64: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/64.jpg)
HEIF Anatomy > Tiles
Tiles • rloc • grid
Why tiles? • Parallelism • Memory • Cropping
System tiles vs. HEVC tiles
![Page 65: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/65.jpg)
Agenda
•De facto standard for image compression—JPEG •Requirements for a new format •HEIF—The answer •HEIF anatomy •The codec of choice—HEVC
![Page 66: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/66.jpg)
The Codec of Choice—HEVC
JPEGJPEG standard
ITU/MPEG standard
JPEG2000 JPEG XR
MPEG1 MPEG2 MPEG4 AVC HEVC
1992 2000 20091996
1999
2003 2013
![Page 67: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/67.jpg)
The Codec of Choice—HEVC
JPEGJPEG standard
ITU/MPEG standard HEVC
2X1992 2000 20091996
1999
2003 2013
![Page 68: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/68.jpg)
The Codec of Choice—HEVC
JPEGJPEG standard
ITU/MPEG standard HEVC
1992 2000 20091996
1999
2003 2013
Hardware Support
![Page 69: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/69.jpg)
The Codec of Choice—HEVC Coding tools that outperform JPEG
•Block size •Angular prediction •Entropy coding •Adaptive quantization •Deblocking, SAO
![Page 70: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/70.jpg)
HEVC > Intra Coding Tools > Block Size
8
8
JPEG
![Page 71: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/71.jpg)
HEVC > Intra Coding Tools > Block Size
64
64
32
32
16
16
8
8
8
8
JPEG HEVC
![Page 72: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/72.jpg)
HEVC > Intra Coding Tools > Angular Prediction
JPEG
8
8
![Page 73: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/73.jpg)
HEVC > Intra Coding Tools > Angular Prediction
JPEG HEVC
8
8
![Page 74: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/74.jpg)
• + • QP
HEVC > Intra Coding Tools > Entropy Coding
• Huffman
JPEG
![Page 75: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/75.jpg)
• + • QP
HEVC > Intra Coding Tools > Entropy Coding
• Huffman
JPEG HEVC
• CABAC
![Page 76: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/76.jpg)
• HUFFMAN • CABAC
HEVC > Intra Coding Tools > Adaptive Quantization
JPEG
![Page 77: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/77.jpg)
• HUFFMAN • CABAC
HEVC > Intra Coding Tools > Adaptive Quantization
JPEG
• + • QP
HEVC
![Page 78: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/78.jpg)
HEVC > Intra Coding Tools > Deblocking > SAO
Deblocking • Global smoothing
sharp edges
SAO • Local smoothing
![Page 79: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/79.jpg)
HEVC > Intra Coding Tools > Deblocking > SAO
Deblocking • Global smoothing
sharp edges
SAO • Local smoothing
![Page 80: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/80.jpg)
HEIF Configuration with Camera App
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 81: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/81.jpg)
HEIF Configuration with Camera App
.HEICHEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 82: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/82.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profileHEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 83: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/83.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profile
Images are encoded in 512x512 tiles
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 84: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/84.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profile
Images are encoded in 512x512 tiles
Thumb is 320x240
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 85: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/85.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profile
Images are encoded in 512x512 tiles
Thumb is 320x240
EXIF
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 86: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/86.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profile
Images are encoded in 512x512 tiles
Thumb is 320x240
EXIF
Depth stored as auxiliary image + XMP
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 87: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/87.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profile
Images are encoded in 512x512 tiles
Thumb is 320x240
EXIF
Depth stored as auxiliary image + XMP
Meta first, then thumbs, then main image
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 88: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/88.jpg)
HEIF Configuration with Camera App
.HEIC
HEVC—main still profile
Images are encoded in 512x512 tiles
Thumb is 320x240
EXIF
Depth stored as auxiliary image + XMP
Meta first, then thumbs, then main image
HEIF container
mdat—Media Data
EXIF
main image compressed data
thumb compressed data
meta—Information about items
ftyp—Declares the brands in the file
![Page 89: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/89.jpg)
Summary
![Page 90: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/90.jpg)
Summary
De facto image file format
![Page 91: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/91.jpg)
Summary
De facto image file format
Format requirements
![Page 92: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/92.jpg)
Summary
De facto image file format
Format requirements
HEIF
![Page 93: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/93.jpg)
Summary
De facto image file format
Format requirements
HEIF
HEIF in depth
![Page 94: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/94.jpg)
Summary
De facto image file format
Format requirements
HEIF
HEIF in depth
HEVC
![Page 95: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/95.jpg)
More Informationhttps://developer.apple.com/wwdc17/513
![Page 96: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/96.jpg)
Related Sessions
Introducing HEIF and HEVC Executive Ballroom Tuesday 4:10PM
Working with HEIF and HEVC Hall 2 Friday 11:00AM
![Page 97: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/97.jpg)
Labs
HEIF and HEVC Lab Technology Lab A Wed 9:00AM–11:00AM
HEIF and HEVC Lab Technology Lab F Fri 12:00PM–1:50PM
![Page 98: •High Efficiency Image File Format - Apple Inc. Efficiency Image File Format ISO standard—ISO/IEC 23008-12 (June 2015—Version 1)](https://reader033.vdocument.in/reader033/viewer/2022051307/5accf46d7f8b9a875a8d3c57/html5/thumbnails/98.jpg)