F65 specifications:

Feedback for

“SPE Next Generation Camera”“SPE Next Generation Camera”

V1.1 Sony

27/Jan/2011

1

Remote Control Module

DP Interface

Network Server

Recordable

Media Dock

WiFi or

Bluetooth

The Camera SystemSPE Request

LUT Rendering

MonitorLive Operation Modules

Fiber Channel

or 10GigEComplete Software Solution

2

Monitoring and control IF

1. DP interfaceA) iOS (iPhone, iPad) and Android application

B) Select camera LUTs to manage color

C) Measure and control exposure

D) Monitor feedback of camera and signal status and levels

E) Enter additional notes as needed

3. LUT Rendering Monitor

A) Receive image files with embedded metadata (LUTs)

B) Apply and render LUTs and display the corrected image

in real time

C) When used with the remote control, allows monitoring

of the impact of real time “camera adjustment”

SPE Request

E) Enter additional notes as needed

2. Remote Control ModuleA) Measure and control exposure

B) Manage color through LUTs including input LUTs

C) Monitor camera and signal status and levels

D) Acquire and manage metadata

E) Manage camera modules such as network interface

3

Data Movers for Live Operation

• Transfer module

– Manages transfer of RAW

images and metadata from

• Wireless receiver module

– Processing as appropriate

for bandwidth limitations

SPE Request

images and metadata from

camera to render module

for real time display and

transmission

– Functionally same as

network server application

for bandwidth limitations

for real time display and

transmission

4

F65 Control Interface

Wi-Fi

GUI menu (All function)

Metadata Input RM-B150

Input LUT (Gamma)

Limited function for Video Workflow

iPad/Android ApplicationMonitor

USB Memory, MS, SD

Setting Export/Import

5

Lens Controller

ARRI Wireless Transmitter/Receiver

(ARRI, C motion)

iPad/Android Application

EthernetPC

CvpFileEditor

LUT select

ASC CDL Control

All Camera settings

RS-232c

Lens interface (Metadata)

ARRI LDS, Cooke /i Metadata

HD-SDI w/LUT

Monitor

MSU-1000/1500

Video Workflow

Lens12pin

Fujinon Lens Servo

F65 Monitoring interface

Floor Monitor

HD SDI 1.5G 422

1D LUT apply

ASC CDL

Marker, Cursor

Status character

Wi-Fi Still Image

USB Memory, MS, SD

Still Image

6

HD View Finder

(HDVF-C30WR)

2nd View Finder

Proxy recorder

Waveform monitor

HD-SDI 1

HD-SDI 2

Floor Monitor Still Image

Exposure Assist

iPad/Android Application

Magnify

Camera x4, VFx2

Connectors and SwitchesUSB

YBS

Shutter Sync

Genlock

M.Shu E.Shu LOCK

ND↓ ND↑

ASSIGN1～4

DISP HOME

DOCK

MS/SD

SDI2LAN

DOCK

7

FUJINON

LENS

Servo

24V12V ARRI Lens Remote

Metadata Input

Power

Camera Remote

DC IN

SDI1REC

REC LockCANSEL PAGE SET

DOCK

MENU

Wi-Fi Adapter

Φ19 carbon rod

Lens Servo Motor

Center handle

Accessory plate

8

ARRI Bridge Plate

Color and Metadata Management• In the last century, Kodak was the

authority in color management. In the 21st century, Sony should be that voice.

• Color management can be redefined

• Done properly, as part of the integrated system, the camera allows Sony to control the images flowing through the post production process.

• Sony can integrate the technology

SPE Request

• Color management can be redefined in a way that:

– Captures the creative decisions made during photography,

– Carries and preserves those decisions

– Allows further refinement post production

• The camera is part of this process –but only a part.

• Sony can integrate the technology into its cameras and bring to market the systems that leverage the capability it provides

• Control of the camera is essential.

9

Render Module• Inserted at or before the vision

mixer/switcher

• Applies accumulated LUTs

• Use Ellcami

• Can also be used in a variety of

SPE Request

• Can also be used in a variety of Post Production roles– Feeds to non-render capable

monitors (e.g. consumer sets in offices or viewing rooms)

– In preparation of dailies materials for use in editing systems

10

F65 Render Module• Real time De-Bayer for on-set/dailies viewing

• Simultaneously output from RAW – 4K 444/422 10/12bit

– 2K/HD 444/422 10/12bit

– HD 422 Monitoring

• Each output enable to apply• Each output enable to apply– 1D LUT

– 3D LUT (ACES Compliant RRT/ODT)

• Real time Film emulation with ACES– On-set Monitoring

– Dailies preview

• Software De-Bayer SDK for post will be prepared as well.

11

F65 Wide color gamut

FS-Gamut (F65)

Film

Storage configuration

1. Recordable Media Dock

A) For unloading SSD media

B) eSATA, NAS and USB 3.0 interfaces

C) Add-on function to dump media to LTO-5

SPE Request

2. Network Server Application

A) Software running on Linux/Mac/Windows server

B) Manages real time transfer of RAW images and metadata

C) Manages opportunistic wireless transfer of RAW images and metadata

D) Managed through UI and web services (Conductor)

13

Network Interfaces

10Gbps Ethernet

• Using Ethernet for isochronous data

– Connect as a point to point data link

– Isolate camera data transmission from

camera control & metadata transmission

8Gbps Fiberchanel

• Using Fiberchannel

– Write directly to storage

SPE Request

Qlogic 8Gb PCI-E (X4) Dual Port Fiber Channel Host

Bus Adapter

Retail Price

US$1,750.99

QLogic QLE8042 - Network adapter - PCI Express

x8 – Dual Port 10 Gigabit Ethernet

Retail price

US$1,568.01

camera control & metadata transmission

– Don’t connect to a blocking switch

– Don’t contend for bandwidth with other

traffic

14

•F65 16-bit 8Kx2K RAW recoding

• 1-60p(16:9), 72p(2.35:1)

• 2K RAW : 120p

• Time code IN/OUT

• Aux IN

• Audio x 2

SR Portable Recorder

• Audio x 2

• USB for version up and control

• Control Panel (same as SRW-1)

• Select FPS

SRPC-5

• Ingest device for SR Memory

• SR Memory Slot x1

• Network GbE I/F, 10GbE I/F (option)– Actual speed will be 1Gbps with 10GbE

Width 19”, Height 1U

19“ Standard rack

• Width 19”, Height 1U

• Network protocol for file mount: CIFS, NFS

• Web GUI control, file transport

SR Memory Deck• HD to 4K format

– SStP 220Mbps, 440Mbps, 880Mbps

– Uncompressed DPX

– 4K RAW (4K RAW option)

• High Frame Rate

– HD 240p

– 4K 60p– 4K 60p

• Response performance

– 4 frame (over EVS system)

• 4 card and 4 I/Os

– Simultaneously 4 in or out interface

• Internal storage 8TB

– Max 12TB : SR Memory(1TB x 4) + internal storage(8TB）

• 1TB

– 4K 16bit RAW 48min

• 10GbE Ethernet port

DESIGN AND SYSTEM CONFIGURATION

18

F65 + SR Memory

19

F65 T-Cam

20

F65 T-Cam w/Shutter

21Include built-in ND Filter

RED-ONE305mm

F65 + SR Memory

SRW-9000

Alexa332mm

330mm

Render Module + SR Memory

23

F65 Untethered System

Time Code

Encode

File I/F

SR Memory Portable

3 : 1 Compressed

16bit Raw

6Gbps

Cloning on set

CM

OS 16bit Raw

Monitor HD w/LUT

Camera Metadata

F65

New Optical I/F

Cable I/F

Sneaker Net

24

Uncompressed

16bit RAW

19Gbps@60p

Ingest at facility

10GbE or New IF

Raw FileHDMonitoring

Proxy recorder

802.11b 11-22Mbps

802.11g 54Mbps

802.11n 600Mbps

F65 Tethered System (1)

4K 444/422

2K/HD 444

Monitor HD 422

Uncompressed

16bit RAW

19Gbps@60p

4K MonitoringRender Module

4K LUT

HD LUT

De-Bayer

HD Proxy

Uncompressed

30m

New Opt. Cable

CM

OS 16bit Raw

Monitor HD w/LUT

Camera Metadata

F65

SR Memory

Portable

New Optical I/F

Cable I/F

Sneaker Net

25

Ingest at facility

10GbE or New IF

Raw File

Cloning on set

HDUncompressed

16bit RAW

19Gbps@60p

3 : 1 Compressed

16bit Raw

6Gbps

New Opt. Cable

HDMonitoring

F65 Tethered System (2)

CM

OS 16bit Raw

Monitor HD w/LUT

Camera Metadata

4K 444/422

2K/HD 444

Monitor HD 422

Uncompressed

16bit RAW

19Gbps@60p

4K MonitoringF65

4K LUT

HD LUT

De-Bayer

HD Proxy

Uncompressed

100m w/Power

2Km wo/Power

Opt. Fiber Adapter Render Module

HD

SR Memory

Portable

New Optical I/F

Cable I/F

Sneaker Net

26

Ingest at facility

10GbE or New IF

Raw File

Cloning on set

HDUncompressed

16bit RAW

19Gbps@60p

3 : 1 Compressed

16bit Raw

6Gbps

2Km wo/Power

T-Cam/3D SystemC

MO

S 16bit Raw

Camera Metadata

4K LUT

HD LUT

De-Bayer

Uncompressed

CMOS RAW

12/14bit

38Gbps@60p

F65-T

4K 444/422

2K/HD 444

Monitor HD 422

4K Monitoring

HD Proxy

30m

New Opt. Cable

Render Module

Uncompressed

16bit RAW

19Gbps@60p

3 : 1 Compressed

16bit Raw

6Gbps

SR Memory

Portable

HD

Schedule• June/2011

– SRM Deck (HD)• 4K 444/422 recording as four HD SDI stream

• Oct/2011– F65, Render Module, SRM Portable (4K RAW recoding)

– Software RAW SDK (Sample release)– Software RAW SDK (Sample release)

• Jan/2012– F65 T-CAM system

• Apr/2012– 4K I/O board for SRM Deck

– F65 Optical fiber adapter

• Oct/2012– RAW development board for SRM Deck

28

Uncovered requirement (1/2)• Size, Weight like EPIC

– F65 T-Cam is similar size as EPIC, but there is only tethered system.

– F65 CMOS RAW is 19Gbps and it will cover not only 4K but also 8K in the future.

– F65 is designed to protect device from internal heat, so it will never hung-up at typical

situation.

• Wireless RAW transmission from camera• Wireless RAW transmission from camera

– Wi-Fi is about 30-200Mbps but F65 RAW data rate is 6Gbps which is even compressed.

– Removable SR Memory will be better than Wi-Fi.

• On set Proxy generation

– Utilize 3rd Party device

• FOCUS, nanoFlash, KiPro, CineDeck

– Proxy workflow with XDCAM System Deck (MPEG2)

29

Uncovered requirement (2/2)• Ingest speed of RAW file

– RAW file is recorded 6Gbps, but ingest speed with SRPC-5 is 1-2 Gbps.

– It takes 3-6 times longer than recording time.

• Lossless RAW (19Gbps@60p, 8Gbps@24p) Ingest

– There is no such fast interface in IT technology.– There is no such fast interface in IT technology.

– IT interface cannot treat real time data transmission from camera.

– We need to make special hardware to ingest PC server.

• Network server application

– Software RAW SDK is needed to start RAW workflow

– Viewing application for RAW and metadata is needed as well.

30

2010 HPA2010 HPA2010 HPA2010 HPA

31

B G R B G R

B G R B G RB G RB G R

1920×3（RGB）

×2

F35 RGB Sampling

+ +

3 imagers (RGB)

1920 1920 1920

1080

B G R

B G R B G RB G R B G R

1080

×

Equal number of RGB pixelsNo interpolation

Bayer pattern

+ +

Need interpolated data from next pixels

Various Sensor Patterns

2K 4K

2K

4K

2K 4K 2K

Full RGBFull RGBFull RGBFull RGB

HD 16:9 = 6.2M pixels4K x 2K = 26.5M pixels Single Sensor

Stripe Structure3 SensorWith Prism 2K 4K

2K

4K

2K 4K 2K

RGBRGBRGBRGB100%100%100%100%

2K 4K 2K 4K

Bayer PatternBayer PatternBayer PatternBayer Pattern

2K 4K

2K

4K

4K x 2K = 8.8M pixels

Q67Q67Q67Q67

2K 4K 2K 4K 2K 4K

2K

4K

8K x 2K = 17.7M pixels67%67%67%67%

33%33%33%33%

Digital S35mm Camera Comparison

ARRI

ALEXA

SonySony

F35, F35,

SRWSRW--9000PL9000PL

RED Epic(Mysterium-X)

SonySony

New 4K New 4K

Active Image Pixel 2880 x 1620 5760 x 21605760 x 2160N/A

Full: 5120 x 2700

8K x 2K8K x 2K

AproxAprox. Bayer 6Kx3K. Bayer 6Kx3KFull: 5120 x 2700 AproxAprox. Bayer 6Kx3K. Bayer 6Kx3K

Color PixelG (2880 x 1620)/2

1440 x 810

1920 x 10801920 x 1080

1920 x 10801920 x 1080

(4520 x 2540)/2

2260 x 1270

4096 x 21604096 x 2160

(4096 x 2160)/2(4096 x 2160)/2R/B

Total Effective Pixel 4.7M 6.2M 6.2M 13.8M 17.7M 17.7M

Global ShutterNo (A-EV, EV Plus)

Yes (A-OV Plus)YesYes No YesYes

RGB vs. BayerOriginalOriginalOriginalOriginal Bayer Bayer Bayer Bayer (No Optical LPF)(No Optical LPF)(No Optical LPF)(No Optical LPF)

Lack of GREEN resolving power

Loss of diagonal resolution

Imbalance between G & R/B

samples

Q67 Q67 Q67 Q67 (No Optical LPF) (No Optical LPF) (No Optical LPF) (No Optical LPF)

Q67 vs. BayerQ67 vs. BayerQ67 vs. BayerQ67 vs. Bayer

Lack of GREEN Lack of GREEN Lack of GREEN Lack of GREEN resolving powerresolving powerresolving powerresolving power

Bayer Bayer Bayer Bayer (No Optical LPF)(No Optical LPF)(No Optical LPF)(No Optical LPF)

Imbalance between Imbalance between Imbalance between Imbalance between R/G/B samplesR/G/B samplesR/G/B samplesR/G/B samples

Better diagonal Better diagonal Better diagonal Better diagonal resolutionresolutionresolutionresolution

Q67Q67Q67Q67 Q67 with Digital ProcessingQ67 with Digital ProcessingQ67 with Digital ProcessingQ67 with Digital Processing

Q67 with Signal ProcessingQ67 with Signal ProcessingQ67 with Signal ProcessingQ67 with Signal Processing

Bayer vs. Q67 Bayer vs. Q67 Bayer vs. Q67 Bayer vs. Q67

BayerBayer Q67Q67Camera: Camera: SinarSinar/P2 4x5/P2 4x5Film: Kodak E100SFilm: Kodak E100SScanner: ICG/330i Scanner: ICG/330i

CCD Global Shutter CMOS Rolling ShutterCMOS Rolling Shutter

Commuter Commuter Commuter Commuter TrainTrainTrainTrain

CMOS Image Sensor Artifacts 1)

CMOS reads pixel with line by CMOS reads pixel with line by line. Time delay in reading line. Time delay in reading lines create distortionlines create distortion

CCD global shutter shifts all pixel CCD global shutter shifts all pixel data to transmission register at data to transmission register at the same time.the same time.

CMOS Image Sensor Artifacts 2)Pixel Noise Random Horizontal Stripe •Every sensor has a unique

noise footprint

•Difficult to Fix-it-in-post

•Requires In-Camera correction

Vertical Stripe Luminance, Color Shading Color Reproduction

•Requires In-Camera correction

◆

◆-30%

■17.7Mpixel(285%)

■26.4Mpixel(427%)

100%

Total PixelTotal PixelTotal PixelTotal PixelPixel SizePixel SizePixel SizePixel SizeTotal Pixel

4K RGBFull

4K Q674K Q674K Q674K Q674K Bayer

2K RGBFull

◆◆-65%

-75%■6.2Mpixel

8.8Mpixel(140%)

■ Reduce Sensitivity and Dynamic Range

Sony CMOS semiconductor technology will be Sony CMOS semiconductor technology will be available to get the same sensitivity and dynamic available to get the same sensitivity and dynamic range as F35 with CCD.range as F35 with CCD.

Spec Comparison(1)Sony

F35Sony

F65ARRI

ALEXARED-ONE(Mysterium)

Active Image Pixel 5760 x 1080 8K x 2K 2880 x 1620 4520 x 2540

Color PixelG 1920 x 1080 4096 x 2160 (2880 x 1620)/2 * (4520 x 2540)/2 *

Color PixelR/B 1920 x 1080 (4096 x 2160)/2 1440 x 810 2560 x 1270

Total Effective Pixel 6.2M 17.7M 4.7M 11.5M

Frame Rate HD 1-50p4K 1-72p

2K 1-120p

HD 1-30fps (SxS)

HD 1-60fps (Cam)

4K 1-30p

2K 1-120p

Global Shutter Yes YesNo (A-EV, EV Plus)

Yes (A-OV, Mecha)No

A/D 14bit 12bit/14bit(24p) 12bit 12bit

Sony

F35Sony

F65ARRI

ALEXARED-ONE

(Mysterium)

S/N 54.5dB59dB (HD)

53dB (4K) 62dB(HD)? 52.5dB(HD)?

800% 940% 1000%? 312%?

Spec Comparison(2)

Dynamic Range800%

(5.3stop)

940%

(5.5stop)

1000%?

(5.6stop)

312%?

(4.0stop)

Latitude 12.1stop 13stop (HD) 13.5stop(HD)? 10.4stop?

Raw Output N/A 16bit Raw 12/14bit Raw 12bit Raw

Color Gamut S-Gamut FS-Gamut - -

Power Consumption 56W 60W 70W? 60W