SpaceFibre Flight Software Workshop 2015

Steve Parkes, University of Dundee

Albert Ferrer Florit, Alberto Gonzalez Villafranca, STAR-Dundee Ltd.

David McLaren, Chris McClements, University of Dundee

Contents

SpaceFibre

SpaceFibre standard

SpaceFibre integrated quality of service

SpaceFibre networks

SpaceFibre cables and connectors

SpaceFibre test and development equipment

SpaceFibre chip designs

SpaceFibre in radiation tolerant FPGAs

2

SpaceFibre

3

SpaceFibre

SpaceFibre is

– A spacecraft on-board data link and network

SpaceFibre runs over

– Electrical and fibre optic cables

SpaceFibre designed specifically for spaceflight

applications

– Integrated QoS

– Integrated FDIR capabilities

– Galvanic isolation

4

SpaceFibre Key Features

High performance

– 2.5 Gbits/s current flight qualified technology

– 3.125 Gbits/s soon (6.25 Gbits/s coming)

– Multi laning of up to 16 lanes (40 Gbits/s)

Innovative integrated QoS

– Priority

– Bandwidth reservation

– Scheduling

Novel integrated FDIR support

– Transparent recovery from transient errors

– Error containment in virtual channels and frames

– “Babbling Node” protection

Low latency

– Broadcast codes

Compatible with SpaceWire at packet level

5

SpaceFibre Benefits Supports high data-rate instruments (e.g. SAR)

– Very high data rates

Reduces cost, schedule and risk

– Reduction of harness mass

– Simplification of redundancy

– Increase in reliability

– Straightforward error recovery

– Very small footprint due to efficient design

Supports integrated AOCS/GNC and payload network

– Quality of service

– Deterministic data delivery

Supports launcher applications

– Long distance

– Galvanic isolation

Easy to integrate with existing SpaceWire equipment

6

Integrated Network

Single integrated network

– Carrying

Instrument data

Configuration and control information

Deterministic traffic

High resolution time information

Event signals

– Improves reliability, mass, cost

7

SpaceFibre Standard

8

SpaceFibre Standard

ECSS

9

Physical Layer

User Application

Lane Layer

Data Link Layer

Network Layer

Driver/Receiver

Cables

Connectors

Link operation

Quality of service

Link error recovery

Nodes

Routers and routing

Message broadcast

Packet definition

Packets

Lane initialisation

Encoding of data &

control words

SerDes

Data &

Control

Words

Broadcast

Messages Packets

Broadcast

Messages

Data &

Control

Words

Multi-Lane Layer

Data &

Control

Words

Data &

Control

Words

Ma

na

ge

ment L

aye

r

Parameters

Lane

Control Lane

Status

Lane coordination

Lane failure recovery

TX Symbols RX Symbols

Broadcast

Messages NChars NChars

Broadcast

Messages

Physical

Control Physical

Status

SpaceFibre ECSS Working Group

ECSS

10

Physical Layer

User Application

Lane Layer

Data Link Layer

Network Layer

Data &

Control

Words

Driver/Receiver

Cables

Connectors

Link operation

Quality of service

Link error recovery

Nodes

Routers and routing

Message broadcast

Packet definition

Packets Broadcast

Messages

Lane initialisation

Encoding of data &

control words

SerDes

Ma

na

ge

ment L

aye

r

Parameters Packets Broadcast

Messages

Data &

Control

Words

Multi-Lane Layer

Data &

Control

Words

Data &

Control

Words

Lane

Control Lane

Status

Lane coordination

Lane failure recovery

TX Symbols RX Symbols

Broadcast

Codes NChars NChars

Broadcast

Codes

Physical

Control Physical

Status

SpaceFibre Integrated QoS

11

SpaceWire CODEC

12

SpaceWire CODEC

Packet Interface Time-Codes Management

Serial

SpaceFibre IP Core

13

SpaceFibre IP Core

… Virtual Channel Interfaces Broadcast Management

SerDes

Each VC like pair of SpW FIFOs.

Sends and Receives SpFi packets

Broadcasts short messages.

Time distribution, synchronisation,

event signalling, error handling

Management interface configures

VCs, BC, etc

SpaceFibre Quality of Service

Integrated QoS scheme

– Priority

VC with highest priority

– Bandwidth reserved

VC with allocated bandwidth and recent low utilisation

– Scheduled

Synchronised time-slots

– E.g. by broadcast messages

VCs allocated to specific time-slots

In allocated time-slot, VC allowed to send

“Integrated” because

– All three QoS work together

– QoS is implemented in the hardware of the SpaceFibre

interface

14

Virtual Channels

VC sends when

– Source VC buffer has data to send

– Destination VC buffer has space in buffer

– QoS for VC results in highest precedence

A SpW packet flowing through one VC does not

block another packet flowing through another VC

15

VC1

VC2

VC3

M

A

C

VC1

VC2

VC3

D

E

M

U

X

QoS: Bandwidth Reserved

16

time

Precedence

Bandwidth Credit Counter

QoS: Bandwidth Reserved

17

time

Precedence

QoS Priority

18

time

Priority 1

Priority 2

Priority 3

QoS Babbling Idiot Protection

19

time

Priority 1

Priority 2

Priority 3

Scheduled Precedence

20

Time-slot 1 2 3 4 5 6 7 8

VC 1

VC 2

VC 3

VC 4

VC 5

VC 6

VC 7

Configured for Priority and BW Reserved Only

21

Time-slot 1 2 3 4 5 6 7 8

VC 1

VC 2

VC 3

VC 4

VC 5

VC 6

VC 7

Simple Mixed QoS

22

Time-slot 1 2 3 4 5 6 7 8

VC 1

VC 2

VC 3

VC 4

VC 5

VC 6

VC 7

Deterministic Data Delivery

23

Time-slot 1 2 3 4 5 6 7 8

VC 1 (high priority)

VC 2 (high priority)

VC 3

VC 4

VC 5

VC 6

VC 7

Packets being transmitted

Packets being received

time

Time-slot 1

SpaceFibre Networks

24

SpaceFibre Routing Switch

25

Routing

Switch

Matrix

SpaceFibre

Interface

VC

VC

VC

VC

VC

SpaceFibre

Interface

VC

VC

VC

VC

VC

SpaceFibre

Interface

VC

VC

VC

VC

VC

SpaceFibre

Interface

VC

VC

VC

VC

VC

Configuration

Port

Port 2 Port 3

Port 1 Port 4

SpaceFibre

Port 2

SpaceFibre

Port 1

SpaceFibre

Port 3

SpaceFibre

Port 4

SpaceFibre Virtual Network

26

SpaceFibre

Routing

Switch

VC

VC 6

VC

VC

VC

VC 6

VC

VC

VC

VC

VC 6

VC

VC

VC

VC

VC

VC

VC

VC 6

VC

SpFi

Port

3

SpFi

Port

4

SpFi

Port

2

SpFi

Port

1

VC 6

VC

VC

SpFi

I/F

Control

Processor

VC

VC 6

VC

SpFi

I/F

Mass

Memory

Unit

VC

VC 6

VC

SpFi

I/F Instrument 2

VC

VC 6

VC

SpFi

I/F Instrument 1

Virtual channel buffers are configured to support specific virtual channels

One set of buffers is always configured to support VC 0, the Configuration Virtual Network

SpaceFibre Virtual Point to Point Link

27

SpaceFibre

Routing

Switch

VC

VC 6

VC

VC

VC

VC 6

VC 4

VC 2

VC

VC

VC 6

VC 4

VC

VC

VC

VC 2

VC

VC

VC 6

VC

SpFi

Port

3

SpFi

Port

4

SpFi

Port

2

SpFi

Port

1

VC 6

VC

VC

SpFi

I/F

Control

Processor

VC 2

VC 6

VC 4

SpFi

I/F

Mass

Memory

Unit

VC 2

VC 6

VC

SpFi

I/F Instrument

2

VC 4

VC 6

VC

SpFi

I/F Instrument

1

SpaceFibre Virtual Point to Point Link

28

SpaceFibre

Routing

Switch

VC

VC 6

VC

VC

VC

VC 6

VC 4

VC 2

VC

VC

VC 6

VC 4

VC

VC

VC

VC 2

VC

VC

VC 6

VC

SpFi

Port

3

SpFi

Port

4

SpFi

Port

2

SpFi

Port

1

VC 6

VC

VC

SpFi

I/F

Control

Processor

VC 2

VC 6

VC 4

SpFi

I/F

Mass

Memory

Unit

VC 2

VC 6

VC

SpFi

I/F Instrument

2

VC 4

VC 6

VC

SpFi

I/F Instrument

1

Simple SpaceFibre Network

29

SpaceFibre

Routing

Switch

VC

VC 6

VC

VC

VC

VC 6

VC 4

VC 2

VC

VC

VC 6

VC 4

VC

VC

VC

VC 2

VC

VC

VC 6

VC

SpFi

Port

3

SpFi

Port

4

SpFi

Port

2

SpFi

Port

1

VC 6

VC

VC

SpFi

I/F

Control

Processor

VC 2

VC 6

VC 4

SpFi

I/F

Mass

Memory

Unit

VC 2

VC 6

VC

SpFi

I/F Instrument

2

VC 4

VC 6

VC

SpFi

I/F Instrument

1

Spacecraft Data Handling Application

30

SpaceWire - SpaceFibre Bridge

VC 7

VC 1

VC 2

VC 3

VC 4

SpFi

I/F

VC 5

VC 6

VC 8

SpaceFibre

Routing

Switch

VC

VC 7

VC

VC

VC

VC 7

VC 1

VC 2

VC 3

VC 4

VC 7

VC 1

VC

VC

VC

VC 2

VC

VC

VC 7

VC

SpFi

Port

3

SpFi

Port

4

SpFi

Port

2

SpFi

Port

1

VC 7

VC

VC

SpFi

I/F

Control

Processor

Mass

Memory

Unit

VC 2

VC 7

VC

SpFi

I/F Instrument

2

VC 1

VC 7

VC

SpFi

I/F Instrument

1

VC 7

VC

VC

VC 8

VC

VC 3

VC 4

VC 5

VC 6

VC 7

SpFi

Port

4

SpFi

Port

1

VC 8

VC 7

VC

SpFi

I/F Downlink

Telemetry

VC 4

VC 7

VC 5

SpFi

I/F SpaceWire

Router

I 3

I 4

I 5

I 6

VC 6

VC 3

VC 5

VC 6

VC 8

Instruments

Spacecraft Data Handling Application

31

Control

Processor

Mass

Memory

Unit

Instrument

2

Instrument

1

Downlink

Telemetry

I 3

I 4

I 5

I 6

Instruments

Spacecraft Data Handling Application

32

SpaceFibre

Routing

Switch

Control

Processor

Mass

Memory

Unit

Instrument 2

Instrument 1

Downlink

Telemetry

SpaceWire

SpaceFibre

Bridge

I 3

I 4

I 5

I 6

Instruments

SpaceFibre

Cables and Connectors

33

SpaceFibre Physical Layer

SpaceFibre can operate over

– Electrical cable up to 5 m

– Fibre Optic cable at least 100 m

Electrical version uses CML

– Differential

– High-speed

34

SpaceFibre

Test and Development

35

STAR Fire

SpaceFibre unit designed by STAR-Dundee

Multi-purpose

– SpaceFibre interface

– SpaceWire to SpaceFibre bridge

– SpaceFibre packet generators/checkers

– SpaceFibre link analyser

36

STAR Fire

37

VC/BC

IF

Reg

USB 3

Router

SpW

SpW

1

2

5

6 SpaceFibre

Port 1

(8 Virtual

Channels)

SpFi

Analyser Mictor

VC/BC

IF

SpaceFibre

Port 2

(8 Virtual

Channels)

Reg

7

8

Analyser

SpFi

Mictor

RMAP Config

(RMAP Target)

4

Configuration Bus

SpaceFibre Equipment

38

SpaceFibre Chips

39

SpaceFibre VHDL IP Core

SpaceFibre VHDL IP Core

– Extensively tested and validated

Incorporates all capabilities

– Full QoS

– Fault detection, isolation and recovery

– Low latency broadcast messages

Available from STAR-Dundee

– Implemented in a range of FPGAs

Microsemi: AX, RTG4

Xilinx: V4, V5, Spartan 6, …

– Full and “lite” versions

Full has configurable number of VCs

Lite is designed for a simple instrument interface with 2 VCs

– High rate data VC

– Low rate, high priority command and control VC

40

Radiation Tolerant SpaceFibre ASIC

41

RC64 Many Core DSP Processor

64 fast CEVA X1643 DSP with FP

extension and HW scheduler – 300 MHz

– 40 GFLOPS, 384 GOPS

Modem and Encrypt accelerators

4 Mbyte on-chip shared memory

Fast I/O – 12x SpaceFibre,

– SpaceWire

– DDR3, AD/DA LVDS I/F, NVM

Rad-Hard, for space

Advanced technology – TSMC 65nm LP

– CCGA / PBGA / COB

– 10 Watt

Modular – Payloads can employ many RC64

Versatile – Designed for all space missions

– Planned for 2020—2050

Re-programmable in space

Shared Memory

M M M M M M M M

SpFi DDR2/3 AD/DA SpW NVM

DMA

DSP

DSP

DSP

D

SP

DSP

D

SP

DSP

D

SP

$ $ $ $ $ $ $ $

scheduler

MO

DEM

ENC

RP

T

Ramon

Chips

SpaceFibre in

Radiation Tolerant FPGAs

43

SpaceFibre Lite Evaluation Board

44

Commercial equivalent of flight proven parts

– Microsemi RTAX1000

– TLK2711-SP SerDes

Pre-programmed with STAR SpFi IP core

FMC interface for connection to development boards

2.5 Gbits/s with 32-bit interface at 62.5 MHz

20% to 25% of AX1000

SpaceFibre on RTG4

45

FMC board to provide SpaceWire and SpaceFibre

RTG4 SerDes running at 2.5 Gbits/s

SpaceFibre interface 4% to 6% of RTG4 (2 to 8 VCs)

SpaceWire interface 1%, RMAP Target 2% of RTG4

Demonstration RTG4 Design

46

RTG4

SpW SpW SpW SpW

SpaceWire

SpaceFibre

Interface

SpFi 4 5 6 7

SpaceFibre

Interface

SpFi 4 5 6 7

0 1 2 3

RTG4

Spa

ceF

ibre

SpaceF

ibre

SpW SpW

RTG4

SpaceF

ibre

SpaceF

ibre

SpW SpW

Demonstration

47

STAR Fire

Packet

Generator

Packet

Checker SpaceF

ibre

Brick Mk3

SpW SpW

USB

3.0

Command

Window Brick Mk3

SpW SpW

USB

3.0

Command

Window

48

Conclusions

SpaceFibre designed specifically for spaceflight

applications

– Integrated QoS

– Integrated FDIR capabilities

– Galvanic isolation

– Compatible with SpaceWire packet level

– Efficient design giving very small footprint

Benefits

– Very high performance

– Reduced harness mass

– Interoperability with existing SpaceWire devices

– Simplification of redundancy

– Deterministic data delivery for control applications

– Single integrated network

Running on RTAX and RTG4 now

49

Thank You

Any questions?

Demonstration in Exhibition/Coffee area

www.star-dundee.com

50