e. calvo (be/bi-qp) 12/10/2015 lhc bi fibre infrastructure

E . C a l v o ( B E / B I - Q P )

1 2 / 1 0 / 2 0 1 5

LHC BI fibre infrastructure

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

2 / 11

Aim and Outline

• BI fibre infrastructure overview• Context• Proposal• Needs, Wants, Likes and concerns…

The objective is to evaluate if the exchange of information and the way BE/BI and EN/EL collaborate can be optimized.

Aim:

Outline:

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

3 / 11

CCR

SR3

SR1

SR2

SX4 SR5

SR6

SR7

SR8

BI fibre infrastructure overview : LHCLHC:Initially, proposed for the BPM system for transmitting the position signals from the front-end cards (in the tunnel) to the acquisition cards (in surface)~2176 operational links @LHC ~1088 spares

Very early, extended to the BLM system, with a very similar distribution. ~1600 operational links

And to the BST system: Broadcast distribution of timing signals from the CCR towards many surface and underground LHC and SPS locations.1:16 splitters in surface buildings>200 operational links more

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

4 / 11

BI fibre infrastructure overview : LTI & SPS

SPS :Very old infrastructure for distributing timing signals (BST):~24 operational links

The new fibre distribution for the BPM system (MOPOS)~432 operational links

And future BLM?

BA1

BA2

BA3

BA4

BA5

BA6

BA7

TI2 & TI8:BPM as in the LHC:~200 operational links

BA7

BA4

Prevessin:Distribution of timing and signals between the CCR and BI laboratories in the CERN Prevessin area.

CCR

866 865

867

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

5 / 11

Context and a bit of legacy• During LHC installation, the termination patch cords (tunnel and surface)

were handled by BI (labelling, installation, etc.) → Mapping (documentation of which signal is on which panel/connector, available spares, etc.) was generated and maintained by BI.

• Mini-tubes came with a standard number of fibres → BI had many spares.

• Every small request from new BI users was tried to be fulfilled within the BI available infrastructure → Faster, cheaper, more efficient.

• The number of BI users increased with time: Ex: - DIDT and MIM (in UA47), Prepulses (in Pt.2 & 8), TTC signals for

BGV (UA43), Diamond detectors in (Pt. 2, 4, 5, 8), 400MHz for Schottky (Pt. 4), White rabbit for MIM, BRAN signals (Pt. 1), Ethernet links for DOROs (Pt 1 & 7), etc.

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

6 / 11

Current situation• Frequently, new requests can not be fully route with existing BI

infrastructure → Part of the routing is requested to EN/EL → Documentation is split between both teams and routing requires several iterations.

• The documentation, initially organised for BPM and BLM systems, is not appropriate for other users (multiple racks).

• Information is distributed through several files: surface rack, tunnel racks, patch cords labels, etc.

•Should EL-CF and BI continue having a BI link person ?

•Is this splitting of information the most efficient way of managing the BI fibres?

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

7 / 11

Proposal• Integrate BI fibre infrastructure in the EN/EL fibre database (or

documentation system).

So that… 1) BI users contact directly EN/EL-CF2) EN/EL-CF can completely route the new requests (using BI infrastructure when possible)3) EN/EL-CF keep the information updated, complete and in a standard way.

Not important differences in the way of working for EN/EL … but an important effort in - understanding the current BI documentation - and (eventually) adapting it to EN/EL

standards

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

8 / 11

Needs, Wants & Likes (I)

Be able to connect/unconnect cards at the link ends for maintenance/upgrade/test purposes.

Usually <10 links per TS Flip patch cords for disentangle tx/rx issues.

BPM can verify correct routing. (BST also can). This is not the case for other systems.

Access to the database/documentation system. Know about links routing and links availability.

EN/EL “Piquet service” for patching or repairing links. EN/EL particular patch cord store. (BI wishes to keep its small local stock of patch

cords as till now).

BI needs:

BI does not need:

BI wishes: Access to additionall information about the link : length, full attenuation, number

of connectors, OTR data Update information in the database: Ex. routing information, power @rx.

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

9 / 11

Needs, Wants & Likes (II)CF team needs and/or concerns ? Clear and complete documentation:

BI has different levels of documentation quality:- Recent links follow EN/EL standards (visio templates, with panel

names, connector types, patch cords lengths, etc) + photos (notes)- BPM, BLM and BST links @ LHC are mainly rack layouts and patch cord

excel tables.

- BLM has also all the links in the layout database.- Old BST links @ SPS have an excel table with building and rack

numbers (there is not information about repeaters, optical attenuators or available spares).

If the proposal is retained/considered, first steps will be study the documentation and probably make a series of visits to the facilities.

https://edms.cern.ch/project/CERN-0000115916

https://edms.cern.ch/project/CERN-0000115916

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

10 / 11

Needs, Wants & Likes (III)CF team needs and/or corcerns ? (cont.) Teams should negotiate and stablish a rigorous procedure to keep the

documentation up to date.

Methods are diverse: direct access to the data base, email, some kind of “DIF” form (“DMF”: Demande de Modification de Fibres? ), etc

Something else?

11 / 11

12 / 11

Spare slides

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

13 / 11

Example of SX4

BY03=UA23 BY02=UA23 BY01=UA27 BY02=UA27 BY03=UA27BY06=UA23BY13=UA43 BY08=UA43 BY07=UA43 BY01=UA47 BY05=UA47 BY08=UA47BY06=UA23BY12=UA43 BY03=UA27BY09=UA47

Surface Rack

Octant 4

BPM , BLM & BST - Optical Fibre distributionBY02=US45

US 45

284 Fibres 300 Fibres

24 Fibres

BYPLM.A33L4 BYPM.A12L4 BYPM.A8L4

22 crates 4 crates

BYPLM.A12L4

8 Fibres 8 Fibres 8 Fibres8 Fibres

BYPM.A8R4 BYPM.A12R4 BYPLM.A34R4

4 crates 23 crates

BYPLM.A12R4

8 Fibres 8 Fibres 8 Fibres8 Fibres

6 Fibres 12 + 7 Fibres

12Fibres 12 Fibres 12 Fibres 6

Fibres24

Fibres

1 minitube x 24 fibres 1 minitube x 24 fibres

1 minitube x 8 fibres 1 minitube x 12 fibres1 minitube x 12 fibres

1 minitube x 12 fibres 1 minitube x 8 fibres1 minitube x 12 fibres 1 minitube x 12 fibres

7 minitubes availablefor UA43

7 minitubes availablefor UA47

1 minitube x 12 fibres

12 Fibres

12 Fibres

BY05=SX4

27/10/2014

BY02=UA27BY11=UA47

10Fibres

BY02=UA23BY06=UA43

2Fibres

1 minitube x 8 fibres 1 minitube x 12 fibres

4 Fibres

BY01=UA27BY02=UA47

2 Fibres


1 minitube x 12 fibres1 minitube x 24 fibres

CYFIB01=SR4


BY01=UA27BY10=UA47

6 Fibres


BY01=UA27BY15=UA47

6 Fibres


6 fibres linked to CCR for FBCT system CYFIB01=SR4

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

14 / 11

Ex. of SR1 star point rack

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

15 / 11

Ex. Diagrams for new BI users

xx

Created by:

Date:

Version:

EN-EL-CF

OSVC:Schematic

1.0BST Signal for DOROS in USC55 & UJ56

Page: 1/1

BST Signals For DOROS B1 & B2 – USC55 = BY01B1 & B2 – UJ56 = BY01

SR5CYFIB0x

E2000 E2000

CCC

ODF

xxmCxxxx

E2000

RA0908

874-R/874-R2/MODF

xmCxxxx

7

SR5

ODF

BY05

5 ODF

CCR

xxx 57

CYFIB01

E2000

LOCAL CONTROL CYFIB01

E2000 E2000

SR5CYFIB0x

E2000 E2000

CCC

ODF

xxmCxxxx

E2000

RA0908

874-R/874-R2/MODF

xmCxxxx

8

SR5

ODF

BY05

6 ODF

CCR

xxx 68

CYFIB01

E2000

LOCAL CONTROL CYFIB01

E2000 E2000

xx

OSVC:Eva Calvo 1/09/2015Date:

USC55

BY01

E2000

USC55

CCR (RA0908) - CCC – SR5 (CYFIB0x) – SR5 (BY05-D6_5) - USC55 (BY01- A17)

BST-B1 for CFB-USC55-BIDRC1 in USC55=BY01

BE/BI


BST-B1 for CFB-USC55-BIDRS1 in USC55=BY01

BE/BIA11

D-5

E200011

D-6 ODF5 17

A

BY01

ODF

SPLITTER N2, BST B1INPUT

SPLITTER N2, BST B2INPUT

IN

IN

E2000 E2000

USC55

BY01

E2000

USC55


BST-B2 for CFB-USC55-BIDRC2 in USC55=BY01

BE/BI


BST-B2 for CFB-USC55-BIDRS1 in USC55=BY01

BE/BIA12

D-5

E2000

12

D-6ODF6 18

A

BY01

ODF

SR1BY05

SPLITTER N2, BST B2OUTPUT 2 2

SR1BY05




E2000 E2000

SR1BY05

SR1BY05

0.5mC53571

0.5mC53565

1 mC45517

1 mC45571

1 mC45578

1 mC45503

E2000

E2000

A-7

A-8

ST

ST

RA0907, Crate: CFV-CCR-CTLBST1

Signal: BST B1

RA0907, Crate: CFV-CCR-CTLBST2

Signal: BST B2

UJ56

E2000 CCR (RA0908) - CCC – SR5 (CYFIB0x) – SR5 (BY05-D8_11) - UJ56 (BY01- A11)

BST-B1 for CFB-UJ56-BIDRS1 in UJ56=BY01

BE/BIA11

D-8

E200011

BY01

ODF

UJ56

E2000 CCR (RA0908) - CCC – SR1 (CYFIB0x) – SR5 (BY05-D8_12) - UJ56 (BY01- A12)

BST-B2 for CFB-UJ56-BIDRS1 in UJ56=BY01

BE/BIA12

D-8

E200012

BY01

ODF

SR1BY05

SPLITTER N2, BST B2OUTPUT 2 3 SPLITTER N2, BST B1

OUTPUT 3 3

SR1BY05

1 mC45532

1 mC45572

E2000

E2000

E2000

E2000

LC

LC

LC

LC

LC

LC

3 mC70589

3 mC70284

LHC BPM debug fibres. Temporary borrowed

LHC BPM debug fibres Temporary borrowed

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

16 / 11

Kind of connectors used

E2000/APC90%

BPM, BLM and BST panels @ LHC

ST:BST rx @ LHC

LC: Rx @SPS new MOPOS and growing community of new systems

FC/PC:Some old patch panels @ SPS

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

17 / 11

BLM fibres in the Layout DB

E. C

alvo

(BE/

BI)

E. C

alvo

(B

E/B

I)

18 / 11

CO rack configuration tools

e. calvo (be/bi-qp) 12/10/2015 lhc bi fibre infrastructure

Documents