status of ssrf control system @ epics collaboration meeting 2008

STATUS OF SSRF CONTROL SYSTEM

@EPICS collaboration meeting 2008

Shen LirenSSRF Control [email protected]

2008-3-12

http://www.sinap.ac.cn/EPICS2008/index.htm

Control Group SSRF CN, Shanghai, 2008

Control system status

• The development & runtime environment of hardware/software has been set up(include high level physical application environment): – Control system network & server system– Epics environment– Matlab 2007a with Accelerator Toolbox (AT) & middle layer

• Have tested all of device controller: – VME system, PLC, Serial device controller etc. – Prepared, done all related EPICS driver testing.

• All Subsystem control schema for the machine were confirmed and tested prototype under the control system environment.

• As yet, All the control system of Linac, Booster & Ring has been finished and used during commissioning.

• Now was delivered for daily operation and works fine.


SSRF Control system overview

• EPICS based control system

• Connected by 2G Backbone Ethernet with backbone redundancy for the whole system

I OC

－1 5储存环－1 2增强器直线－1 7线站一层实验室－1 5

数据库服务器 SAN

二层实验室－1 5

计算机计算机计算机计算机计算机计算机

防火墙

路由器

公共网络

OPI OPI

VPN服务器

VPN客户端

应用服务器

DNS/LDAPRADI USDC etc

核心交换机

OPI OPI

• For LINAC, Booster, Storage ring control, MPS, Timing System & the Software System

• Using Ethernet as fieldbus– Ethernet based PLC

– Serial 2 Ethernet translate for serial device

– Soft IOC

Environment of Control system

• The development and runtime environment of control system have been set up and come into use.

• Composed with the control system network system, server system and OPI system.

• Uniform running and development environment.

• Developer and operator can login in on any terminal and share resource of entire environment with one account system.


Control System Network

Control Group SSRF CN , Shanghai, 2008

•1000M Ethernet with 3 layer switcher •backbone reach 2G. •Control system sub lan by VLAN•Division and recombine•Full Network manage ability and application oriented Qos•Backbone redundancy design to ensure reliability•Remote access and monitor

•Sub system division by VALN•10.30.X.X/24

•Static 3 layer route table•Access List table for access control•Can be integrated other system easy in future

PS system

BI system

Server system

OPI

…

Development and runtime enviroment

• Set up the uniform development environment which base on PC Linux system for development and operations.

• All of the OPI and the server system running the fedora 7 system for supply the EPICS development and high level physics application environment.

• Using NIS and NFS to manage user account and share resource. As part of runtime environment, the database server, boot server, Soft IOC server and EPICS application server such archive and alarm handler were installed at the server room.


Server System

• Two kinds of server:– Linux & Windows Server

• Integrated with Windows UNIX service 3.5

– The operation system

• Fedora core 7

• Windows 2003 R2 64bit & 32bit

• Different application on different type of server– NIS, YUM, PXE, NFS, NTP, Windows AD, Epics Boot, Soft IOC,

Archive, Alarm, Database, Web Service, WEB, e-Log etc.

• User can log on the any terminal with one set of account

• User’s home on one NFS Server


Hardware system

• Uniform hardware design, as typical implementation of SSRF control system have:– Ethernet everywhere – VME 64x System : GE VMIVME-7050 and Motorola MV5500.– PLC system: Yokogawa FM3, SIEMENS S300.– Serial port server MOXA NPort-5610.– The embedded controller: Digital power supply controller– VME board:

• Timing system: VME-EVG-230, VME-EVR-230, EVR-TTB-200, EVR-OTB-200

• PS control system: VIPC 664– Linux PC server (SoftIOC)

• Multi IOC running configure

• IOC management


VME 64X System

Control Group SSRF CN Review, Shanghai, 2008Control Group SSRF CN, Shanghai, 2007

• CPU:

– Motorola MV5500

– GE VMIVME-7050

VME 64X crateby Elma

4U 7Slot9U 12 Sloat

With the crate monitor systemwith Ethernet or Serial port

Support Telnet, Http

integrated with EPICS

Hardware

• Serial 2 Ethernet translate


MOXA UCEmbedded LinuxDI/DO

PLC System

MOXA NPort 5610-16

Software System

• The SSRF control system running on EPICS base v3.14.8.2

• OPI – EDM and some Python script

• High level physics application– Matlab v2007a

– MCA/LabCA

– Accelerator Toolbox (AT) & middle layer was adopted.

• Perl/Python, Qt3

• CodeGear RAD Studio 2007(Borland C++/Delphi)– EPICS base 3.14.8.2


Control Group SSRF CN Review, Shanghai, 2006

Online Device test using AT@ Matlab

Centralize EPICS Develpoment platform

• Hardware– HP Rack PC Server 580GG4– Xeon 3.0G/8G RAM/300G SCSI HD

• Software– OS

• Linux FC7/Kernel 2.6x/GCC 4.xx– EPICS base

• 3.13.9/3.14.8.2/3.14.7/3.14.6/3.14.5– Extensions

• Edm/medm/SDDS/Archiver/Sequencer/etc.– Cross-compiler environment

• Gcc 2.8x/gcc 2.96/gcc 2.96 patch

• Target– Motorola VME 5500/GE VME 7050/ Motorola VME2302


Centre Database System

• Store the machine parameters and reference information for all stage of machine simulation and running.

• Access and set various accelerator run time configure parameters, failure report and invalid record of all system.

• Store accelerator runtime data using enhance channel archive system.

• Integrated with uniform authentication system, uniform database access rule and data integrality.

• Remote access from Internet and web based database access also could be applied.


Database System

• The hardware platform using SAN & database server cluster.

• Now we have tested on the MS SQL Server 2005 and will transfer to Oracle 10g with RAC later.



Data archive & analysis tools

• Distributed archive engine with center relational database

• Native XML data type with xml schema for data storage

• Developed a data retrieval system based XML Web Services to access the archived data.

• The system included bottom layer interface and interface applicably for accelerator physics as well as client samples exemplifying how to use the interface.

• Tools for users that can browse, retrieve and plot data

• By the client samples, user can development their own application.

• Memo: not be used now, just in test progress


Data archive & analysis tools

e-Log System

• Based on center database system

• Using Web2.0 Blog system

• Support RSS

• Integrated with uniform authentication system


SSRF Control System

• Three part of control system:– Linac, Booster, Storage Ring

– Magnet PS, Vacuum, Modulator, e-gun, Microwave, Transport Line(inject&extract ), Timing, MPS, RF, Software

• System device IOC PV

• Power supply 585 26 60000

• Vaccum system 730 25 23298

• MPS system 25 3 16842

• Timing system16 16 540


Control Group SSRF CN Shanghai, 2008

EDM OPI of Linac control system

PS Control System

• Over 550 magnet power supplies are used at SSRF

• All magnet PS are digital controlled

• 2 types of digital controller used:– SINAP-developed digital PS controller:

• served for LINAC, Booster and Transport Lines

– PSI-designed digital controllers (Purchased from DLS Co., Ltd):

• served for Storage Ring and the Booster Ramp PS.

• Performance of high stability and reliability has been demonstrated since SSRF commission.



Digital Power Supply Control system

• Two kinds of system

• Set up the prototype system

• All system testing have been done

• EPICS integrated

Digital Power supply control system


Statistics


Section PS IOC Record Cost(CNY)

Linac 50 1 3.0K 0.6M

Linac-to-Booster 21 1 1.3K 0.3M

Booster 58 2 4.0K 0.8M

Booster-to-Ring 25 1 1.7K 0.4M

Storage ring 431 22 50.0K 7.0M

Total 585 27 60.0K 9.1M

PS Control System

Control Group SSRF CN, Shanghai, 2008Control Group

Booster PS Control System - in house design


Vacuum Control System

• Device based on serial port– Vacuum Gauge: VARIAN Multi Gauge

– Sputter Ion Pump: JJJvac Sputter Ion Pump Power Supply

– VAT

– RGA（ Residual Gas Analyzer）• Vacuum Valve

– PLC system



• Serial Device Server: MOXA Nport 5610-16– Total 53

• Gauge Controller: VARIAN MultiGauge– Total 72, with 140 BA Gauges

• Pump Power Supply: JJJVac IPS & TSPC– Total 406 IPS, with 406 Ion Pumps

– Total 229 TSPC, with 229TSP

• Valves: VAT– Total 41




Contact Signal

RS - 232

Ethernet

RGA Monitor

PC/Windows

IOC

PC/Linux

Serial Device Server: MOXA NP5610

Pump

Pump Power Supply

Gauge

Gauge Controller

PLC

Valve Controller

RGA

Thermocouple

I nterlock Signals

RelatedSystems

OPI

Ethernet

Valves

Vacuum Control

Control Group SSRF CN, Shanghai, 2008Control Group SSRF CN Review, Shanghai, 2006


Vacuum device control with MOXA UC7400

• Serial device control with EPICS embedded

• Create new make files– make EPICS base support “linux-xscale”

target

• Create new driver API on Monta vista linux

– Protocol converter between BSD socket protocol and proprietary protocol

– Using non-block mode to solve timeout connections

Power supply of Ion pump Edm GUI

W A R N IN G

O P I

IO C

N P O R T-5 6 1 0

Var i o us s e r i al de vi c e s

O P I

IO C

U C 7 4 0 0

Var i o us s e r i al de vi c e s


The event timing system

• New event timing system– Structure is simple used

broadcasting method– Low Jitter with distributed RF clock– Run on the EPCIS environment, base

3.14.x– Easy to extend

µç ÀÂ²Û ¼Ü

B L

B LC 0 1

C 0 2

C 0 3

C 0 4

C 0 5

C 0 6

C 0 7

C 0 8

C 0 9

C 1 0C 1 1

C 1 2

C 1 3

C 1 4

C 1 5

C 1 6

C 1 7

C 1 8

C 1 9

C 2 0

F A N 2 -1

F A N 2 -2

F A N 2 -3 F A N 2 -4

F A N 2 -5

E V GF A N 1

R F

F A N 2 -6

F A N 2 -7

S R 1

S R 2

S R 3

S R 4

S R 5

S R 6

S R 7

S R 8

S R 9

S R 1 0B R 2

B R 1

LN 1

S e c o nd le v e l brunc he s, ~ 2 5 0 m

Third le v e l brunc he s, ~ 6 0 m

S R : S to ra g e R ing lo c a l sta tio n ,a ssum ing 1 0B R : B o o ste r R ing lo c a l sta tio n ,a ssum ing 2L N : L ina c lo c a l sta tio n ,a ssum ing 1

F o uth le v e l brunc he s(pla stic fibe rs), ~ 3 5 m

• Compact network based on characteristic event system.

• All EVRs are placed on timing crates and BI local stations not being triggered devices

• All trigger outputs integrate with hardware interlocks

M as ter4 9 9 .6 5 M Hz ~ 1 m c o ax ia l c ab les w ith p h as e s tab ilized

R F L o c al Stat i o n

L i nac C o ntr o l L o c al Stat i o nV

ME

-FO

UT

-12

WM

E-F

OU

T-12

G u n - T x -2 0 0( VM E 6 4 x )

VM E - E VR - 2 3 0(VM E 6 4 x )

B o o s te r R in g L o ca l S ta t io n

0 d b m

E VR -O T B- 2 0 0( VM E 6 4 x )

1 m M u ltim o d e f ib er

250m M

ultimode fiber60m

Multim

ode fiber

G u n - R c- 2 0 0

LVP E C L 4 9 9 .6 5 M Hz

P o w erd ev id er

T r an s f o rm er VM E - E VG - 2 3 0( VM E 6 4 x )

TTL 5 0 H z ·½ ²̈5 0 H z 2 2 0 VAC

- 3 d b

M as te r4 8 9 .6 5 M Hz

P o w erd ev id e r- 3 d b

L P F

+

-

L VP E C LBP F L P F

A/D

A/D

C P U D /A

Ö÷¶¨ Ê± »ú ¹ñµç Ô´ ²å ×ù

ÕýÏÒ ²̈ /·½ ²̈

5 0 H z 5 VAC

P h as e S h if t

VM E - E VR - 2 3 0( VM E 6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR -T T B- 2 0 0( VM E 6 4 x )

3 1 0 m M ult im o de F ibe r

EVR - O E B-2 0 0

EVR - O E B-2 0 0

EVR - O E B-2 0 0

EVR - O E B-2 0 0

LA -BI:BP M -Gu n t rig 02LA -BI:BCM -Gu n t rig 03LA -BI:A D C-Gu n t rig 04LA -BI:CM R-Gu n t rig 05LA -BI:O S G-Gu n t rig 06

LA -CN :EVR1Gu n

WM

E-F

OU

T-12

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR -O T B- 2 0 0( VM E 6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR - O T B-2 0 0(VM E 6 4 x )

E VR -O E B- 2 0 0

E VR -O E B- 2 0 0

E VR -O E B- 2 0 0

E VR -O E B- 2 0 0

BS -CN :H 01EVR1ExtK ic k

VM E - E VR - 2 3 0(VM E 6 4 x )

E VR - T T B- 2 0 0(VM E 6 4 x )

WM

E-F

OU

T-12

VM E - E VR - 2 3 0(VM E 6 4 x )

E VR - O T B- 2 0 0( VM E6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR - T T B-2 0 0( VM E 6 4 x )

E VR - O E B- 2 0 0

E VR - O E B- 2 0 0

BS -BI:H 01EVR1:Brf1

WM

E-F

OU

T-12

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

EVR - O E B-2 0 0

EVR - O E B-2 0 0

S R-CN :H 20EVR1:In jK ic k1

EVR - O E B-2 0 0

F A N 1

F A N 2-7

F A N 2-9

F A N 2-8

F A N 2-6

Sto r ag e R i ng L o c al Stat i o ns

WM

E-F

OU

T-12

F A N 2-1

WM

E-F

OU

T-12

F A N 2-3

S R-BI:H 01EVR1:S rf1

2m coaxial cable

3 5 m M u ltim o d e f ib er

35m plastic fiber




S R-CN :H 20EVR1:In jS e p t1

S R-CN :H 20EVR1:In jS e p t2

S R-BI:H 01EVR1:S rf1S R-BI:H 01EVR1:S in j1S R-BI:H 01EVR1:S in j2S R-BI:H 01EVR1:S in j3S R-BI:H 01EVR1:4K H z

S R-BI:? 01EVR1:S rf1S R-BI:? 01EVR1:S rf1S R-BI:? 01EVR1:S in j1S R-BI:? 01EVR1:S in j2S R-BI:? 01EVR1:S in j3S R-BI:? 01EVR1:500MS R-BI:H 03EVR1:S rf1

S R-BI:H 03EVR1:S in j1S R-BI:H 03EVR1:S in j2S R-BI:H 03EVR1:4K H zS R-BI:H 05EVR1:S rf1S R-BI:H 05EVR1:S rf1S R-BI:H 05EVR1:S in j1S R-BI:H 05EVR1:S in j2S R-BI:H 05EVR1:S in j3S R-BI:H 05EVR1:4K H z

WM

E-F

OU

T-12

F A N 2-2

S R-BI:H 07EVR1:S rf1S R-BI:H 07EVR1:S rf1S R-BI:H 07EVR1:S in j1S R-BI:H 07EVR1:S in j2S R-BI:H 07EVR1:4K H zS R-BI:H 09EVR1:S rf1S R-BI:H 09EVR1:S rf1S R-BI:H 09EVR1:S in j1S R-BI:H 09EVR1:S in j2S R-BI:H 09EVR1:S in j3S R-BI:H 09EVR1:4K H z

S R-BI:H 11EVR1:S rf1S R-BI:H 11EVR1:S rf1S R-BI:H 11EVR1:S in j1S R-BI:H 11EVR1:S in j2S R-BI:H 11EVR1:4K H z

WM

E-F

OU

T-12

F A N 2-4

S R-BI:H 13EVR1:S rf1S R-BI:H 13EVR1:S rf1S R-BI:H 13EVR1:S in j1S R-BI:H 13EVR1:S in j2S R-BI:H 13EVR1:S in j3S R-BI:H 13EVR1:4K H z

S R-BI:H 15EVR1:S rf1S R-BI:H 15EVR1:S rf1S R-BI:H 15EVR1:S in j1S R-BI:H 15EVR1:S in j2S R-BI:H 15EVR1:4K H z

WM

E-F

OU

T-12

F A N 2-5

S R-BI:H 17EVR1:S rf1S R-BI:H 17EVR1:S rf1S R-BI:H 17EVR1:S in j1S R-BI:H 17EVR1:S in j2S R-BI:H 17EVR1:S in j3S R-BI:H 17EVR1:4K H zS R-BI:H 19EVR1:S rf1S R-BI:H 19EVR1:S rf1S R-BI:H 19EVR1:S in j1S R-BI:H 19EVR1:S in j2S R-BI:H 19EVR1:4K H z

60m M

ultimode fiber

60m M

ultimode fiber

60m M

ultimode fiber

60m M

ultimode fiber

BS -CN :H 01EVR2P S B1BS -CN :H 01EVR2P S B2BS -CN :H 01EVR2P S Q FBS -CN :H 01EVR2P S Q DBS -CN :H 01EVR2P S S DBS -CN :H 01EVR2P S S F

BS -CN :H 01ExtEVR1S e p t1

BS -CN :H 01EVR1ExtS e p t2BS -CN :H 01ExtEVR1S e p t3

BS -CN :H 01EVR1ExtBu mp 1BS -CN :H 01EVR1ExtBu mp 2

BS -CN :H 01EVR1ExtBu mp 3 BS -BI:H 01EVR1:Brf2BS -BI:H 01EVR1:Bin j1BS -BI:H 01EVR1:Bin j2BS -BI:H 01EVR1:Bin j3BS -BI:H 01EVR1:Bin j4BS -BI:H 01EVR1:Bin j5

BS -CN :H 02In jK ic k

BS -CN :H 02In jS e p t

BS -CN :H 02RFBS -BI:H 02EVR1:Brf1BS -BI:H 02EVR1:Brf2BS -BI:H 02EVR1:Bin j1BS -BI:H 02EVR1:Bin j2BS -BI:H 02EVR1:Bin j3

LA -CN :EVR1S a mp 1

LA -CN :EVR1S a mp 2

LA -CN :EVR1S a mp 3LA -CN :EVR1P M o d 1

LA -CN :EVR1M o d 1

LA -CN :EVR1P M o d 2LA -CN :EVR1M o d 2

60m M

ultimode fiber 60m

Multim

ode fiber60m

Multim

ode fiber60m

Multim

ode fiber

250m M

ultimode fiber

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

S R-BI:H 03EVR1:S rf2

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - EVR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

VM E - E VR - 2 3 0( VM E 6 4 x )

E VR - O T B- 2 0 0( VM E 6 4 x )

S R R F L o ca l S ta t io n

Hardware Schematic


Performance

• The RMS jitter of gun trigger relative to RF reference is 10.72ps, which includes the jitter of e-gun and oscilloscope.

• The RMS jitters of other injection and extraction trigger are less the 30ps.

• Performance are satisfied with the requirements of physical design.


Timing System



MPS System

• 3 parts：– Accelerator & beam line device interlock– Utility system– Safety system

• Hiberarchy– The whole machine layer– Linac, boost, ring layer– Sub system layer – Device layer

P L C

P L CP L C

P L C

P L C

P L C

I O C

I O C

I O C

I O C

I O C

Ö±Ïß

ÔöÇ¿ Æ÷

·ø Éä ·À »¤ Ïµ Í³

¹« ÓÃÉè Ê©Ïµ Í³

Êø Ïß Õ¾Áª Ëø Ïµ Í³P L C ×¨ ÓÃÍ¨ Ñ¶·½ Ê½

Áª Ëø ÐÅºÅ

·½ Ê½´ý ¶¨

¶¨ Ê± Æ÷

¶¨ Ê± Æ÷

¶¨ Ê± Æ÷

¶¨ Ê± Æ÷

SR 9

B R 1

B R 2

L R

P L C Êä ³ö ´¥ ·¢ Áª Ëø

M P S S w itc h

2# IP1# IP

2# IP

1# IP

O P I

MPS System ,Inject&Extract control system


The RF System

• Turn key system except Linac RF System

• Integrated with EPICS system and can remote control at center control room

• LLRF system


Linac RF Controller


RF Devices Interface

SSRF Design

VME Controller

MVME 5500 CPU

VMIVME 2536

Digital 32 In/32 Out Ch

VMIVME 3125

Analog 32 Ch A/D

Isolated Interface

SSRF-Design EPICS Driver

Booster & Storage Ring RF


Display

Interlock

VME Controller

RF Amplifier & Klystron

Thales

Booster 180Kw

Storage Ring300Kw X 3

Epics IOCMVME 5500

Hytec I/O boardsFully Isolated -

Interface

LLRF SYSTEM


Powe Meter

iPCLocal Interface

x 3

LLRF Control Unit x 3

Motor Drive x 3

SSRF Design

FPGA

Labview

EPICS SoftIOC

RF & Timing Event Distribution


Master Signal Generater

RF SignalDistrubution

Unit

Timing & Eent Signal

Generator

Fiber (Om3 ) Distribution

Unit

RF OPI @ Center Control room


Storage Ring Booster

Remote manage & debug


•Video & Audio system based on network•Device management•Remote monitor: VME ,Switch,UPS etc•Network management system

•Based onSNMP•Email、 SMS alarm system(Next)

IOC Manager


Center Control Room

• HP7700 OPI PC( 18 ) in the Control Room

• All the OPI run on the Linux Fedora 7 and in ssrf.ac.cn domain.

• OPI system running at control system uniform runtime environment.

• The edm file store on NFS file server and all the client can access it by a start script.


Control Group SSRF CN, Shanghai, 2008Control Group SSRF CN, Shanghai, 2007

Conclusion

• Set up a distributed controls system based on EPICS.

• All device control system had finished system construct, include install, online testing and software development.

• The Linac, Booster and Storage Ring control system were finished and used in daily operation.

• High level physics application and control system OPI panel can run normally.

• The control system was successful during the machine commissioning. In general, most function of control have been reached on design goal.



Thanks

status of ssrf control system @ epics collaboration meeting 2008

Documents

control system environment

control system network

control system of linac

status of ssrf control

account system

opi system

system easy

timing system