cern, geneva, switzerland
TRANSCRIPT
OPERATION FOR LHC CRYOMAGNET TESTS: CONCERNS, CHALLENGES
& SUCCESSFUL COLLABORATION
V. ChohanCERN, Geneva, Switzerland
Asian Particle Accelerator ConferenceIndore, India
30 January 2007
APAC 07, January 2007, Indore, India 2V. Chohan
Outline
IntroductionConcerns & HurdlesEarly PerformanceOperational Strategies & ToolsResultsConcluding Remarks
APAC 07, January 2007, Indore, India 3V. Chohan
LHC Requires:• 1232 Dipoles (~19 km out of 27 km ring)
• 360 Short Straight Sections (MQ - SSS)
• 114 Insertion Region SSS (IR-SSS)
Testing & Qualification (& Training!) of each of them for:• Cryo, mechanical & electrical insulation• Quench performance• Field Quality
Total of ~ 1900 magnets (incl. spares & repeats) to be tested before early 2007!
Introduction
1232360114
~ 1900
APAC 07, January 2007, Indore, India 4V. Chohan
Massive Effort !
Test facility called SM 18
15 m long dipoles
SSS
APAC 07, January 2007, Indore, India 5V. Chohan
SM18 Test Facility
With 12 test benches & Cryogenic infrastructureTesting of first series magnets: early 2001– with only 2 test benchesAll 12 benches ready only by June 2004 !
APAC 07, January 2007, Indore, India 6V. Chohan
Various Teams of SM18
Magnet Connect / Disconnect
Team
Magnet Tests Team
Cryogenics TeamMagnet Transport
Team
(OP Team)
Mainly consists of associates
from DAE, India
Industrial consortia
APAC 07, January 2007, Indore, India 7V. Chohan
Magnet Tests.. What do we do ?
New magnet arrives..
Insulation test, connection to CFB
Preparatory tests (functioning of protection systems & instrumentation, insulation…)
Preparatory tests (tuning DAQ..)
Insulation tests
Functioning of protection systems
Power tests (&Training)
Magnetic measurements
Final insulation tests @cold
Cool down to 1.9K
Final warm tests
Electrical integrity
Resistance measurements..
Final insulation tests
Disconnection from CFB
Warm –up
APAC 07, January 2007, Indore, India 8V. Chohan
SM18 Magnet Tests : What it’s all about
Demands on SM18 Operation
ProjectManagement
MagnetProduction
LHC Beam Running in &Minimum dI, dE
provision
AcceleratorPhysicists
APAC 07, January 2007, Indore, India 9V. Chohan
Concerns & Hurdles
APAC 07, January 2007, Indore, India 10V. Chohan
Who’s & How’s of Tests1. Novelty Aspects
― Early R&D culture – lack of transparency! ― Magnets trained to ultimate field, Extensive
magnetic measurements, Qualification of ‘poor’magnets..
2. Infrastructure Limitations― Cryogenics, Water, Electronics, Power Converter..
3. Personnel Logistics― Minimum staff strength of 4 per shift (24 hr
operation, 45 weeks..)
4. Co-ordination of Work & Teams― Indian Staff & Language barrier!
5. Nature of Industrial Contracts― Work slowed down during weekends, lack of
adequate technical support beyond normal hours..
APAC 07, January 2007, Indore, India 11V. Chohan
Early Performance
APAC 07, January 2007, Indore, India 12V. Chohan
Early Performance
Finish testing of remaining ~1800 magnets by early 2007 ???
Only 21 magnets in 2001~02 !
Only 95 magnets till end 2003 !
APAC 07, January 2007, Indore, India 13V. Chohan
Operational Strategies & Tools
APAC 07, January 2007, Indore, India 14V. Chohan
Strategies
1.Addressing Manpower IssuesWho?
2.Addressing Technical IssuesHow?
APAC 07, January 2007, Indore, India 15V. Chohan
Addressing Manpower Issues
APAC 07, January 2007, Indore, India 16V. Chohan
Staffing Profile 2003
7 from CERN
5 from India
APAC 07, January 2007, Indore, India 17V. Chohan
Manpower IssuesStaff strength : 4 per shift (≈ total 24)7 from CERN (up to 12 in 2005)Rest from India BUT on strict 1 year rotationHence careful planning was necessary..
0
5
10
15
20
25
30
35
40
45 Cern
Cern-NewIndia-New
India
(2005)CERN FTE ~ 12INDIA FTE ~ 14
(2005)CERN FTE ~ 12INDIA FTE ~ 14
(2006)CERN FTE ~ 6
INDIA FTE ~ 20
(2006)CERN FTE ~ 6
INDIA FTE ~ 20
APAC 07, January 2007, Indore, India 18V. Chohan
Addressing Technical Issues
APAC 07, January 2007, Indore, India 19V. Chohan
Operational Strategies
1. To-Do List― Describes minimum set of tests on each magnet
2. Magnet Test Report (MTR)― Paper log of test results
3. Get higher throughput― Training rules:
Two-Quench Rule Three Quench Rule
― Reduced magnetic measurements
4. Rapid On-Bench Thermal Cycle (ROBTC)― Thermal cycle of a poor magnet without
disconnection from test bench
5. Overall & Cryo priority setting― 24 hour priority decision by OP team for
effective & clash-free utilization of resources
APAC 07, January 2007, Indore, India 20V. Chohan
To-Do List & MTRTests
numbered sequentially
Prefixes define type of test
Obeys To-Do List
Checklists & notes
appended
APAC 07, January 2007, Indore, India 21V. Chohan
Training Rules & ROBTCMost of the ‘good magnets’ cross nominal field (11850A ~ 8.33T) in
the second training ramp..ALL ramp2
10350
10850
11350
11850
12350
12850
13350
1001
-1st
run
1002
1002
-3rd
run
1003
1004
-1st
run
1005
1006
-1st
run
1007
-1st
run
1008
-ist r
un10
08-2
nd ru
n10
09-1
st ru
n10
10-1
st ru
n10
11-1
st ru
n10
1210
1310
1410
1510
1610
1710
1810
1910
2110
2610
26- 2
nd10
2210
2310
2410
2510
2710
2810
29-1
st ru
n10
29-2
nd ru
n10
2010
3110
3210
3410
3510
3810
4510
3910
4210
4910
5010
50-2
nd ru
n10
5210
48
2001
-1st
run
2001
-2nd
run
2001
-3rd
run
2002
2003
-1st
run
2004
2008
2008
-2nd
run
2007
2006
2010
2009
2012
2017
2018
2020
2021
2022
2022
-2nd
run
2025
2025
-2nd
run
2023
2023
-2nd
run
2026
2026
-2nd
run
2027
2029
2024
2024
2054
3001
-1st
run
3001
-2nd
run
3001
-3rd
run
3001
-4th
run
3002
- 1st
run
3002
- 2nd
3002
- 3rd
run
3002
-4th
run
3004
3005
3006
3007
3008
3011
3012
3013
3014
3027
3028
3034
3041
3038
3039
3042
3044
3043
3045
3046
3046
-2nd
run
3047
3054
3055
3065
3070
ALL ramp2
10350
10850
11350
11850
12350
12850
13350
1001
-1st
run
3002
- 2nd
run
3002
- 3rd
run
3001
-3rd
run
1002
-3rd
run
1006
-1st
run
1008
-ist r
un10
1210
1310
1710
1810
3110
3210
3510
3810
4510
3910
4220
03-1
st ru
n30
01-4
th ru
n30
02-4
th ru
n30
0430
0630
0730
0830
1430
2730
2830
46-2
nd ru
n30
5430
7030
01-2
nd ru
n10
04-1
st ru
n20
0810
10-1
st ru
n10
1610
50-2
nd ru
n10
07-1
st ru
n10
1510
0310
08-2
nd ru
n10
09-1
st ru
n20
0710
5210
2810
3420
08-2
nd ru
n30
4520
0630
3430
4110
2330
4710
29-2
nd ru
n20
0420
22-2
nd ru
n20
26-2
nd ru
n20
0930
4420
2030
1210
11-1
st ru
n10
2410
0210
5030
1330
4210
4920
23-2
nd ru
n30
1110
2130
3810
1410
2520
01-2
nd ru
n20
01-3
rd ru
n30
01-1
st ru
n30
3930
6530
4310
26- 2
nd ru
n30
02- 1
st ru
n20
5420
0210
4810
29-1
st ru
n30
0520
1720
2420
25-2
nd ru
n10
2720
1220
2910
2230
4620
1830
5520
2620
01-1
st ru
n10
2620
1010
1910
2020
2520
2120
2320
2420
2220
2710
052017
2024
2025
-2nd
run
1027
2012
2029
1022
3046
2018
3055
2026
2001
-1st
run
1026
2010
1019
1020
2025
2021
2023
2024
2022
2027
1005
80% magnets cross nominal in 2nd ramp!
―Two-Quench Rule: Accept the magnet if it crosses nominal field in Second training with small margin!
―Three-Quench Rule:Accept the magnet if it crosses 12250 A (~8.66 T)in third training, even if it had not passed the preceding rule..
ROBTC: Rapid thermal cycle of a poor magnet without disconnection from test bench
―Saves disconnection & connection time….
―And mounting the quench location devices (often a futile exercise!)
APAC 07, January 2007, Indore, India 22V. Chohan
Overall & Cryo Priority Setting
― Ensure that magnets follow the desired cryogenic phase distribution, within the limits of possibilities due to the varying training performance ( a priori not known)
APAC 07, January 2007, Indore, India 23V. Chohan
Operational Tools
1. SM18 Test Management System (SMTMS)― All relevant test data stored in it
2. E-traveller― Web based electronic work flow manifest with mobile
phone interface
3. Integrated Resource Display― On-line display of usage of various resources
4. E-logbook― Maintains log of activities, categorizes & records faults
5. MAPS― Single page record of ‘rule based magnet goodness
evaluation’
6. Operations Web page― Easy access to all tools & documents
APAC 07, January 2007, Indore, India 24V. Chohan
SMTMS
• Saves all test data into the system
• Tracks test progress & test statistics
• Automatic generation of test reports
• Smooth team interaction
• Interface with mobile phones – alert teamsMinimizes verbal communication..
• Maintains automaticrecord of test flow
& E-Traveller
APAC 07, January 2007, Indore, India 25V. Chohan
Other ToolsIntegrated Resource Display E-log book
MAPS Operations Web page
APAC 07, January 2007, Indore, India 26V. Chohan
APAC 07, January 2007, Indore, India 27V. Chohan
Results
APAC 07, January 2007, Indore, India 28V. Chohan
Early performance
With new strategies & tools
APAC 07, January 2007, Indore, India 29V. Chohan
Annual Statistics
Special SSS tests, Train
to ultimate…Time
consuming!
2176
456
703
648
0
100
200
300
400
500
600
700
800
2002 2003 2004 2005 2006
Total Magnets Tested
APAC 07, January 2007, Indore, India 30V. Chohan
Repeat Rates & Magnetic Measurements
--30.8512.8IR-SSS
~ 613.3212.5SSS
~ 318.369Dipoles
Repair/ Rejection
%
Mag. Meas. (MM)
%
Repeat Rate%
APAC 07, January 2007, Indore, India 31V. Chohan
Concluding Remarks
1. Magnet tests completed ~Feb 20072. Major contributions of Indian
Associates:Development of strategies, tools & proceduresDedication, Sincerity and Hard workAnd much more….
Unique, large scale international collaboration in the accelerator domain! (in human resources: ~90 persons in 5 years)
APAC 07, January 2007, Indore, India 32V. Chohan
Collaborators from Bhabha Atomic Research Centre (BARC), Mumbai, India:Clement Verghese, Prem Kumar Kavalan, Laddha Anand, Maurya Beachai, Malhotra Sanjay, Perupayikkad Daniel Babu, Shetty Satish Shankar, Narayanan Ramkumar, Satyanarayana Arunkumar, Nair Kesavan, Awale Prashant Kamalakar, Patil Mahesh Balasaheb, Dubey Krishna, Roy Amitava, Thota Venkatesulu Shyam, Gupta Rakesh Kumar, Mascarenhas Martin Lucio, Surendran Puthiyedath, A Kasbekar, J Mishra, P Motiwala, P Adibabu, P Joshi, P Kashyap, Naushad Ali, D Roy, Jacob John, K Ambastha, Jaydeep Gore, Vasu Kakkat, Sanjeev Sharma, D Bhattacharjee, Sudheer Singh, Surajit Sen, Manna, Swagat Mukherjee, Vikas Chauhan, Mukesh Sharma, Vikas Telang, Subrat Kaushik, Sumeet Maity, Sampath Kumar, Charudatta Kulkarni, S. Padmakumar, P. K. Panda, N.S. Dalal, Sunil G Kulkarni, Sreyas R Shimjith, Sushil K Bahuguna, Vijendra Sinha, Kuldeep Joshi, E Kandaswamy, M Y Dixit, Amit Tikaria, R I Bhaktsingh, B V Rama Rao, S T Sonnis, N G Tayade, Vivek YadavG Aravamuthan, S. Gomu, Gangoor, Vineet Sinha, M Naskar,Y Chaudhari, A Basu, P BehereCollaborators from Centre for Advanced Technology (CAT), Indore, India:Gandhi Manoj, Marathe Ravindra G, M Jathar, Radheshyam Pramod, A Kasliwal, Khare Krishna Mohan, Pareek Prashant, Jain Akhilesh, Pagare Anand, Yash Pal Singh, Mandar Joshi, Praveen Deshpande, Jitendra Patil, Rajkumar Gupta, Seshnath SinghS Kane, S Pralod, Vimal Bhatnagar
Collaborators from Indira Gandhi Centre for Atomic Research (IGCAR), Kalpakkam, India:T S Selvakumaran, R Dhandapani, Sethumadhavan Sridhar, B Rao, K Palanisami
Collaborators from Variable Energy Cyclotron Centre (VECC), Kolkata, India:Bhunia Uttam, Bhole R, Sandip Pal, J Debnath
Indian Associates in SM18(2002 – 2006)
APAC 07, January 2007, Indore, India 33V. Chohan
Making it possible ..
APAC 07, January 2007, Indore, India 34V. Chohan
It is pretty cool…
APAC 07, January 2007, Indore, India 35V. Chohan
With food for thought..
APAC 07, January 2007, Indore, India 36V. Chohan
With a little workout..
APAC 07, January 2007, Indore, India 37V. Chohan
& Bit of aerobics for health !
APAC 07, January 2007, Indore, India 38V. Chohan
Thank You !
APAC 07, January 2007, Indore, India 39V. Chohan
Extra Slides
APAC 07, January 2007, Indore, India 40V. Chohan
Statistics: Actual Vs. Predicted Throughput
For the dipoles actual throughput has coincided with the prediction.For the special SSS and arc SSS the actual throughput is better thenthe prediction.
magnet trained! Quench?
Min. NRJ at 11.85 kA
Yes Iq<12kAMM*, PT8, CDAP
Ramp 1[To 12850A]
No
Ramp 2[To 12850A]
Yes Iq>12kA
NoYes Iq>12kA
Yes Iq<12kAQuench?
No
Yes
Rules : 15 April 04
If shafts?
MM*, CDAP
Min. NRJ at 11.85 kA
Ramp 2[To 12850A]Quench?
Train to 12850A(see rules) #
8 rampsYes
Generate .u fileat 12850A & SPA
No
Warm-up on 10th
Quench at 4K (SSL)
CDAP at 4K
Generate .u fileat 12850A & SPA
Min. NRJ at 11.85 kA
PT8
MM*, CDAPMM*, CDAP
Min. NRJ at 11.85 kA
CDAP
Generate .u fileat 12850A & SPA
No
Warm-Up
Yes
Generate .u fileat 12850A & SPA
Ramp 9[To 12850A]
MM*, PT8, CDAP
Quench?No
Yes
APAC 07, January 2007, Indore, India 42V. Chohan
# Max 9 Ramps to 12850A; If this terminated in <= 9 rampsThen follow flowchart , else:magnet is poor & do warmup on 10th with 4K
quench Instead of PT10THEN: Thermal Cycle if AntiC exist & so put in shaftsELSE(( if no AntiC) – Magnet removed & Standby
MM* If Shafts Are Present!
PT8 = Ramp to 12 kA & SPA
CDAP =HV@ cold Final
Thermal Cycle Rules with Shafts Inserted :In the 2nd Run:
if 1st Q above (8.4 T) 12000A then MB accepted if 2st Q above (8.6 T) 12350A then MB accepted
ELSE MAGNET REJECTED WITH poor perf non-conformity but with the rules :if Quenches are localised only in 2nd run (with shafts inserted only in the 2nd run ): perform 5 quenches only And END the Tests.
if Quenches were localised in first RUN : then perform max 2 localized quenches only in 2nd run
Min NRJ = Quench provokedFPA Disabled
APAC 07, January 2007, Indore, India 43V. Chohan
Typical magnet test times (For the week starting 26th July 2005)
Reference TimesLight green : Connect (up to Cryo pump down) 24 hBlue : Wait + Cool down 26 hIvory: Tests at Cold 36 hRed : Wait + Warm up 12 hDark Green: Disconnect 12 h
Fatigue tests
ICS new connectionproblems
ROBTC
Connection cryostat (B1)
APAC 07, January 2007, Indore, India 44V. Chohan
SM18 Test OperationAvailable Resources
Test EquipmentFixed• 12 Test Benches arranged in pairs so, 6 clusters( A to F)• 6 Main Power Converters • 6 sets of Electronics for testing 1 per clusterMobile• For Q-location & MM special 15 m Shafts to be installed in magnets• Mobile Racks for HV insulation tests & Magnetic Measurements• SSW Units
Shared Utilities• Water for 4 magnet powering at the same time • Cryogenics capacity and limits
Manpower [24 hr Tests Operation Staff] in 2005• 14 CERN staff ( ~12 FTE ) on loan from CERN Accelerator Operation ( some only part-time)• 20-25 persons on exact 1 year contracts from India & constantly rotating, so (~16 FTE)• ICS “Magnet connectors/disconnectors” working 24 hours ( but ROCLA not)•Cryogenic Support staff
Technical Support• Equipment support for magnet test equipment and electronics
APAC 07, January 2007, Indore, India 45V. Chohan
Utilities : Cryogenics Capacity
Cryogenics capacity (in 2005) and limits :
3 to 5 Magnets @ 1.9K and under cold tests,
Up to 2 magnets in 300K to 90 K (Cool down) phase , Up to 2 magnets in Last (Warm up) Quench to 300K phase,
( but not exceeding 3 magnets in cool-down or warm-up phase altogether - this limit was 2 up to end 2004 )
1 magnet in 90K to 1.9 K phase
Cryogenics capacity was enhanced in 2005, with•Faster cooling & warming times•Better quench recovery•Increased limits on number of quenchesHowever it still requires a judicious and optimized setting of bench cryo priorities by OP crew
APAC 07, January 2007, Indore, India 46V. Chohan
Hardware CommissioningBeam test
AlignmentTunnelStorelimited number Connections
Beam screen Extra-work(30% dip)
Store4 areas
StrippingFiducials
Cold test
Magnet work flow at CERNbefore beam test
Arrival CM CryostatReception
Beam test Hardware CommissioningDecember 2007 Start January 2007
6 superconducting bus bars 13 kA for B, QD, QF quadrupole
20 superconducting bus bars 600 A for corrector magnets (minimise dipole field harmonics)
42 sc bus bars 600 A for corrector magnets (chromaticity, tune, etc….) + 12 sc bus bars for 6 kA (special quadrupoles)
13 kA Protection diode
To be connected:
• Beam tubes• Pipes for helium• Cryostat• Thermal shields• Vacuum vessel• Superconductingcables
ConnectionsAlignmentTunnelStorelimited number
Beam screen Store4 areas
Extra-work(30% dip)
StrippingFiducials
Cold testCryostatReceptionArrival CM
1st dipole lowered : 7th March 2005
Courtesy: L.Rossi
APAC 07, January 2007, Indore, India 47V. Chohan
Cost structure of the LHC
Magnet+cryogenics = 66%
Courtesy: L.Rossi
LHC tunnel 2002
LHC tunnel 2006
APAC 07, January 2007, Indore, India 50V. Chohan
1232 main dipoles
+ 3700 corrector (spool pieces)
Regular arc Magnets
APAC 07, January 2007, Indore, India 51V. Chohan
Installed dipole
Regular arc Magnets
392 main quadrupoles +
2500 corrector magnets
SSS being transported
APAC 07, January 2007, Indore, India 52V. Chohan
Supply and recovery of helium with 26 km long cryogenic distribution line
Static bath of superfluidhelium at 1.9 K in cooling loops of 110 m length
Connection via service module and jumper
APAC 07, January 2007, Indore, India 53V. Chohan
Insulation vacuum for the cryogenic distribution line
Insulation vacuum for the magnet cryostats
Beam vacuum for
Beam 1 + Beam 2
Insulation vacuum for the cryogenic distribution line
Insulation vacuum for the magnet cryostats
Beam vacuum for
Beam 1 + Beam 2
APAC 07, January 2007, Indore, India 54V. Chohan
Beam vacuum for
Beam 1 + Beam 2
quench protection, power converters for orbit correctors and instrumentation (beam, vacuum + cryogenics)
APAC 07, January 2007, Indore, India 55V. Chohan
Inner triplet magnets
APAC 07, January 2007, Indore, India 56V. Chohan
Accelerator magnets issues
In iron dominated magnets the pole shape dictates field qualityIn superconducting magnets the conductor position dictates the accuracy of the field.Coils not self-supportingBeam will circulate 500 Millions times in the LHC ! Field accuracy: 10-100 ppmNecessity to have all dipoles equal in length within ~ 100 ppm (1.5 mm over 15 m of the LHC dipole length !)
Quantity: 1232 dipoles ×15 m = 18.5 km Operated at same current: 154 circuitsExtremely high current density: operation 85% of Ic (on load line), little stabilizer to increase J⇒ Training. BUT we cannot train them at long (it costs too much) and they should not re-training.After the cool down the worst magnet will determine the energy of the accelerator.
LHC main dipoles
Courtesy: L.Rossi
APAC 07, January 2007, Indore, India 57V. Chohan
The historical outlookCourtesy: L.Rossi
APAC 07, January 2007, Indore, India 58V. Chohan
Dipole cross section: yoke & shrinking cylinder
Curvature released from ± 1 to ± 2.5 mm:
Solution: pairing
Two half shells, welded on the magnet
274.90
274.95
275.00
275.05
275.10
Radius averageGrinding Operation
Courtesy: L.Rossi
APAC 07, January 2007, Indore, India 59V. Chohan
Dipole -end partend plateCourtesy: L.Rossi
APAC 07, January 2007, Indore, India 60V. Chohan
Dipole-end part Bus BarsCourtesy: L.Rossi
APAC 07, January 2007, Indore, India 61V. Chohan
Dipole -end partShrinking cyilinderCourtesy: L.Rossi
APAC 07, January 2007, Indore, India 62V. Chohan
Dipole -end partCu HXT Courtesy: L.Rossi
APAC 07, January 2007, Indore, India 63V. Chohan
Dipole -end partCorrector MagnetsCourtesy: L.Rossi
APAC 07, January 2007, Indore, India 64V. Chohan
Dipole -end partCold foot, Bellows and N-line
Courtesy: L.Rossi
APAC 07, January 2007, Indore, India 65V. Chohan