uk national e-infrastructure survey 2014 - update for hpc-sig may 2014
DESCRIPTION
TRANSCRIPT
2014 UK NationalE-Infrastructure Survey
Jeremy Yates, DiRAC: [email protected] Hamilton, Jisc: [email protected]
Diagram courtesy EPSRC
2014 UK NationalAcademic E-Infrastructure Survey
Jeremy Yates, DiRAC: [email protected] Hamilton, Jisc: [email protected]
Diagram courtesy EPSRC
—Revised and updated version of survey conducted in 2013
—Led by Jeremy Yates, Martin Hamilton, Neil Chue Hong, with input from Alan Real and Oz Parchment
—Probing several additional areas not covered in 2013:—Staffing and workload, budget arrangements—Sharing services / pooling effort
—Responses received from 17 large and specialist facilities, and 35 of the 38 HPC-SIG member institutions
National E-Infrastructure Survey
National E-Infrastructure SurveyFTE allocation breakdown
0 - 250
251 - 500
501- 750
751 - 1000
1001 - 1250
1251 - 1500
1501 - 1750
1751 - 2000
2001- 2250
2251 - 2500
2501 - 2750
2751 - 3000
3001 - 3250
3251 - 3500
3501 - 3750
3751 - 4000
4001 - 5000
5001 - 6000
6001- 7000
7001 - 8000
8001 -15999
17000 - 20000
70000+0
1
2
3
4
5
6
7
8
HEIs Large/Specialist
Total no. of processor cores
0 - 250
251 - 500
501- 750
751 - 1000
1001 - 1250
1251 - 1500
1501 - 1750
1751 - 2000
2001- 2250
2251 - 2500
2501 - 2750
2751 - 3000
3001 - 3250
3251 - 3500
3501 - 3750
3751 - 4000
4001 - 5000
5001 - 6000
6001- 7000
7001 - 8000
8001 -15999
17000 - 20000
70000+0
1
2
3
4
5
6
7
8
HEIs Large/Specialist
Total no. of processor cores
National E-Infrastructure SurveyFTE allocation breakdown
549,190 cores
National E-Infrastructure SurveyFTE allocation breakdown
0 - 10 11 - 20 21 -30 31 - 40 41 - 50 51- 60 61 - 70 71 - 80 81 - 90 91 - 100 101 - 110 101 -1000 1000+0
1
2
3
4
5
6
7
8
9
HEIs Large/Specialist
Theoretical peak performance (Tflops)
National E-Infrastructure SurveyFTE allocation breakdown
0 - 10 11 - 20 21 -30 31 - 40 41 - 50 51- 60 61 - 70 71 - 80 81 - 90 91 - 100 101 - 110 101 -1000 1000+0
1
2
3
4
5
6
7
8
9
HEIs Large/Specialist
Theoretical peak performance (Tflops)
36 Petaflops
National E-Infrastructure SurveyFTE allocation breakdown
0 - 10 11 - 50 51 - 100 101 - 200 201 - 300 301 - 400 401 - 500 501 - 600 601 - 1000
1001 - 2000
2001 - 2048
20000+0
2
4
6
8
10
12
HEIs Large/Specialist
Amount of storage available to users (TB)
National E-Infrastructure SurveyFTE allocation breakdown
0 - 10 11 - 50 51 - 100 101 - 200 201 - 300 301 - 400 401 - 500 501 - 600 601 - 1000
1001 - 2000
2001 - 2048
20000+0
2
4
6
8
10
12
HEIs Large/Specialist
Amount of storage available to users
63PB
National E-Infrastructure SurveyFTE allocation breakdown
0-100 100-500 500-1000 1000+0
2
4
6
8
10
12
14
16
18
20
HEIs Large/Specialist
No. of users
National E-Infrastructure SurveyFTE allocation breakdown
0-100 100-500 500-1000 1000+0
2
4
6
8
10
12
14
16
18
20
HEIs Large/Specialist
No. of users
25,000 users** = some double counting
National E-Infrastructure SurveyFTE allocation breakdown
-30 -20 -10 0 10 20 30 40 50 60 700
1
2
3
4
5
6
HEIs Large/Specialist
No. of months until end of maintenance period
No.
of f
acili
ties
National E-Infrastructure SurveyFTE allocation breakdown
-30 -20 -10 0 10 20 30 40 50 60 700
1
2
3
4
5
6
HEIs Large/Specialist
No. of months until end of maintenance period
No.
of f
acili
ties
National E-Infrastructure SurveyFTE allocation breakdown
-30 -20 -10 0 10 20 30 40 50 60 700
1
2
3
4
5
6
HEIs Large/Specialist
No. of months until end of maintenance period
No.
of f
acili
ties
National E-Infrastructure SurveyFTE allocation breakdown
0
10
20
30
40
50
60
Large/Specialist
National E-Infrastructure SurveyFTE allocation breakdown
0
10
20
30
40
50
60
Large/Specialist
0
2
4
6
8
10
12
14
HEIs
National E-Infrastructure Survey
System Support30%
Software Engineering10%Application Support
19%
User Training9%
Strategic Engagement14%
Project Management10%
Other User Support7%
FTE allocation breakdown
External Centrally Distributed Dept/research centre
0
2
4
6
8
10
12
14
16
18
20
Where are staff based?
HEIsLarge/Specialist
National E-Infrastructure SurveyFTE allocation breakdown
0 0.5 1 1.5 2 2.5 3 3.50
1
2
3
4
5
6
System Support
FTE count
No
of re
spon
dent
s
0 0.5 1 1.5 2 2.5 3 3.502468
101214
Software Engineering
FTE count
No
of re
spon
dent
s
0 0.5 1 1.5 2 2.5 3 3.5 4 4.5012345678
Application Support
FTE count
No
of re
spon
dent
s
0 0.2 0.4 0.6 0.8 1 1.20
2
4
6
8
10
User Training
FTE count
No
of re
spon
dent
s
National E-Infrastructure SurveyFTE allocation breakdown
0 0.5 1 1.5 2 2.5 3 3.50
1
2
3
4
5
6
System Support
FTE count
No
of re
spon
dent
s
0 0.5 1 1.5 2 2.5 3 3.502468
101214
Software Engineering
FTE count
No
of re
spon
dent
s
0 0.5 1 1.5 2 2.5 3 3.5 4 4.5012345678
Application Support
FTE count
No
of re
spon
dent
s
0 0.2 0.4 0.6 0.8 1 1.20
2
4
6
8
10
User Training
FTE count
No
of re
spon
dent
s0 0.5 1 1.5 2 2.5 30123456789
10
Strategic Engagement
FTE count
No
of re
spon
dent
s
National E-Infrastructure SurveyFTE allocation breakdown
System Support
Yes No Under development0
5
10
15
20
25
30
35
40
Do you offer your own training courses?
Yes No Under Development0
5
10
15
20
25
30
35
40
Do you develop your own training materials?
National E-Infrastructure SurveyFTE allocation breakdown
System Support
Yes No Under development0
5
10
15
20
25
30
35
40
Do you offer your own training courses?
Yes No Under Development0
5
10
15
20
25
30
35
40
Do you develop your own training materials?
Already engaged No Yes0
5
10
15
20
25
30
35
Interest in shared pool of training and/or training resources?
FTE allocation breakdownSystem Support
http://etraining.esc.rl.ac.uk
<=25% 25% to 50% 50% to 75% >75%0
2
4
6
8
10
12
What proportion of your users are in self-supporting groups?
AllLargeHEI
National E-Infrastructure Survey
<=25% 25% to 50% 50% to 75% >75%0
2
4
6
8
10
12
What proportion of your users are in self-supporting groups?
AllLargeHEI
Documen
tation
Intro to
progra
mming
Linux o
rientati
on
On-boarding t
raining
Sample
scripts
etc
Sched
uler basi
cs
Targe
tted ad
vice
0
5
10
15
20
25
Help required by new users
National E-Infrastructure Survey
—Initial results received by RCUK National E-Infrastructure group— Informing roadmap for E-Infrastructure investments
—Further analysis and recommendations under development, e.g.—Critical role of HEIs in the national E-Infrastructure—Institutional funding uncertainties, staffing issues—How might we make better use of resources?—What does a well founded Research Computing team look like?—Common technical and procedural approaches, e.g. AAAI—Bring Your Own Workflow and lowering the barrier of entry
—Comments and queries?
National E-Infrastructure Survey
2014 UK NationalE-Infrastructure Survey
Jeremy Yates, DiRAC: [email protected] Hamilton, Jisc: [email protected]
Diagram courtesy EPSRC