gtc on-demand featured talks | gpu technology...

●●●●●

●○○

●○○

●○○○○

●○

●○

●○

●○

●●●

●○

●○

●

Solution Sandboxing Enforced Supported

CUDA_VISIBLE_DEVICES ✓ ✘ ✓

Solution Sandboxing Enforced Supported

CUDA_VISIBLE_DEVICES ✓ ✘ ✓

Permissions on /dev/nvidia* ✓ ✓ ✘

Solution Sandboxing Enforced Supported

CUDA_VISIBLE_DEVICES ✓ ✘ ✓

Permissions on /dev/nvidia* ✓ ✓ ✘

cgroups ✓ ✓ ✓

(since

Cuda7)

☓

✓

●○○

Application Optimal CPU/GPU

NAMD (2014) ~2.5

NAMD (2016) ~7

Gromacs ~8

Theano ~1

NVbio ~2

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores

Torque’s cpuset Home solution

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 cores

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 cores

Torque’s cpuset Home solution

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 cores

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 cores

Torque’s cpuset Home solution

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2

Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores

Torque’s cpuset Home solution

●

●

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2Torque’s solution

GPU0

GPU1

GPU2

GPU3

0 5

1 6

2 7

3 8

4 9

GPU4

GPU5

GPU6

GPU7

10 15

11 16

12 17

13 18

14 19

Socket #1 Socket #2Custom solution

●

○

●○

●

○○

●○