graphics driver quality - amd.com€¦ · graphics driver quality july 11, 2018 iii report...

Graphics Driver Quality Determination of Stability from Leading Market Vendors

Prepared By QA Consultants

North American Centre

5700 Yonge Street, 14th Floor

Toronto, Ontario, M2M 4K2

Date July 11th, 2018

Graphics Driver Quality

July 11, 2018

ii

Table of Contents

Executive Summary ................................................................................................................... 1

1.0 Overview and Test Selection ................................................................................................ 2

2.0 System Configuration ........................................................................................................... 2

3.0 Methodology ........................................................................................................................ 4

3.1 Test Deployment ..................................................................................................................................................... 5

4.0 Results Overview .................................................................................................................. 6

5.0 Daily Iteration Results ......................................................................................................... 6

6.0 Detailed Results ................................................................................................................. 13

7.0 GPU Results Breakdown .................................................................................................. 110

7.1 Radeon RX 560 .................................................................................................................................................... 110

7.2 Radeon RX 580 – 8GB ....................................................................................................................................... 111

7.3 Radeon Vega RX 64 ............................................................................................................................................ 112

7.4 Radeon Pro WX 3100 ......................................................................................................................................... 113

7.5 Radeon Pro WX 7100 ......................................................................................................................................... 114

7.6 Radeon Pro WX 9100 ......................................................................................................................................... 115

7.7 GeForce GTX 1050 – 2 GB .............................................................................................................................. 116

7.8 GeForce GTX 1060 – 6 GB .............................................................................................................................. 117

7.9 GeForce GTX 1080 Ti ....................................................................................................................................... 118

7.10 Quadro P600 ...................................................................................................................................................... 119

7.11 Quadro P4000 .................................................................................................................................................... 120

7.12 Quadro P5000 .................................................................................................................................................... 121

8.0 Conclusion ....................................................................................................................... 122


July 11, 2018

iii

Report Verification

This is to certify that QA Consultants confirms the results in the Graphics Driver Quality report to

be true.

Validated By: Arthur Forzon

Date: July 11th, 2018

Signature

About QA Consultants

QA Consultants is an award-winning provider of software testing and quality assurance solutions. We

are the trusted testing company for businesses, government departments and institutions. Over the

last 20 years we have successfully delivered 5,000+ mission-critical projects in the private, public and

not-for-profit sectors. Within those sectors, QA Consultants has extensive testing experience and

depth in the following industries: automotive, banking, consumer goods, product design, insurance,

media and entertainment, public affairs, retail, technology, and travel and tourism.

https://qaconsultants.com/

https://qaconsultants.com/


July 11, 2018

1

Executive Summary

In May 2018, AMD commissioned QA Consultants to independently evaluate the stability of several

of the latest graphics drivers from both AMD and NVIDIA. A pool of 6 AMD and 6 NVIDIA

graphics accelerators were subjected to 12 days of 24-hour stress testing using CRASH from

Microsoft’s Windows Hardware Lab Kit (HLK). Gaming and Workstation products from both

graphics vendors were equally represented. The aggregate of AMD products passed 93% of scheduled

tests whereas the aggregate of NVIDIA products passed 82% of scheduled tests (See Figure 1).

Figure 1. GPU Market Vendor Stability


July 11, 2018

2

1.0 Overview and Test Selection

We define graphics driver stability as a resistance to Blue Screens (BSODs), application crashes, hangs,

and otherwise unexpected behavior in the presence of stressful test vectors over a period of time. We

used Microsoft’s Windows HLK as a source of graphics test vectors. Windows HLK is a test

framework designed to help hardware manufacturers deliver a quality product to users running

Windows operating systems.

Within Windows HLK, we used the 64-bit variant of CRASH to stress the Graphics Processing Unit

(GPU). CRASH is a GPU stress test tool that spans 4 hours in length and captures test cases covering

S3, display resolution changes, display orientation changes, content protection, and rendering.

While 4 hours of stress testing is a good indicator of prominent quality issues, it does not suffice in

capturing intermittent stability failures or glitches. Therefore, we ran this test back-to-back around the

clock for 12 days for each GPU. This accounts for 288 hours of non-stop stress in a test designed to

make the GPU driver fail.

2.0 System Configuration

12 of the latest GPUs from both AMD and NVIDIA were sampled. Care was taken to ensure

representation from entry-level, mid-range, and high-end products was available. Both gaming and

workstation parts were selected from both vendors.

Platforms were selected to be representative of mid-tier offerings. An Intel Core i5 was paired to 16

GB of system memory for all configurations. All systems had identical BIOS settings.

To reduce the chance of system bias skewing the results towards one vendor, mid-way through testing,

at iteration 7/12, we swapped the AMD and NVIDIA GPUs in their respective systems before

continuing testing. Windows 10 April 2018 Update (build 1803) was selected as the operating system

for all 12 platforms.

The latest certified/recommended graphics drivers as of mid-May 2018 were used for both vendors.

Driver pairings with Windows 10 April 2018 Update were compliant with Microsoft’s HLK

submission criteria here:

https://blogs.msdn.microsoft.com/windows_hardware_certification/2018/04/27/accepting-

windows-10-version-1803-submissions/

See Table 1 for complete details for system hardware and software.

https://blogs.msdn.microsoft.com/windows_hardware_certification/2018/04/27/accepting-windows-10-version-1803-submissions/

https://blogs.msdn.microsoft.com/windows_hardware_certification/2018/04/27/accepting-windows-10-version-1803-submissions/


July 11, 2018

3

Gaming Workstation

Client Operating System Microsoft Windows® 10 April 2018 Update

AMD Graphics Hardware Radeon™ Vega RX 64

Radeon™ RX 580 8GB

Radeon™ RX 560

Radeon™ Pro WX 9100



AMD Driver Radeon™ Software Adrenalin

Edition 18.5.1

Radeon™ Pro Software

Enterprise Edition 18.Q2

NVIDIA Graphics

Hardware

GeForce® GTX 1080 Ti

GeForce® GTX 1060 – 6 GB

GeForce® GTX 1050 – 2 GB

Quadro® P5000

Quadro® P4000

Quadro® P600

NVIDIA Driver GeForce® Game Ready Driver

397.64

Quadro® Desktop 391.58

System Configuration

(Whitebox)

Intel® Core™ i5 8400 CPU

MSI Z370-A PRO Motherboard

ADATA XPG Z1 16 GB DDR4 RAM

Corsair CX Series CX750 PSU

Samsung 860 EVO 250GB SSD

Display HP Z24x @ 1920 x 1200

Display Port or mini-Display Port connections were used

Table 1. System Configuration Breakdown for Gaming and Workstation Platforms


July 11, 2018

4

3.0 Methodology

There were 432 tests scheduled for each vendor. This represents 12 iterations of 6 executions of

CRASH (a 4 hour test) per GPU, across 6 GPUs. (See Table 3)

12 Day CRASH Test Schedule

Day 1 2 3 4 5 6 7 8 9 10 11 12 TOTAL

# of AMD

Tests

(6 per GPU)

36 36 36 36 36 36 36 36 36 36 36 36 432

# of NVIDIA

Tests

(6 per GPU)

36 36 36 36 36 36 36 36 36 36 36 36 432

Table 3. Test schedule breakdown across 12-iteration run.

Testing was broken down into 12 iterations, where each iteration is a 24-hour period. Testing was

scheduled 1 iteration at a time, with 6 CRASH executions assigned to each GPU at a time. (See Table

4)

Daily Iteration Per-GPU Test Schedule

CRASH

TEST 1 2 3 4 5 6

TOTAL TESTS

PER GPU PER

DAY

TOTAL HOURS

PER GPU PER

DAY

Time

(Hours) 0-4 4-8 8-12 12-16 16-20 20-24 6 24

Table 4. Test schedule breakdown across 1 iteration run.

At the end of each 24-hour iteration, public Microsoft HLK filters were applied to the results. The

results were then noted, and a new iteration of tests was scheduled.


July 11, 2018

5

3.1 Test Deployment

Tests were deployed to all 12 machines in parallel via an HLK Controller. The HLK Controller was

configured with Windows Server 2012 R2 and ran HLK version 1803.

Windows HLK Client was installed on all 12 test machines. These test machines were then managed

by Windows HLK Studio on the HLK Controller.

All 12 test machines and the HLK Controller were maintained on an isolated network. A DHCP

server was instantiated on the HLK Controller, and all machines were connected via a network switch.

The configured environment used a workgroup.


July 11, 2018

6

4.0 Results Overview

The below table aggregates results for all AMD products and all NVIDIA products (See Table 4).

Failures represent crashes caught by Windows HLK and system hangs.

Tests Scheduled Failures

(Crash or Hang)

Pass Rate

(Pass/Scheduled)

AMD 432 31 92.8%

NVIDIA 432 76 82.4%

Table 4. Pass rate breakdown for AMD and NVIDIA across 12 days of testing.

5.0 Daily Iteration Results

The below tables show all 72 test results for each ASIC. Each column represents 1 24-hour iteration

of testing. After each 24-hour iteration, testing was restarted with 6 newly-queued CRASH instances.

If a hang was observed during a CRASH run, that instance was counted as a FAIL. (See Table 5 –

16)

Table 5. Test result breakdown for day 1 of testing.

Day 1

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Pass Pass Pass Fail Pass Fail Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Fail

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass



July 11, 2018

7



Day 2

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Fail Pass Not Attempted

(Due to hang) Pass Pass Pass Not Attempted

(Due to hang) Pass Pass

Pass Pass Pass Pass Fail Not Attempted



Pass Pass Pass Pass Pass Fail Pass Pass Pass Not Attempted


Pass Pass Pass Pass Pass Pass Pass Pass Pass Not Attempted




Pass Pass Fail Pass Pass Pass Pass Pass Pass Fail Pass Pass

Day 3

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000





Pass Pass Pass Pass Fail Pass Pass Pass Pass Not Attempted




Pass Pass Pass Pass Pass Pass Pass Fail Pass Not Attempted


Pass Pass Pass Pass Pass Pass Pass Pass Pass Fail Pass Pass


July 11, 2018

8



Day 4

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Not Attempted


(Due to hang) Pass Fail Pass Not Attempted

(Due to hang)




(Due to hang)




(Due to hang)

Pass Pass Pass Fail Pass Pass Pass Not Attempted

(Due to hang) Pass Pass Pass Fail

Pass Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang) Pass Pass Pass Pass

Pass Pass Pass Pass Pass Pass Pass Fail Pass Fail Pass Pass

Day 5

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Pass Pass Fail Pass Pass Fail Not Attempted

(Due to hang) Fail Pass

Pass Pass Pass Fail Pass Pass Pass Pass Pass Not Attempted





Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass Fail Pass



July 11, 2018

9



Day 6

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Pass Fail Pass Pass Pass Pass Pass Pass Pass

Pass Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass

Pass Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass



Pass Pass Pass Pass Pass Pass Pass Pass Pass Fail Fail Pass

Day 7

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang) Not Attempted

(Due to hang)

Pass Pass Pass Pass Pass Pass Pass Fail Pass Pass Not Attempted


(Due to hang)

Pass Pass Pass Pass Pass Pass Pass Pass Pass Fail Fail Not Attempted

(Due to hang)





July 11, 2018

10



Day 8

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000





Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass Pass Pass


Day 9

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000


(Due to hang) Pass Pass Pass Pass Pass Pass Pass Fail


(Due to hang) Pass Pass Pass Pass Pass Pass Pass Pass



Pass Fail Pass Fail Pass Pass Pass Pass Pass Pass Pass Pass


Pass Pass Fail Pass Pass Pass Pass Pass Pass Pass Pass Pass


July 11, 2018

11



Day 10

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000



Pass Pass Pass Fail Pass Pass Fail Pass Pass Pass Pass Pass

Pass Pass Pass Pass Pass Pass Pass Pass Fail Fail Pass Pass



Day 11

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Pass Pass Pass Pass Pass Not Attempted

(Due to hang) Pass Pass Pass Fail Pass Pass

Pass Pass Pass Fail Pass Not Attempted

(Due to hang) Pass Pass Pass Pass Fail Pass






July 11, 2018

12


Day 12

Radeon™

RX 560 –

2GB

Radeon™

RX 580 –

8GB

Radeon™

Vega RX

64

Radeon™

Pro WX

3100

Radeon™

Pro WX

7100

Radeon™

Pro WX

9100

GeForce®

GTX

1050

GeForce®

GTX

1060 –

6GB

GeForce®

GTX

1080 Ti

Quadro®

P600

Quadro®

P4000

Quadro®

P5000

Fail Pass Pass Fail Pass Pass Pass Pass Pass Not Attempted



(Due to hang)




(Due to hang)



(Due to hang) Fail



(Due to hang) Pass


(Due to hang) Fail Pass



July 11, 2018

13

6.0 Detailed Results

The below list of 864 individual CRASH tests captures the results across all tested GPUs over a 12

day period. These are broken down per 24-hour iteration.

Test # Platform Configuration Result

1

Microsoft Windows 10 April 2018 Update, Intel Core i5 8400, MSI Z370-

A PRO, Radeon RX 560, ADATA XPG Z1 16 GB DDR4, Corsair CX

Series CX750, Samsung 860 EVO 250GB, HP Z24x @ 1920 x 1200,

Radeon Software Adrenalin Edition 18.5.1

Passed

2





Passed

3





Passed

4





Passed

5





Passed

6





Passed

7





Passed

8





Passed


July 11, 2018

14


9





Passed

10





Passed

11





Passed

12





Passed

13





Passed

14





Passed

15





Passed

16





Passed

17





Passed


July 11, 2018

15


18





Passed

19





Passed

20





Passed

21





Passed

22





Passed

23





Passed

24





Passed

25





Passed

26





Passed


July 11, 2018

16


27





Passed

28





Passed

29





Passed

30





Passed

31





Passed

32





Passed

33





Passed

34





Passed

35





Passed


July 11, 2018

17


36





Passed

37





Passed

38





Passed

39





Passed

40





Passed

41





Passed

42





Passed

43





Passed

44





Passed


July 11, 2018

18


45





Passed

46





Passed

47





Passed

48





Passed

49





Passed

50





Passed

51





Passed

52





Passed

53





Passed


July 11, 2018

19


54





Passed

55





Passed

56





Passed

57





Passed

58





Passed

59





Passed

60





Passed

61





Passed

62





Passed


July 11, 2018

20


63





Passed

64





Passed

65





Passed

66





Passed

67





Passed

68





Passed

69





Passed

70





Passed

71





Passed


July 11, 2018

21


72





FAIL

73





Passed

74





Passed

75





Passed

76





Passed

77





Passed

78





Passed

79





Passed

80





Passed


July 11, 2018

22


81





Passed

82





Passed

83





Passed

84





Passed

85





Passed

86





Passed

87





Passed

88





Passed

89





Passed


July 11, 2018

23


90





Passed

91





Passed

92





Passed

93





Passed

94





Passed

95





Passed

96





Passed

97





Passed

98





Passed


July 11, 2018

24


99





Passed

100





Passed

101





Passed

102





Passed

103





Passed

104





Passed

105





Passed

106





Passed

107





Passed


July 11, 2018

25


108





Passed

109





Passed

110





Passed

111





Passed

112





Passed

113





Passed

114





Passed

115





Passed

116





Passed


July 11, 2018

26


117





Passed

118





Passed

119





Passed

120





Passed

121





Passed

122





Passed

123





FAIL

124





Passed

125





Passed


July 11, 2018

27


126





Passed

127





Passed

128





Passed

129





Passed

130





Passed

131





Passed

132





Passed

133





Passed

134





Passed


July 11, 2018

28


135





Passed

136





Passed

137





Passed

138





Passed

139





Passed

140





Passed

141





Passed

142





Passed

143





Passed


July 11, 2018

29


144





Passed

145


A PRO, Radeon Vega RX 64, ADATA XPG Z1 16 GB DDR4, Corsair

CX Series CX750, Samsung 860 EVO 250GB, HP Z24x @ 1920 x 1200,


Passed

146





Passed

147





Passed

148





Passed

149





Passed

150





Passed

151





FAIL

152





Passed


July 11, 2018

30


153





Passed

154





Passed

155





Passed

156





Passed

157





Passed

158





Passed

159





Passed

160





Passed

161





Passed


July 11, 2018

31


162





Passed

163





Passed

164





Passed

165





Passed

166





Passed

167





Passed

168





Passed

169





Passed

170





Passed


July 11, 2018

32


171





Passed

172





Passed

173





Passed

174





Passed

175





Passed

176





Passed

177





Passed

178





Passed

179





Passed


July 11, 2018

33


180





Passed

181





Passed

182





Passed

183





Passed

184





Passed

185





Passed

186





Passed

187





Passed

188





Passed


July 11, 2018

34


189





Passed

190





Passed

191





Passed

192





Passed

193





FAIL

194





Passed

195





Passed

196





Passed

197





Passed


July 11, 2018

35


198





Passed

199





Passed

200





Passed

201





Passed

202





Passed

203





Passed

204





Passed

205





Passed

206





Passed


July 11, 2018

36


207





Passed

208





Passed

209





Passed

210





Passed

211





Passed

212





Passed

213





Passed

214





Passed

215





Passed


July 11, 2018

37


216





Passed

217


A PRO, Radeon Pro WX 3100, ADATA XPG Z1 16 GB DDR4, Corsair


Radeon Pro Software Enterprise Edition 18.Q2

Passed

218





Passed

219





Passed

220





Passed

221





Passed

222





Passed

223





Passed

224





Passed


July 11, 2018

38


225





Passed

226





Passed

227





Passed

228





FAIL

229





Passed

230





Passed

231





Passed

232





Passed

233





Passed


July 11, 2018

39


234





Passed

235





Passed

236





Passed

237





FAIL

238





Not

Attempted

(due to hang)

239





Not

Attempted

(due to hang)

240





Not

Attempted

(due to hang)

241





Passed

242





Passed


July 11, 2018

40


243





Passed

244





Passed

245





FAIL

246





Passed

247





Passed

248





Passed

249





Passed

250





Passed

251





Passed


July 11, 2018

41


252





Passed

253





Passed

254





Passed

255





Passed

256





Passed

257





Passed

258





Passed

259





Passed

260





Passed


July 11, 2018

42


261





Passed

262





Passed

263





Passed

264





Passed

265





Passed

266





Passed

267





FAIL

268





Not

Attempted

(due to hang)

269





Not

Attempted

(due to hang)


July 11, 2018

43


270





Not

Attempted

(due to hang)

271





Passed

272





Passed

273





Passed

274





FAIL

275





Passed

276





Passed

277





Passed

278





Passed


July 11, 2018

44


279





Passed

280





Passed

281





FAIL

282





Passed

283





Passed

284





Passed

285





Passed

286





Passed

287





Passed


July 11, 2018

45


288





FAIL

289





Passed

290





Passed

291





Passed

292





Passed

293





FAIL

294





Passed

295





Passed

296





Passed


July 11, 2018

46


297





Passed

298





Passed

299





FAIL

300





Passed

301





Passed

302





Passed

303





Passed

304





FAIL

305





Passed


July 11, 2018

47


306





Passed

307





Passed

308





Passed

309





Passed

310





Passed

311





Passed

312





Passed

313





Passed

314





Passed


July 11, 2018

48


315





Passed

316





Passed

317





Passed

318





Passed

319





Passed

320





Passed

321





Passed

322





Passed

323





Passed


July 11, 2018

49


324





FAIL

325





Passed

326





Passed

327





Passed

328





Passed

329





Passed

330





Passed

331





Passed

332





Passed


July 11, 2018

50


333





Passed

334





Passed

335





FAIL

336





Passed

337





Passed

338





Passed

339





Passed

340





Passed

341





Passed


July 11, 2018

51


342





Passed

343





Passed

344





Passed

345





Passed

346





Passed

347





Passed

348





Passed

349





Passed

350





Passed


July 11, 2018

52


351





Passed

352





Passed

353





Passed

354





Passed

355





Passed

356





Passed

357





Passed

358





Passed

359





Passed


July 11, 2018

53


360





Passed

361





Passed

362





Passed

363





Passed

364





Passed

365





Passed

366





Passed

367





Passed

368





Passed


July 11, 2018

54


369





Passed

370





FAIL

371





Not

Attempted

(due to hang)

372





Not

Attempted

(due to hang)

373





Passed

374





Passed

375





Passed

376





Passed

377





Passed


July 11, 2018

55


378





Passed

379





Passed

380





Passed

381





Passed

382





Passed

383





Passed

384





Passed

385





Passed

386





FAIL


July 11, 2018

56


387





Passed

388





Passed

389





Passed

390





FAIL

391





Passed

392





Passed

393





Passed

394





Passed

395





Passed


July 11, 2018

57


396





Passed

397





Passed

398





Passed

399





Passed

400





Passed

401





Passed

402





Passed

403





Passed

404





FAIL


July 11, 2018

58


405





Passed

406





Passed

407





Passed

408





Passed

409





Passed

410





Passed

411





Passed

412





Passed

413





Passed


July 11, 2018

59


414





Passed

415





Passed

416





Passed

417





Passed

418





Passed

419





Passed

420





Passed

421





Passed

422





Passed


July 11, 2018

60


423





Passed

424





FAIL

425





Not

Attempted

(due to hang)

426





Not

Attempted

(due to hang)

427





Passed

428





Passed

429





Passed

430





Passed

431





Passed


July 11, 2018

61


432





Passed

433

Microsoft Windows 10 April 2018 Update, Intel Corei5 8400, MSI Z370-

A PRO, GeForce GTX 1050, ADATA XPG Z1 16 GB DDR4, Corsair


GeForce Game Ready Driver 397.64

Passed

434





Passed

435





Passed

436





Passed

437





Passed

438





Passed

439





FAIL

440





Not

Attempted

(due to hang)


July 11, 2018

62


441





Not

Attempted

(due to hang)

442





Not

Attempted

(due to hang)

443





Not

Attempted

(due to hang)

444





Not

Attempted

(due to hang)

445





FAIL

446





Not

Attempted

(due to hang)

447





Not

Attempted

(due to hang)

448





Not

Attempted

(due to hang)

449





Not

Attempted

(due to hang)


July 11, 2018

63


450





Not

Attempted

(due to hang)

451





FAIL

452





Passed

453





Passed

454





Passed

455





Passed

456





FAIL

457





Passed

458





Passed


July 11, 2018

64


459





FAIL

460





Not

Attempted

(due to hang)

461





Not

Attempted

(due to hang)

462





Not

Attempted

(due to hang)

463





FAIL

464





Passed

465





Passed

466





Passed

467





Passed


July 11, 2018

65


468





Passed

469





Passed

470





FAIL

471





Passed

472





FAIL

473





Passed

474





Passed

475





Passed

476





Passed


July 11, 2018

66


477





Passed

478





Passed

479





Passed

480





FAIL

481





Passed

482





Passed

483





Passed

484





Passed

485





Passed


July 11, 2018

67


486





Passed

487





Passed

488





Passed

489





FAIL

490





Passed

491





Passed

492





Passed

493





Passed

494





Passed


July 11, 2018

68


495





FAIL

496





Passed

497





Passed

498





FAIL

499





FAIL

500





Not

Attempted

(due to hang)

501





Not

Attempted

(due to hang)

502





Not

Attempted

(due to hang)

503





Not

Attempted

(due to hang)


July 11, 2018

69


504





Not

Attempted

(due to hang)

505





Passed

506





Passed

507





Passed

508





Passed

509





Passed

510





Passed

511





Passed

512





Passed


July 11, 2018

70


513





Passed

514





Passed

515





Passed

516





Passed

517





Passed

518





Passed

519





Passed

520





Passed

521





Passed


July 11, 2018

71


522





Passed

523





Passed

524





Passed

525





Passed

526





Passed

527





Passed

528





Passed

529





Passed

530





FAIL


July 11, 2018

72


531





Passed

532





Passed

533





Passed

534





FAIL

535





FAIL

536





Passed

537





Passed

538





Passed

539





Passed


July 11, 2018

73


540





Passed

541





Passed

542





Passed

543





Passed

544





FAIL

545





Not

Attempted

(due to hang)

546





Not

Attempted

(due to hang)

547





Passed

548





Passed


July 11, 2018

74


549





Passed

550





Passed

551





Passed

552





Passed

553





Passed

554





Passed

555





Passed

556





Passed

557





Passed


July 11, 2018

75


558





Passed

559





Passed

560





Passed

561





Passed

562





Passed

563





Passed

564





Passed

565





Passed

566





Passed


July 11, 2018

76


567





Passed

568





Passed

569





FAIL

570





Passed

571





Passed

572





FAIL

573





Not

Attempted

(due to hang)

574





Not

Attempted

(due to hang)

575





Not

Attempted

(due to hang)


July 11, 2018

77


576





Not

Attempted

(due to hang)

577


A PRO, GeForce GTX 1080 Ti, ADATA XPG Z1 16 GB DDR4,

Corsair CX Series CX750, Samsung 860 EVO 250GB, HP Z24x @ 1920

x 1200, GeForce Game Ready Driver 397.64

Passed

578





Passed

579





FAIL

580





Not

Attempted

(due to hang)

581





Not

Attempted

(due to hang)

582





Not

Attempted

(due to hang)

583





Passed

584





Passed


July 11, 2018

78


585





Passed

586





Passed

587





Passed

588





Passed

589





Passed

590





Passed

591





Passed

592





Passed

593





Passed


July 11, 2018

79


594





Passed

595





Passed

596





Passed

597





FAIL

598





Not

Attempted

(due to hang)

599





Not

Attempted

(due to hang)

600





Not

Attempted

(due to hang)

601





Passed

602





Passed


July 11, 2018

80


603





Passed

604





Passed

605





Passed

606





Passed

607





Passed

608





FAIL

609





Passed

610





Passed

611





Passed


July 11, 2018

81


612





Passed

613





FAIL

614





Passed

615





FAIL

616





Not

Attempted

(due to hang)

617





Not

Attempted

(due to hang)

618





Not

Attempted

(due to hang)

619





Passed

620





Passed


July 11, 2018

82


621





Passed

622





Passed

623





Passed

624





Passed

625





Passed

626





Passed

627





Passed

628





Passed

629





Passed


July 11, 2018

83


630





FAIL

631





Passed

632





Passed

633





Passed

634





Passed

635





Passed

636





Passed

637





Passed

638





Passed


July 11, 2018

84


639





Passed

640





Passed

641





Passed

642





Passed

643





Passed

644





Passed

645





Passed

646





FAIL

647





Not

Attempted

(due to hang)


July 11, 2018

85


648





Not

Attempted

(due to hang)

649


A PRO, Quadro P600, ADATA XPG Z1 16 GB DDR4, Corsair CX


Quadro Desktop 391.58

Passed

650





Passed

651





Passed

652





FAIL

653





FAIL

654





Passed

655





Passed

656





Passed


July 11, 2018

86


657





Passed

658





Passed

659





Passed

660





Passed

661





Passed

662





Passed

663





Passed

664





Passed

665





Passed


July 11, 2018

87


666





Passed

667





Passed

668





Passed

669





Passed

670





Passed

671





Passed

672





Passed

673





Passed

674





Passed


July 11, 2018

88


675





Passed

676





Passed

677





Passed

678





Passed

679





Passed

680





Passed

681





Passed

682





Passed

683





Passed


July 11, 2018

89


684





Passed

685





Passed

686





Passed

687





Passed

688





Passed

689





Passed

690





Passed

691





Passed

692





Passed


July 11, 2018

90


693





Passed

694





Passed

695





Passed

696





Passed

697





Passed

698





Passed

699





Passed

700





Passed

701





Passed


July 11, 2018

91


702





Passed

703





Passed

704





Passed

705





Passed

706





FAIL

707





Passed

708





Passed

709





Passed

710





Passed


July 11, 2018

92


711





Passed

712





Passed

713





Passed

714





Passed

715





Passed

716





Passed

717





Passed

718





Passed

719





Passed


July 11, 2018

93


720





Passed

721





Passed

722





Passed

723





Passed

724





Passed

725





Passed

726





Passed

727





Passed

728





Passed


July 11, 2018

94


729





Passed

730





Passed

731





Passed

732





Passed

733





Passed

734





FAIL

735





Passed

736





Passed

737





Passed


July 11, 2018

95


738





Passed

739





FAIL

740





Not

Attempted

(due to hang)

741





Not

Attempted

(due to hang)

742





Not

Attempted

(due to hang)

743





Not

Attempted

(due to hang)

744





Not

Attempted

(due to hang)

745





Passed

746





Passed


July 11, 2018

96


747





Passed

748





Passed

749





Passed

750





Passed

751





Passed

752





Passed

753





Passed

754





FAIL

755





FAIL


July 11, 2018

97


756





Passed

757





Passed

758





Passed

759





Passed

760





Passed

761





FAIL

762





Passed

763





Passed

764





Passed


July 11, 2018

98


765





Passed

766





Passed

767





Passed

768





Passed

769





Passed

770





Passed

771





Passed

772





Passed

773





Passed


July 11, 2018

99


774





Passed

775





Passed

776





Passed

777





Passed

778





Passed

779





Passed

780





Passed

781





Passed

782





Passed


July 11, 2018

100


783





Passed

784





Passed

785





Passed

786





Passed

787





Passed

788





Passed

789





Passed

790





Passed

791





Passed


July 11, 2018

101


792





Passed

793





Passed

794





Passed

795





Passed

796





Passed

797





Passed

798





Passed

799





Passed

800





Passed


July 11, 2018

102


801





Passed

802





Passed

803





Passed

804





Passed

805





Passed

806





Passed

807





Passed

808





Passed

809





Passed


July 11, 2018

103


810





Passed

811





Passed

812





Passed

813





Passed

814





Passed

815





Passed

816





Passed

817





Passed

818





Passed


July 11, 2018

104


819





Passed

820





Passed

821





Passed

822





Passed

823





Passed

824





Passed

825





Passed

826





Passed

827





Passed


July 11, 2018

105


828





Passed

829





Passed

830





Passed

831





Passed

832





Passed

833





Passed

834





Passed

835





Passed

836





Passed


July 11, 2018

106


837





Passed

838





Passed

839





Passed

840





Passed

841





Passed

842





Passed

843





Passed

844





Passed

845





Passed


July 11, 2018

107


846





Passed

847





Passed

848





Passed

849





FAIL

850





Passed

851





Passed

852





Passed

853





Passed

854





Passed


July 11, 2018

108


855





Passed

856





Passed

857





Passed

858





Passed

859





Passed

860





Passed

861





Passed

862





Passed

863





Passed


July 11, 2018

109


864





Passed

Table 17. Detailed results for individual CRASH tests


July 11, 2018

110

7.0 GPU Results Breakdown

This section details the day to the day CRASH test results of all 12 GPUs from both vendors.

7.1 Radeon RX 560

Table 18. GPU Specifications for Radeon RX 560

Table 19. 12 Day CRASH results for Radeon RX 560

Radeon RX 560

Memory

Size 4 GB

Memory Type GDDR5

Bandwidth 112 GB/s

Software API Support

DirectX 12

OpenCL 2.0

OpenGL 4.5

Vulkan 1.0

Power Requirements 80 W

Display Outputs 1x DisplayPort 1.4, 1x HDMI 2.0b, 1x Dual Link-DVI

Stream Processors 1024

12 Day CRASH Results

1 2 3 4 5 6 7 8 9 10 11 12








July 11, 2018

111

7.2 Radeon RX 580 – 8GB

Table 20. GPU Specifications for Radeon RX 580

Table 21. 12 Day CRASH results for Radeon RX 580

Radeon RX 580

Memory

Size 8 GB

Memory Type GDDR5

Bandwidth 256 GB/s


DirectX 12

OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 3x DisplayPort 1.4, 1x HDMI 2.0b



1 2 3 4 5 6 7 8 9 10 11 12




Pass Pass Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass




July 11, 2018

112

7.3 Radeon Vega RX 64

Table 22. GPU Specifications for Radeon RX Vega 64

Table 23. 12 Day CRASH results for Radeon RX Vega 64

Radeon RX Vega 64

Memory

Size 8 GB

Memory Type HBM2

Bandwidth 483.8 GB/s


DirectX 12.0

OpenCL 2.0

OpenGL 4.5

Vulkan 1.0





1 2 3 4 5 6 7 8 9 10 11 12






Pass Fail Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass


July 11, 2018

113

7.4 Radeon Pro WX 3100

Table 24. GPU Specifications for Radeon Pro WX 3100

Table 25. 12 Day CRASH results for Radeon Pro WX 3100

Radeon Pro WX 3100

Memory

Size 4 GB

Memory Type GDDR5

Bandwidth 96 GB/s

ECC No


DirectX 12.0 (feature level 12_0)

OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 1x DisplayPort 1.4, 2x Mini-DisplayPort 1.4



1 2 3 4 5 6 7 8 9 10 11 12

Pass Fail Pass Not Attempted

(Due to hang) Pass Pass Pass Pass Not Attempted

(Due to hang) Pass Pass Fail


(Due to hang) Fail Pass Pass Pass Not Attempted

(Due to hang) Pass Fail Pass



(Due to hang) Fail Pass Pass

Pass Pass Pass Fail Pass Pass Pass Pass Fail Pass Pass Pass




July 11, 2018

114




Radeon Pro WX 7100

Memory

Size 8 GB

Memory Type GDDR5

Bandwidth 224 GB/s

ECC No



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 4x DisplayPort 1.4



1 2 3 4 5 6 7 8 9 10 11 12


Fail Fail Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass

Pass Pass Fail Pass Pass Pass Pass Pass Pass Pass Pass Pass





July 11, 2018

115


Radeon Pro WX 9100

Memory

Size 16 GB

Memory Type HBM2

Bandwidth 484 GB/s

ECC Yes



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 6x Mini-DisplayPort 1.4





1 2 3 4 5 6 7 8 9 10 11 12

Pass Not Attempted

(Due to hang) Pass Pass Fail Pass Pass Pass Pass Pass

Not Attempted

(Due to hang) Pass

Pass Not Attempted

(Due to hang) Pass Pass Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang) Pass

Pass Fail Pass Pass Pass Pass Pass Pass Pass Pass Fail Pass


Pass Pass Pass Pass Fail Pass Pass Fail Pass Pass Pass Pass



July 11, 2018

116

7.7 GeForce GTX 1050 – 2 GB

GeForce GTX 1050

Memory

Size 2 GB

Memory Type DDR5

Bandwidth 112 GB/s



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0



CUDA Cores 640

Table 30. GPU Specifications for GeForce GTX 1050

Table 31. 12 Day CRASH results for GeForce GTX 1050


1 2 3 4 5 6 7 8 9 10 11 12


Fail Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass

Fail Pass Pass Pass Pass Pass Pass Pass Pass Fail Pass Pass





July 11, 2018

117

7.8 GeForce GTX 1060 – 6 GB

GeForce GTX 1060

Memory

Size 6 GB

Memory Type Ddr5

Bandwidth 192 GB/s



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0




Table 32. GPU Specifications for GeForce GTX 1060

Table 33. 12 Day CRASH results for GeForce GTX 1060


1 2 3 4 5 6 7 8 9 10 11 12




(Due to hang) Pass Fail Fail Pass Pass Pass Pass Pass


(Due to hang) Pass Fail Pass Pass Pass Pass Pass Pass



Pass Pass Fail Not Attempted


Pass Pass Pass Fail Pass Pass Pass Pass Pass Pass Pass Pass


July 11, 2018

118

7.9 GeForce GTX 1080 Ti

GeForce GTX 1080 Ti

Memory

Size 11 GB

Memory Type GDDR5

Bandwidth 484 GB/s



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0



CUDA Cores 3584

Table 34. GPU Specifications for GeForce GTX 1080 Ti

Table 35. 12 Day CRASH results for GeForce GTX 1080 Ti


1 2 3 4 5 6 7 8 9 10 11 12








July 11, 2018

119

7.10 Quadro P600

Quadro P600

Memory

Size 2 GB

Memory Type GDDR5

Bandwidth 64 GB/s



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 4x Mini-DisplayPort 1.4

CUDA Cores 684

Table 36. GPU Specifications for Quadro P600

Table 37. 12 Day CRASH results for Quadro P600


1 2 3 4 5 6 7 8 9 10 11 12

Pass Not Attempted

(Due to hang)

Not Attempted

(Due to hang) Fail Not Attempted

(Due to hang) Pass Pass Fail Pass Pass Fail Not Attempted

(Due to hang)

Pass Not Attempted


(Due to hang) Pass Not Attempted

(Due to hang) Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Not Attempted


(Due to hang) Pass Not Attempted

(Due to hang) Pass Fail Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Not Attempted


(Due to hang) Pass Fail Pass Pass Pass Pass Fail Fail Not Attempted

(Due to hang)

Pass Not Attempted


(Due to hang) Pass Pass Pass Fail Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Fail Fail Fail Pass Fail Pass Pass Pass Pass Pass Fail


July 11, 2018

120

7.11 Quadro P4000

Quadro P4000

Memory

Size 8 GB

Memory Type GDDR5

Bandwidth 243 GB/s



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 4x DisplayPort 1.4

CUDA Cores 1792




1 2 3 4 5 6 7 8 9 10 11 12

Pass Pass Pass Pass Fail Pass Not Attempted


(Due to hang)

Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang) Pass Pass Pass Fail Not Attempted

(Due to hang)

Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Not Attempted

(Due to hang)

Pass Pass Pass Pass Fail Pass Pass Pass Pass Pass Pass Fail



July 11, 2018

121

7.12 Quadro P5000

Quadro P5000

Memory

Size 16 GB

Memory Type GDDR5

Bandwidth 288 GB/s



OpenCL 2.0

OpenGL 4.5

Vulkan 1.0


Display Outputs 4x DisplayPort 1.4 + DVI-D DL

CUDA Cores 2560




1 2 3 4 5 6 7 8 9 10 11 12

Not Attempted

(Due to hang) Pass Pass Not Attempted


(Due to hang) Pass Fail Pass Pass Not Attempted

(Due to hang)

Not Attempted




(Due to hang)

Not Attempted



(Due to hang) Pass Pass Pass Pass Fail

Fail Pass Pass Fail Pass Pass Fail Pass Pass Pass Pass Pass


Pass Pass Pass Pass Pass Pass Fail Pass Pass Pass Pass Pass


July 11, 2018

122

8.0 Conclusion

As GPUs advance in capability, more is demanded from the graphics driver. A good user experience

hinges on a stable, reliable software stack. Using CRASH from Microsoft’s Windows HLK, we ran 12

days of 24-hour tests to evaluate the stability of a suite of graphics drivers from leading market

vendors.

In our testing, both AMD gaming and workstation GPUs performed better than the comparable

NVIDIA products. Based on our testing of the aforementioned 12 GPUs, we believe that AMD has

the most stable graphics driver in the industry.

graphics driver quality - amd.com€¦ · graphics driver quality july 11, 2018 iii report...

Documents