8/9/2019 Parallel Computation of the Singular Value Decomposition

1/57

ISSN0

249-6399

ISRNI

NRIA/RR--4694--FR+ENG

apport

de re che rch e

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Parallel computation of the singular value

decomposition

Michael W. Berry , Dani Mezher , Bernard Philippe , Ahmed Sameh

N4694

Janvier 2003

THME 4

8/9/2019 Parallel Computation of the Singular Value Decomposition

2/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

3/57

Unit de recherche INRIA RennesIRISA, Campus universitaire de Beaulieu, 35042 RENNES Cedex (France)Tlphone : 02 99 84 71 00 - International : +33 2 99 84 71 00Tlcopie : 02 99 84 71 71 - International : +33 2 99 84 71 71

8/9/2019 Parallel Computation of the Singular Value Decomposition

4/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

5/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

6/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

7/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

8/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

9/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

10/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

11/57

3.5 3 2.5 2 1.5 1 0.5 0 0.5 1

1

0.5

0

0.5

1

=1.09272e01

=6.67291e02

=4.42368e02

7 6 5 4 3 2 1 0

1.5

1

0.5

0

0.5

1

1.5 =1.09272e01

=6.67291e02

=4.42368e02

=1.85130e01

=1.17346e01

=1.51263e01

0.8644 0.8646 0.8648 0.865 0.8652 0.8654 0.8656 0.8658 0.866

6

4

2

0

2

4

6

x 104

=1.41959e04

=1.65758e04

=1.87017e04

8/9/2019 Parallel Computation of the Singular Value Decomposition

12/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

13/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

14/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

15/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

16/57

-

-

-

-

-

-

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

17/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

18/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

19/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

20/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

21/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

22/57

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

23/57

-

-

-

-

-

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

24/57

-

-

-

-

-

-

-

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

25/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

26/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

27/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

28/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

29/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

30/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

31/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

32/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

33/57

-

-

-

-

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

34/57

-

-

-

-

-

-

-

-

-

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

35/57

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

8/9/2019 Parallel Computation of the Singular Value Decomposition

36/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

37/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

38/57

t

y

x=t+z

z

x+y

O

8/9/2019 Parallel Computation of the Singular Value Decomposition

39/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

40/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

41/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

42/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

43/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

44/57

15 20 25 30 35 40 45 50 55 601000

2000

3000

4000

5000

6000

7000

8000

Number of processors

Time(ms)for1000AV(ATV)

Product A.V

. Product AT.V

15 20 25 30 35 40 45 50 55 6010

15

20

25

30

35

40

45

50

55

Number of processors

Speedup(referencedonr=17processors)

Product A.V

. Product AT.V

8/9/2019 Parallel Computation of the Singular Value Decomposition

45/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

46/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

47/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

48/57

0 .5 0.49 0.48 0.47 0.46 0.45 0.44 0.43 0.42 0.41

0.97

0.98

0.99

1

1.01

1.02

1.03

1.04

1.05

8/9/2019 Parallel Computation of the Singular Value Decomposition

49/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

50/57

0 2 4 6 8 10 12 14 16 18 200

5

10

15

OLM1000

RDB3200L

DW8192S

max

0 2 4 6 8 10 12 14 16 18 200.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

1.1

1.2E

max

OLM1000

RDB3200L

DW8192

8/9/2019 Parallel Computation of the Singular Value Decomposition

51/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

52/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

53/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

54/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

55/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

56/57

8/9/2019 Parallel Computation of the Singular Value Decomposition

57/57

Unit de recherche INRIA Lorraine, Technople de Nancy-Brabois, Campus scientifique,615 rue du Jardin Botanique, BP 101, 54600 VILLERS LS NANCY

Unit de recherche INRIA Rennes, Irisa, Campus universitaire de Beaulieu, 35042 RENNES CedexUnit de recherche INRIA Rhne-Alpes, 655, avenue de lEurope, 38330 MONTBONNOT ST MARTIN

Unit de recherche INRIA Rocquencourt, Domaine de Voluceau, Rocquencourt, BP 105, 78153 LE CHESNAY CedexUnit de recherche INRIA Sophia-Antipolis, 2004 route des Lucioles, BP 93, 06902 SOPHIA-ANTIPOLIS Cedex

diteurINRIA, Domaine de Voluceau, Rocquencourt, BP 105, 78153 LE CHESNAY Cedex (France)

ISSN 0249-6399