representing local structure using tensors...

13
Representing local structure using tensors II Hans Knutsson, Carl-Fredrik Westin and Mats Andersson Linköping University Post Print N.B.: When citing this work, cite the original article. Original Publication: Hans Knutsson, Carl-Fredrik Westin and Mats Andersson, Representing local structure using tensors II, 2011, Proceedings of the 17th Scandinavian conference on Image analysis, 545- 556. Postprint available at: Linköping University Electronic Press http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-78924

Upload: others

Post on 13-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing local structure using tensors II

Hans Knutsson, Carl-Fredrik Westin and Mats Andersson

Linköping University Post Print

N.B.: When citing this work, cite the original article.

Original Publication:

Hans Knutsson, Carl-Fredrik Westin and Mats Andersson, Representing local structure using

tensors II, 2011, Proceedings of the 17th Scandinavian conference on Image analysis, 545-

556.

Postprint available at: Linköping University Electronic Press

http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-78924

Page 2: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing Local Structure using Tensors II

H. Knutsson1,2, C-F Westin1,3, M Andersson1,2

1 Department of Biomedical Engineering, Linkoping University, Sweden2 Center for Medical Image Science and Visualization (CMIV), Linkoping, Sweden3 Laboratory of Mathematics in Imaging, Brigham and Women’s Hospital, Harvard

Medical School, Boston, [email protected]

Abstract. Estimation of local spatial structure has a long history andnumerous analysis tools have been developed. A concept that is widelyrecognized as fundamental in the analysis is the structure tensor. How-ever, precisely what it is taken to mean varies within the research commu-nity. We present a new method for structure tensor estimation which isa generalization of many of it’s predecessors. The method uses filter setshaving Fourier directional responses being monomials of the normalizedfrequency vector, one odd order sub-set and one even order sub-set. It isshown that such filter sets allow for a particularly simple way of attainingphase invariant, positive semi-definite, local structure tensor estimates.We continue to compare a number of known structure tensor algorithmsby formulating them in monomial filter set terms. In conclusion we showhow higher order tensors can be estimated using a generalization of thesame simple formulation.

keywords: structure tensor; higher order; quadrature; monomial filter;

1 Introduction

Many of the popular image analysis concepts of today have roots that can betraced to early work in signal processing and optics, e.g. Riesz transforms,[1],Zernike moments, [2], and Gabor signals,[3]. The first steps towards analysis ofdigital images were taken more then four decades ago [4]. From the very startdetecting edges and lines in images was considered a fundamental operation [5].Since these early days new and more advanced schemes for analysis of localimage structure has been suggested in a seemingly never ending stream. Papershaving a particular relevance in the present context can be found in, for example[6] - [33]. Local image orientation, scale, frequency, phase, motion and locality ofestimates are prominent examples of features that have been considered centralin the analysis.

The main force driving the research has been the need for an efficient anduseful analysis of data produced by increasingly capable imaging devices. Boththe outer and the inner dimensionality is commonly high, e.g. volume sequencedata and tensor field data respectively. Regardless of this development the firststages in the analysis remain the same. In most cases the processing starts by

Page 3: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

2 H. Knutsson, C-F Westin, M Andersson

performing local linear combinations of image values, e.g. convolution operators.The output from these convolutions are then usually combined in a non-linearfashion to produce local feature descriptors.

We will focus on developments regarding a particular instance of such al-gorithms, local structure tensor estimation. We start by presenting a generalestimation scheme using monomial filter sets.

2 Monomial filters

The monomial filters are spherically separable, i.e. defined as a product of oneradial and one directional part:

F (µ) = R(ρ)D(µ) (1)

where µ defines the Fourier domain (FD) coordinates and ρ = ‖µ‖. The radialpart, R(ρ), is a band-pass or high-pass filter (R(0) = 0) and a typical choice isthe lognormal function [9].

Directional part - The directional part consists of monomials i.e. productsof positive integer powers of the components of µ. Performing n repeated outerproducts of µ will contain all order n component products.

µ⊗n = µ⊗ µ ... ⊗ µ︸ ︷︷ ︸n entities

(2)

For convenience we rearrange the terms such that the directional part, Dn(µ),becomes a matrix:

Dn(µ) = µ bµ⊗(n−1)cT (3)

Here the “ b c ” notation implies a lineup operation which arrange the ele-ments of a multi dimensional array into a lexicographic ordered column vector.The motivation for introducing this notation is that letting Dn contain the el-ements of µ⊗n arranged as a matrix greatly simplifies the equations needed inthe following analysis.

To handle the special cases of n = 0 and n = 1 we introduce the followingdefinitions:

µ bµ⊗(−1)c ≡ µ⊗0 ≡ I (4)

where I is an identity matrix scaled to have a unity frobenius norm. The need tointroduce these definitions correspond to the fact that order 0 implies a scalarentity that does not carry orientation information and thus constitutes a specialcase.

It is also worth noting here that the odd part of D1(µ) corresponds to theHilbert transform in the 1-dimensional case and the Riesz transform for higherdimensions, [1].

The monomial filter matrix - For each order n a monomial filter matrix isdefined as:

F n = R(ρ) Dn(µ) (5)

Page 4: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing Local Structure using Tensors II 3

FD SD

Fig. 1. Left : Fourier domain images of F3(1, 1) and F3(1, 2), see eq. (6). High valuesare bright and low values are dark. Green indicates positive real values and red indicatesnegative real values. Right : Spatial domain images of F3(1, 1) and F3(1, 2). Yellowindicates positive imaginary values and blue indicates negative imaginary values. Theblack contours are iso-level lines. The remaining filters in the set are 90 deg rotatedcopies of the shown filters.

As an example consider the monomial filter matrix of order three in 2D.Using the notation µ = (µ, ν)T the monomial filter matrix is computed as:

F 3 = R(ρ)(µν

)⌊µ2 µν

µν ν2

⌋T

= R(ρ)(µν

) (µ2 µν µν ν2

)= R(ρ)

(µ3 µ2ν µ2ν µν2

µ2ν µν2 µν2 ν3

)(6)

For clarity of the presentation most examples in this paper are given in 2D.The proposed concept is, however, valid for any signal dimensions.

Monomial filter responses - Now let the spatial domain (SD) correspon-dence of the monomial filter matrix F n be denoted Fn. Each element of Fn con-sequently contains the convolution kernel of the corresponding FD filter functionin F n. If the multi dimensional signal is denoted s(x) where x denotes the SDcoordinates the monomial filter response matrix, Qn(x), is defined as:

Qn(x) = Fn(x) ∗ s(x) (7)

Denoting the Fourier transform of s around x by Sx the same relation is, in theFourier domain, expressed as:

Qn(x) =∫Fn(µ) Sx(µ) dµ (8)

In this general description each element of Qn(x) contains the monomial filterresponses for the entire signal. Since all filtering operations in this paper are shiftinvariant we may from now on sometimes omit the spatial coordinate vector xand, when doing so, consider each element of Qn to contain a monomial filterresponses for any given spatial coordinate.

Page 5: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

4 H. Knutsson, C-F Westin, M Andersson

3 Signal classes

It is useful in the following to define different classes of signals. We will heredefine three different signal classes: Sinusoidal, Simple and Rank d signals.

Sinusoidal signals - We first present the simplest case, a sinusoidal signalwith amplitude a, spatial frequency u, and phase θ. For this case the monomialfilter response matrix can be described in FD terms as:

s(x) = a cos(uT x + θ) (9)

both even and odd order filters will respond and we get:

Qn =

{a cos(θ)R(ρ)Dn(u) for even n

−ia sin(θ)R(ρ)Dn(u) for odd n(10)

Simple signals - Following [18] we define signals that can be expressed byequation (11) to be termed simple signals.

s(x) = g(uT x) (11)

Here g(x) is any real, one variable, function and x = uT x. u is a unit vectorgiving the orientation of the signal. For this case the monomial filter responsematrix can be described in FD terms as:

Qn(u) = An Dn(u)

= An u bu⊗(n−1)cT(12)

The local orientation invariant filter factor, An, is a function of the radial filterfunction, R(ρ), and the signal generating function, g(x). The fact that the Fouriertransform of a simple signal is non-zero only on a line through the origin makesfor a simple solution. Denoting the Fourier transform of g(x) by G(u) we findthe filter response amplitude as:{

An = Ae =∫R( |u| ) G(u) du for even n

An = Ao =∫R( |u| ) G(u) sign(u) du for odd n

(13)

Unless explicitly mentioned all signals will in the following be regarded simple.

Rank d signals - Although not directly used here, it is worth noting that itis straight forward to classify more complex signals in a similar manner. Let Ube a projection operator of rank d and g be a real function of d variables, then

s(x) = g(Ux) (14)

is a rank d signal. Thus, a simple signal is a rank one signal. A full rank signalcorresponds to U = I. In the following we will only distinguish between sinu-soidal, simple and non-simple signals.

Page 6: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing Local Structure using Tensors II 5

4 Second order structure tensors

The next step towards obtaining a structure tensor is to compute the outerproduct of the filter matrix.

T2n = Qn QT

n (15)

where “ T ” denotes complex conjugate transpose.We will present the case where the local neighborhood of the image consists

of a simple signal with direction u. As a simple introductory example we consider2-dimensional monomial filters of order three.

Q3 = Ao

(u3 u2v u2v uv2

u2v uv2 uv2 v3

)(16)

Carrying out the sums we get:

T3 = Q3 QT3

= AoA∗

o

(u3 u2v u2v uv2

u2v uv2 uv2 v3

)u3 u2v

u2v uv2

u2v uv2

uv2 v3

= |Ao|2 (u2 + v2)2︸ ︷︷ ︸

=1

(u2 uv

uv v2

)

= |Ao|2(u2 uv

uv v2

)(17)

In general the matrix product of equation (15) becomes:

T2n = An u bu⊗(n−1)cT︸ ︷︷ ︸

Qn

bu⊗(n−1)c uT A∗n︸ ︷︷ ︸QT

n

= An u bu⊗(n−1)cT bu⊗(n−1)c︸ ︷︷ ︸inner product

uT A∗n

(18)

The inner product of the lined up outer products above can be performed inreversed order. Then, for n > 0, equation (18) simplifies to:

T2n = An u (uT u)(n−1)︸ ︷︷ ︸

=1

uT A∗n (19)

By definition uT u is equal to one. It follows that the under-braced term alsoequals one and we have the desired result:

T2n = |An|2 u uT ; n > 0 (20)

For n = 0 we have a special case since the filter is isotropic, Dn = 1, andT2

0 = Q0 QT0 = |Ae|2 I.

Page 7: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

6 H. Knutsson, C-F Westin, M Andersson

Monomial quadrature - As stated in equation (13) even and odd filters willhave different local magnitudes.

T2n =

{A2

e u uT for even n

|Ao|2 u uT for odd n(21)

A phase invariant monomial quadrature tensor can now be computed as the sumof one even index tensor and odd index tensor. Letting n be even and m odd weobtain:

T2nm = T2

n + T2m

= QnQTn + QmQT

m

= |Ae + Ao |2 u uT

= q2 u uT

(22)

Note that the tensor magnitude, q, will be the same regardless of the order ofthe filters used.

Tensor positivity - A more compact expression of the monomial quadraturetensor can be attained by concatenating the even and the odd filter responsematrices to a single matrix. The “ , ” notation implies concatenation of thearguments left to right.

Qnm = (Qn ,Qm) (23)

and compute the monomial quadrature tensor of origin (m,n) as

T2nm = Qnm QT

nm (24)

As the monomial quadrature tensor is computed from products of filter responsematrices

T2nm = QnmQT

nm =∑

k

λk ekeTk (25)

it follows that all λk ≥ 0 which allows for robust certainty estimates for the localstructure estimation.

5 Structure tensor estimation variations

Local structure analysis algorithms are quite complex and involve a lot morethan the filters used. This makes comparisons difficult to interpret from a filterpoint of view. There are, however, a number of interesting similarities betweendifferent suggested algorithms. A few previous comparisons can be found in [21]and [26]. In the following we point out the relation to the monomial approachfor a number of well known approaches to structure tensor estimation. We showthat nearly all variants can be formulated as special or modified versions of themonomial approach.

Page 8: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing Local Structure using Tensors II 7

The structure tensor, T - The first publications mentioning tensors as arepresentation for local orientation and structure is due to Knutsson, [12,16].Similar to the earlier developed vector representation, [9,11], the construction isbased on a set of quadrature filters oriented in a number of fixed orientations,qk, k indicating the orientation. The structure tensor is obtained as:

T =∑

k

√qkq∗k Tk (26)

The vector variant works for two dimensional signals but for three dimension,or more, the tensor formulation is necessary. The loglet based structure tensorestimation suggested in [22] also uses this weighted ’basis tensor’ approach butinvolve a different set of filters allowing higher order orientations components tobe incorporated.

Unlike the methods discussed below these method for structure tensor con-struction are not possible to describe as a special or modified case of the mono-mial approach.

The gradient tensor, TG - The simplest way to obtain a matrix describ-ing local orientation is exemplified by Bigun-Granlund’s inertia matrix [13] andForstners corner detector [15]. This matrix is constructed as the outer productof the local gradient and is, in the notation introduced above and Q defined byequation(7), given by:

TG = T1

= Q1 QT1

(27)

Although the authors never mention tensors in the original work this outer prod-uct matrix estimate is often referred to as the gradient tensor or the structuretensor.

Since only a single order, i.e. order one, is used this tensor is not phase in-variant. Another drawback is that the frequency bandwidth of the estimate canbecome twice that of the original signal which may cause significant aliasingartifacts. Both these shortcomings are in practice, to some extent, remedied bythe use of an averaging filter performing a weighted summation of local outerproducts. On the other hand this decreases the spatial resolution of the estimate,[24].

The boundary tensor, TB - The boundary tensor originally suggested byKothe, [23], uses orders one and two and constitutes a special case of the mono-mial quadrature tensor.

TB = T12

= Q12 QT12

(28)

The energy tensor, TE - The energy tensor, suggested by Felsberg, [28], isa variant where filters of different orders are involved in the computed products.

Page 9: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

8 H. Knutsson, C-F Westin, M Andersson

The energy tensor uses an isotropically bandpass filter signal, it’s gradient andit’s Hessian. It can in monomial terms be expressed as:

TE = T1 + T(0,2)

= Q1QT1 + q0Q2

(29)

Note that the filter response matrices here have different radial frequency re-sponse and the mixing of different order terms will not give a positive semi-definite tensor for all image neighborhoods.

Gradient energy tensor, TGE - The gradient energy tensor (GET) suggestedin [29] can be said to use the same formula as the energy tensor with the inputsignal replaced by it’s gradient. In monomial terms the result can be expressed:

TGE = Q2 QT2 +

12

(Q1 QT

3 + Q3 QT1

)(30)

Note that also in this case the filter response matrices here have different radialfrequency response and that the mixing of different order terms will not give apositive semi-definite tensor for all image neighborhoods.

Spatial 2:nd order polynomial tensor, TSP - The 2:nd order polymertensor suggested by Farneback in [19] is a sum of outer products of 1:st and 2:ndorder monomial filters. The difference from the monomial approach is that thefilters are designed as windowed 1:st and 2:nd order polynomials in the spatialdomain.

TSP = T1 + T2

= Q1QT1 + Q2QT

2

(31)

This spatial design results in 1:st and 2:nd order filter that have different radialfunctions in the frequency domain. For this reason the result is not in generalphase invariant i.e components are not in quadrature. However, since it is a sumof squares, the result is always positive semi-definite.

Spherical harmonics, TSH - A somewhat different way to estimate a localstructure tensor is suggested in [24]. This approach is based on sums of productsof spherically separable filters. The filter have the same radial function andthe directional functions are spherical harmonic functions. The structure tensorcarries information about 0:th and 2:nd order variations in orientation. A productbetween an order j filter and an order k filter will contain signal componentsof orders j − k and j + k. By an appropriate weighted summation of a numberof filter products it is possible to retain only order 0 and order 2 in the correctproportion while canceling out all other orders: i.e:

TSH =∑jk

wjkHjHk (32)

This is a very general approach and, since spherical harmonic filter sets of orders1 to N span the same function space as monomial filter sets of orders 1 to N ,

Page 10: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing Local Structure using Tensors II 9

all monomial tensor variations can also be expressed in this way. With properweights the result can also be made phase-invariant.

Sum of monomial tensors - Even more careful weighting of spherical har-monic filter products will give positive semi-definite tensors, in this case theresult will be equivalent to a sum of tensor estimates over different order, n ≥ 0(even and odd), monomial filter matrices, Qn.

TSM =∑

n

wnQnQTn (33)

6 Higher order structure tensors

In equation (18) the filter matrix is constructed to produce a 2:nd order tensor.However, a simple rearrangement of the order n filter matrix components willallow tensors of order 2p to be estimated.

T22p,n = An bu⊗pc bu⊗(n−p)cT︸ ︷︷ ︸

Q(p)n

bu⊗(n−p)c b u⊗pcT An︸ ︷︷ ︸QT

(p)n

= An bu⊗pc bu⊗(n−p)cT bu⊗(n−p)c︸ ︷︷ ︸inner product

b u⊗pcT An

(34)

As before the inner product of the lined up outer products above can be per-formed in reversed order. Then, for n ≥ p ≥ 0, equation (18) simplifies to:

T22p,n = An b u⊗pc (uT u)(n−p)︸ ︷︷ ︸

=1

b u⊗pcT An (35)

By definition uT u is equal to one. It follows that the under-braced term alsoequals one which gives:

T22p,n = |An|2 bu⊗pcb u⊗pcT ; n ≥ p ≥ 0 (36)

The result now holds the components of a tensor of order 2p. However, due tothe use of the lineup operator, the components are stored in matrix form andthey need to be re-organized in order to obtain the result as a proper tensor Υof order 2p.

Υ2p,n = d T22p,ne (37)

The “ d e ” notation used here indicates a reshape operation that restores theproper structure of the data, i.e. the result is a tensor having 2p indexes.

As 2:nd order tensors are naturally represented as matrices the lineup oper-ator greatly simplifies the notation. For higher order tensors, however, the useof standard tensor notation may be preferred by some readers. Equations (36)and (37) can then be jointly expressed as:

Υa1 ... ap

n b1 ... bp= |An|2 u

a1 ... apap+1 ... an u

ap+1 ... an

b1 ... bp(38)

Page 11: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

10 H. Knutsson, C-F Westin, M Andersson

According to the Einstein convention a summation is performed over equal in-dexes and equation 38 clearly shows that the difference between tensors of dif-ferent order is how many indexes are summed over (contracted). Letting p = 0means summing over all indexes and the result is a scalar representing the localenergy. For p = 1 we obtain the standard structure tensor. For p > 1 we obtainhigher order tensors having the power to represent more complex local structure.

Non-simple signals - For such non-simple signals equation (38) is no longerapplicable since there is no unique local orientation, u. Directly expressed as asum of filter products, corresponding to a generalization of the monomial filterresponse matrix product in equation (15), we obtain an order 2p structure tensoras:

Υa1 ... ap

n b1 ... bp= q

a1 ... apap+1... an q

ap+1... an

b1 ... bp(39)

Tensors of order four have been used to analyze situations with two orientationspresent, e.g. [25,31,33]. Applications where tensors of order higher than four havebeen used are so far not known to the authors but can be expected to prove apowerful tool when more that two orientation are present.

To produce quadrature type tensors we still need to add a tensor from oddorder filter sets and a tensor from even order filter sets. In the most general casewe can express the estimation of local structure tensors of order 2p as a weightedsummation of order 2p tensors, here of order (p

p), from monomial filter sets ofdifferent orders, i.e:

Υa1 ... ap

b1 ... bp=∑

n

wn qa1 ... apap+1... an q

ap+1... an

b1 ... bp(40)

7 Conclusion

Research concerning 2:nd order structure tensor estimation is still continuingafter more than two decades. The higher order tensor estimates produced byequation (40) contains a much richer representation of the local structure and weexpect that the future will hold considerable effort towards fully understandingthese new higher order constructs.

Acknowledgment

The Swedish Research Council and Linkopings Universitet are gratefully ac-knowledged for supporting this work.

References

1. M. Riesz. Sur les fonctions conjuge’es. Math. Zeit., 27:218–244, 1927.

Page 12: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

Representing Local Structure using Tensors II 11

2. F. Zernike. Diffraction theory of the cut procedure and its improved form, thephase contrast method. Physica, 1:689–704, 1934.

3. D. Gabor. Theory of communication. J. Inst. Elec. Eng., 93(26):429–457, 1946.4. Ming Kuei Hu. Visual pattern recognition by moment invariants. IRE Transactions

on Information Theory, IT-8(2):179–187, February 1962.5. L. G. Roberts. Optical and Electro-Optical Information Processing, chapter Ma-

chine Perception of three-dimensional Solid, pages 159–197. MIT Press, 1965. J.T. Tippell, editor.

6. G. H. Granlund. In search of a general picture processing operator. ComputerGraphics and Image Processing, 8(2):155–178, 1978.

7. P. E. Danielsson. Rotation invariant operators with directional response. In Pro-ceedings 5’th Int. Conf. on Pattern Recognition, Miami Beach, Florida, 1980.

8. H. Knutsson, R. G. Wilson, and G. H. Granlund. Anisotropic filtering operationsfor image enhancement and their relation to the visual system. In IEEE ComputerSociety Conference on Pattern Recognition and Image Processing, Dallas, Texas,August 1981.

9. H. Knutsson. Filtering and Reconstruction in Image Processing. PhD thesis,Linkoping University, Sweden, 1982. Diss. No. 88.

10. H. Knutsson and G. H. Granlund. Texture analysis using two-dimensional quadra-ture filters. In IEEE Computer Society Workshop on Computer Architecture forPattern Analysis and Image Database Management - CAPAIDM, Pasadena, Oc-tober 1983.

11. H. Knutsson. Producing a continuous and distance preserving 5-D vector repre-sentation of 3-D orientation. In IEEE Computer Society Workshop on ComputerArchitecture for Pattern Analysis and Image Database Management - CAPAIDM,pages 175–182, Miami Beach, Florida, November 1985. IEEE. Report LiTH–ISY–I–0843, Linkoping University, Sweden, 1986.

12. H. Knutsson. A tensor representation of 3-D structures. In 5th IEEE-ASSPand EURASIP Workshop on Multidimensional Signal Processing, Noordwijkerhout,The Netherlands, September 1987. Poster presentation.

13. J. Bigun and G. H. Granlund. Optimal orientation detection of linear symmetry. InIEEE First International Conference on Computer Vision, pages 433–438, London,Great Britain, June 1987.

14. R. Lenz. Rotation-invariant operators and scale space filtering. Pattern RecognitionLetters, Vol 6:151–154, 1987.

15. W. Forstner and E. Gulch. A fast operator for detection and precise location ofdistinct points, corners and centres of circular features. In ISPRS IntercommissionConference on Fast Processing of Photogrammetric Data, pages 281–305, 1987.

16. H. Knutsson. Representing local structure using tensors. In The 6th ScandinavianConference on Image Analysis, pages 244–251, Oulu, Finland, June 1989. ReportLiTH–ISY–I–1019, Computer Vision Laboratory, Linkoping University, Sweden,1989.

17. H. Knutsson, H. Barman, and L. Haglund. Robust orientation estimation in 2D,3D and 4D using tensors. In Proceedings of Second International Conference onAutomation, Robotics and Computer Vision, ICARCV’92, Singapore, September1992.

18. G. H. Granlund and H. Knutsson. Signal Processing for Computer Vision. KluwerAcademic Publishers, 1995. ISBN 0-7923-9530-1.

19. G. Farneback. Fast and accurate motion estimation using orientation tensors andparametric motion models. In Proceedings of 15th International Conference on

Page 13: Representing local structure using tensors IIliu.diva-portal.org/smash/get/diva2:536938/FULLTEXT01.pdf · Representing Local Structure using Tensors II H. Knutsson 1;2, C-F Westin

12 H. Knutsson, C-F Westin, M Andersson

Pattern Recognition, volume 1, pages 135–139, Barcelona, Spain, September 2000.IAPR.

20. M. Felsberg and G. Sommer. The monogenic signal. IEEE Transactions on SignalProcessing, 49(12):3136–3144, December 2001.

21. Bjorn Johansson and Gunnar Farneback. A theoretical comparison of differentorientation tensors. In Proceedings SSAB02 Symposium on Image Analysis, pages69–73, Lund, March 2002. SSAB.

22. H. Knutsson and M. Andersson. Loglets: Generalized quadrature and phase forlocal spatio-temporal structure estimation. In Proceedings of the ScandinavianConference on Image Analysis (SCIA), June 2003.

23. Ullrich Kothe. Inegrated edge and junction detection with the boundary tensor. InProceedings of ninth IEEE International Conference on Computer Vision (ICCV),2003.

24. H. Knutsson and M. Andersson. Implications of invariance and uncertainty for localstructure analysis filter sets. Signal Processing: Image Communications, 20(6):569–581, July 2005.

25. Klas Nordberg. A fourth order tensor for representation of orientation and posi-tion of oriented segments. Other academic ,, Linkoping University, Department ofElectrical Engineering, Sweden, 2004. diva2:288343.

26. Klas Nordberg and Gunnar Farneback. Estimation of orientation tensors for simplesignals by means of second-order filters. Signal Processing: Image Communication,20(6):582–594, 2005.

27. Ullrich Kothe and Michael Felsberg. Riesz-transforms versus derivatives: On therelationship between the boundary tensor and the energy tensor. In Scale Spaceand PDE Methods in Computer Vision, volume 3459 of Lecture Notes in ComputerScience, pages 179–191, 2005.

28. Michael Felsberg and Erik Jonsson. Energy tensors: Quadratic, phase invariantimage operators. In Pattern Recognition, volume 3663 of Lecture Notes in ComputerScience, pages 493–500, 2005.

29. Michael Felsberg and Ullrich Kothe. GET: The connection between monogenicscale-space and Gaussian derivatives. In Scale Space and PDE Methods in Com-puter Vision, volume 3459 of Lecture Notes in Computer Science, pages 192–203,2005.

30. M. Herberthson, A. Brun, and H. Knutsson. Representing pairs of orientations inthe plane. In Proceedings of the 15th Scandinavian conference on image analysis(SCIA’07), Aalborg, Denmark, June 2007.

31. Angelos Barmpoutis, Baba C. Vemuri, and John R. Forder. Registration of high an-gular resolution diffusion mri images using 4th order tensors. In Proceedings of the10th international conference on Medical image computing and computer-assistedintervention - Volume Part I, MICCAI’07, pages 908–915, Berlin, Heidelberg, 2007.Springer-Verlag.

32. Qing Wang, Olaf Ronneberger, and Hans Burkhardt. Fourier analysis in polar andspherical coordinates. Technical Report Internal Report 1/08, IIF-LMB, ComputerScience Department, University of Freiburg, 2008.

33. C-F Westin and H. Knutsson. Visualization and Processing of Tensor Fields:Proceedings of the Dagstuhl Workshop, chapter Representation and Estimation ofTensors-Pairs. 2010. submitted.