jeffrey a. fessler eecs department the university of ...p2,slide,bw.pdf · image reconstruction...

72
Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI Tutorial, Part 2 Apr. 6, 2006 Acknowledgements: Doug Noll, Brad Sutton, Chunyu Yip, Will Grissom 0

Upload: others

Post on 18-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Image reconstruction methods for MRI

Jeffrey A. Fessler

EECS DepartmentThe University of Michigan

ISBI Tutorial, Part 2Apr. 6, 2006

Acknowledgements: Doug Noll, Brad Sutton,Chunyu Yip, Will Grissom

0

Page 2: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Outline

•MR image reconstruction introduction(k-space, FFT, gridding, density compensation)

•Model-based reconstruction overview

• Iterations and computation (NUFFT etc.)

• Regularization

• Field inhomogeneity correction

• Parallel (sensitivity encoded) imaging

• Iterative methods for RF pulse design

• Examples

1

Page 3: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Introduction

2

Page 4: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Standard MR Image Reconstruction

MR k−space data Reconstructed Image

Cartesian sampling in k-space. An inverse FFT. End of story.

Commercial MR system quotes 400 FFTs (2562) per second.

3

Page 5: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Non-Cartesian MR Image Reconstruction

“k-space” image

kx

ky

=⇒

4

Page 6: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Example: Iterative Reconstruction under ∆B0

5

Page 7: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Example: Iterative RF Pulse Design

6

Page 8: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Textbook MRI Measurement Model

Ignoring lots of things:

yi = s(ti)+noisei, i = 1, . . . ,N

s(t) =Z

f (~r)e−ı2π~κ(t) ·~r d~r,

where~r denotes spatial position, and~κ(t) denotes the “k-space trajectory” of the MR pulse sequence,determined by user-controllable magnetic field gradients.

e−ı2π~κ(t) ·~r provides spatial information =⇒ Nobel Prize

•MRI measurements are (roughly) samples of the Fouriertransform F(~κ) of the object’s transverse magnetization f (~r).

• Basic image reconstruction problem:recover f (~r) from measurements {yi}

Ni=1.

Inherently under-determined (ill posed) problem=⇒ no canonical solution.

7

Page 9: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Image Reconstruction Strategies

The unknown object f (~r) is a continuous-space function,but the recorded measurements yyy = (y1, . . . ,yN) are finite.

Options?

• Continuous-discrete formulation using many-to-one linear model:

yyy = A f +εεε.Minimum norm solution (cf. “natural pixels”):

minf

∥∥ f∥∥ subject to yyy = A f

f = A∗(AA

∗)−1yyy = ∑Ni=1ci e−ı2π~κi ·~r , where AA

∗ccc = yyy.

• Discrete-discrete formulationAssume parametric model for object:

f (~r) =M

∑j=1

f j p j(~r) .

8

Page 10: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

• Continuous-continuous formulationPretend that a continuum of measurements are available:

F(~κ) =Z

f (~r)e−ı2π~κ ·~r d~r,

vs samples yi = F(~κi)+εi, where~κi ,~κ(ti) .The “solution” is an inverse Fourier transform:

f (~r) =Z

F(~κ)eı2π~κ ·~r d~κ .

Now discretize the integral solution (two approximations!):

f (~r) =N

∑i=1

F(~κi)eı2π~κi ·~r wi ≈N

∑i=1

yiwi eı2π~κi ·~r ,

where wi values are “sampling density compensation factors.”Numerous methods for choosing wi value in the literature.For Cartesian sampling, using wi = 1/N suffices,and the summation is an inverse FFT.

9

Page 11: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Conventional MR Image Reconstruction

1. Interpolate measurements onto rectilinear grid (“gridding”)

2. Apply inverse FFT to estimate samples of f (~r)

0

0

kx

k yGridding from Polar to Cartesian

10

Page 12: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Gridding Approach 1: Pull from K nearest

0

0

kx

k y

Gridding by pulling from 10 nearest

11

Page 13: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Gridding Approach 2: Pull from neighborhood

0

0

kx

k y

Gridding by pulling from within neighborhood

12

Page 14: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Gridding Approach 3: Push to neighborhood

0

0

kx

k y

Gridding by pushing onto neighborhood

13

Page 15: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Gridding Approaches

Ignore noise: yi = F(~κi)

Pull:for each Cartesian grid point, use weighted averageof nonuniform k-space samples within some neighborhood◦ Does not require density compensation◦ Requires cumbersome search/indexing to find neighbors

Push:each nonuniform k-space sample onto a Cartesian neighborhood

F(~κ) =N

∑i=1

yiwi C(~κ−~κi)

◦ C(~κ) denotes the gridding kernel, typically separable Kaiser-BesselJackson et al., IEEE T-MI, 1991

◦ “∗” denotes convolution.◦ δ(·) denotes the Dirac impulse◦ density compensation factors wi essential

14

Page 16: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Post-iFFT Gridding Correction

Gridding as convolution in k-space:

F(~κ) =N

∑i=1

yiwi C(~κ−~κi) = C(~κ)∗N

∑i=1

yiwi δ(~κ−~κi) .

Inverse FT reconstruction:

finitial(~r) = F−1{

F(~κ)}

= c(~r)N

∑i=1

yiwi e−ı2π~κi ·~r .

Post-correction:

ffinal(~r) =finitial(~r)

c(~r).

15

Page 17: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Gridding Kernels and Post-corrections

−6 −4 −2 0 2 4 6−0.4

−0.2

0

0.2

0.4

0.6

0.8

1

u

C(u

)

Convolution kernels

−1.5 −1 −0.5 0 0.5 1 1.5−0.2

0

0.2

0.4

0.6

0.8

1

x/FOV

c(x)

Post−gridding correction functions

Kaiser−Bessel, J=4 β=18.5547Sinc

16

Page 18: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Density Compensation

f (~r) =Z

F(~κ)eı2π~κ ·~r d~κ≈N

∑i=1

yi eı2π~κi ·~r wi.

• Voronoi cell areaBracewell, 1973, Astrophysical Journal; Rasche et al., IEEE T-MI, 1999

• Jacobians Norton, IEEE T-MI, 1987

• Jackson’s area density Jackson, IEEE T-MI, 1991

• Iterative methods Pipe and Menon, MRM, 2000

• ...

Tradeoffs between simplicity and accuracy.

17

Page 19: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Voronoi Cell Area

−1 0 1−1

0

1

ν1

ν 2

18

Page 20: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Limitations of Gridding Reconstruction

1. Artifacts/inaccuracies due to interpolation

2. Contention about sample density “weighting”

3. Oversimplifications of Fourier transform signal model:

•Magnetic field inhomogeneity•Magnetization decay (T2)• Eddy currents• ...

4. Sensitivity encoding ?

5. ...

(But it is faster than iterative methods...)

19

Page 21: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Model-Based Image Reconstruction: Overview

20

Page 22: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Model-Based Image Reconstruction

MR signal equation with more complete physics:

s(t) =Z

f (~r)scoil(~r)e−ıω(~r) t e−R∗2(~r) t e−ı2π~κ(t) ·~r d~r

yi = s(ti)+noisei, i = 1, . . . ,N

• scoil(~r) Receive-coil sensitivity pattern(s) (for SENSE)• ω(~r) Off-resonance frequency map

(due to field inhomogeneity / magnetic susceptibility)• R∗2(~r) Relaxation map

Other physical factors (?)• Eddy current effects; in~κ(t)• Concomitant gradient terms• Chemical shift• Motion

Goal?(it depends)

21

Page 23: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Field Inhomogeneity-Corrected Reconstruction

s(t) =Z

f (~r)scoil(~r)e−ıω(~r) t e−R∗2(~r) t e−ı2π~κ(t) ·~r d~r

Goal: reconstruct f (~r) given field map ω(~r).(Assume all other terms are known or unimportant.)

MotivationEssential for functional MRI of brain regions near sinus cavities!

(Sutton et al., ISMRM 2001; T-MI 2003)22

Page 24: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Sensitivity-Encoded (SENSE) Reconstruction

s(t) =Z

f (~r)scoil(~r)e−ıω(~r) t e−R∗2(~r) t e−ı2π~κ(t) ·~r d~r

Goal: reconstruct f (~r) given sensitivity maps scoil(~r).(Assume all other terms are known or unimportant.)

Can combine SENSE with field inhomogeneity correction “easily.”

(Sutton et al., ISMRM 2001, Olafsson et al., ISBI 2006)23

Page 25: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Joint Estimation of Image and Field-Map

s(t) =Z

f (~r)scoil(~r)e−ıω(~r) t e−R∗2(~r) t e−ı2π~κ(t) ·~r d~r

Goal: estimate both the image f (~r) and the field map ω(~r)(Assume all other terms are known or unimportant.)

Analogy:joint estimation of emission image and attenuation map in PET.

(Sutton et al., ISMRM Workshop, 2001; ISBI 2002; ISMRM 2002;ISMRM 2003; MRM 2004)

24

Page 26: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

The Kitchen Sink

s(t) =Z

f (~r)scoil(~r)e−ıω(~r) t e−R∗2(~r) t e−ı2π~κ(t) ·~r d~r

Goal: estimate image f (~r), field map ω(~r), and relaxation map R∗2(~r)

Requires “suitable” k-space trajectory.

(Sutton et al., ISMRM 2002; Twieg, MRM, 2003)25

Page 27: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Estimation of Dynamic Maps

s(t) =Z

f (~r)scoil(~r)e−ıω(~r) t e−R∗2(~r) t e−ı2π~κ(t) ·~r d~r

Goal: estimate dynamic field map ω(~r) and “BOLD effect” R∗2(~r)given baseline image f (~r) in fMRI.

Motion...

26

Page 28: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Model-Based Image Reconstruction: Details

27

Page 29: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Back to Basic Signal Model

s(t) =Z

f (~r)e−ı2π~κ(t) ·~r d~r

Goal: reconstruct f (~r) from yyy = (y1, . . . ,yN), where yi = s(ti)+ εi.

Series expansion of unknown object:

f (~r)≈M

∑j=1

f j p(~r−~r j)←− usually 2D rect functions.

yi ≈Z

[M

∑j=1

f j p(~r−~r j)

]

e−ı2π~κi ·~r d~r =M

∑j=1

[Z

p(~r−~r j)e−ı2π~κi ·~r d~r

]

f j

=M

∑j=1

ai j f j, ai j = P(~κi)e−ı2π~κi ·~r j , p(~r)FT⇐⇒ P(~κ) .

Discrete-discrete measurement model with system matrix AAA= {ai j}:

yyy = AAA fff + εεε.Goal: estimate coefficients (pixel values) fff = ( f1, . . . , fM) from yyy.

28

Page 30: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Small Pixel Size Need Not Matter

x true

−128 0 127−128

0

127

0

2N=32

−128 0 127−128

0

127

0

2N=64

−128 0 127−128

0

127

0

2

N=128

−128 0 127−128

0

127

0

2N=256

−128 0 127−128

0

127

0

2N=512

−128 0 127−128

0

127

0

2

29

Page 31: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Profiles

−100 −50 0 50 1000

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

2

horizontal position [mm]

|f(x,

0)|

trueN=32N=64N=128N=256N=512

30

Page 32: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Regularized Least-Squares Estimation

fff = argminfff∈CM

Ψ( fff ), Ψ( fff ) = ‖yyy−AAA fff‖2+αR( fff )

• data fit term ‖yyy−AAA fff‖2

corresponds to negative log-likelihood of Gaussian distribution• regularizing roughness penalty term R( fff ) controls noise

R( fff )≈Z

‖∇ f‖2d~r

• regularization parameter α > 0controls tradeoff between spatial resolution and noise(Fessler & Rogers, IEEE T-IP, 1996)• Equivalent to Bayesian MAP estimation with prior ∝ e−αR( fff )

Quadratic regularization R( fff ) = ‖CCC fff‖2 leads to closed-form solution:

fff =[AAA′AAA+αCCC′CCC

]−1AAA′yyy

(a formula of limited practical use)31

Page 33: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Choosing the Regularization Parameter

fff =[AAA′AAA+αCCC′CCC

]−1AAA′yyy

E[

fff]

=[AAA′AAA+αCCC′CCC

]−1AAA′E[yyy]

E[

fff]

=[AAA′AAA+αCCC′CCC

]−1AAA′AAA

︸ ︷︷ ︸

blur

fff

AAA′AAA and CCC′CCC are Toeplitz =⇒ blur is approximately shift-invariant.

Frequency response of blur:

L(ω) =H(ω)

H(ω)+αR(ω)

where H = FFT(AAA′AAAej) (lowpass) and R= FFT(CCC′CCCej) (highpass)

Adjust α to achieve desired spatial resolution.

32

Page 34: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Spatial Resolution Example

A’A ej

−10 0 10−10

−5

0

5

10

α C’C ej

−10 0 10−10

−5

0

5

10PSF

−10 0 10−10

−5

0

5

10

H(ω)

ωX

ωY

−π 0 π−π

0

πR(ω)

ωX

ωY

−π 0 π−π

0

πH/(H+R)

ωX

ωY

−π 0 π−π

0

π

Spiral k-space trajectory, FWHM of PSF is 1.2 pixels33

Page 35: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Spatial Resolution Example: Profiles

−π 0 π0

2

4

6

8ξ 10

4

H(ω

)

−π 0 π0

200

400

600

800

R(ω

)

−π 0 π

0.6

0.8

1

L(ω

)

ω

34

Page 36: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Iterative Minimization by Conjugate Gradients

Choose initial guess fff (0) (e.g., fast conjugate phase / gridding).Iteration (unregularized):

ggg(n) = ∇Ψ(

fff (n))

= AAA′(AAA fff (n)−yyy) gradientppp(n) = PPPggg(n) precondition

γn =

0, n = 0〈ggg(n), ppp(n)〉

〈ggg(n−1), ppp(n−1)〉, n > 0

ddd(n) =−ppp(n) + γnddd(n−1) search direction

vvv(n) = AAAddd(n)

αn = 〈ddd(n),−ggg(n)〉/〈AAA fff (n), AAA fff (n)〉 step sizefff (n+1) = fff (n) +αnddd

(n) update

Bottlenecks: computing AAA fff and AAA′yyy.• AAA is too large to store explicitly (not sparse)• Even if AAA were stored, directly computing AAA fff is O(NM)

per iteration, whereas FFT is only O(N logN).35

Page 37: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Computing AAA fff Rapidly

[AAA fff ]i =M

∑j=1

ai j f j = P(~κi)M

∑j=1

e−ı2π~κi ·~r j f j, i = 1, . . . ,N

• Pixel locations {~r j} are uniformly spaced• k-space locations {~κi} are unequally spaced

=⇒ needs nonuniform fast Fourier transform (NUFFT)

36

Page 38: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

NUFFT (Type 2)

• Compute over-sampled FFT of equally-spaced signal samples• Interpolate onto desired unequally-spaced frequency locations• Dutt & Rokhlin, SIAM JSC, 1993, Gaussian bell interpolator• Fessler & Sutton, IEEE T-SP, 2003, min-max interpolator

and min-max optimized Kaiser-Bessel interpolator.NUFFT toolbox: http://www.eecs.umich.edu/∼fessler/code

0

50

100

π−π π/2−π/2 ω

X(ω

)

?37

Page 39: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Worst-Case NUFFT Interpolation Error

2 4 6 8 1010

−10

10−8

10−6

10−4

10−2

J

Em

axMaximum error for K/N=2

Min−Max (uniform)Gaussian (best)Min−Max (best L=2)Kaiser−Bessel (best)Min−Max (L=13, β=1 fit)

38

Page 40: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Further Acceleration using Toeplitz Matrices

Cost-function gradient:

ggg(n) = AAA′(AAA fff (n)−yyy)= TTT fff (n)−bbb,

whereTTT , AAA′AAA, bbb , AAA′yyy.

In the absence of field inhomogeneity, the Gram matrix TTT is Toeplitz:

[AAA′AAA] jk =N

∑i=1

|P(~κi)|2e−ı2π~κi ·(~r j−~rk) .

Computing TTT fff (n) requires an ordinary (2× over-sampled) FFT.(Chan & Ng, SIAM Review, 1996)

In 2D: block Toeplitz with Toeplitz blocks (BTTB).

Precomputing the first column of TTT and bbb requires a couple NUFFTs.(Wajer, ISMRM 2001, Eggers ISMRM 2002, Liu ISMRM 2005)

39

Page 41: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

NUFFT with Field Inhomogeneity?

Combine NUFFT with min-max temporal interpolator(Sutton et al., IEEE T-MI, 2003)(forward version of “time segmentation”, Noll, T-MI, 1991)

Recall signal model including field inhomogeneity:

s(t) =Z

f (~r)e−ıω(~r) t e−ı2π~κ(t) ·~r d~r .

Temporal interpolation approximation (aka “time segmentation”):

e−ıω(~r) t ≈L

∑l=1

al(t)e−ıω(~r)τl

for min-max optimized temporal interpolation functions {al(·)}Ll=1.

s(t)≈L

∑l=1

al(t)Z [

f (~r)e−ıω(~r)τl

]

e−ı2π~κ(t) ·~r d~r

Linear combination of L NUFFT calls.40

Page 42: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Field Corrected Reconstruction Example

Simulation using known field map ω(~r).

41

Page 43: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Simulation Quantitative Comparison

• Computation time?

• NRMSE between fff and fff true?

Reconstruction Method Time (s) NRMSE NRMSEcomplex magnitude

No Correction 0.06 1.35 0.22Full Conjugate Phase 4.07 0.31 0.19Fast Conjugate Phase 0.33 0.32 0.19Fast Iterative (10 iters) 2.20 0.04 0.04Exact Iterative (10 iters) 128.16 0.04 0.04

42

Page 44: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Human Data: Field Correction

43

Page 45: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Acceleration using Toeplitz Approximations

In the presence of field inhomogeneity, the system matrix is:

ai j = P(~κi)e−ıω(~r j)ti e−ı2π~κi ·~r j

The Gram matrix TTT = AAA′AAA is not Toeplitz:

[AAA′AAA] jk =N

∑i=1

|P(~κi)|2e−ı2π~κi ·(~r j−~rk) e−ı(ω(~r j)−ω(~rk))ti .

Approximation (“time segmentation”):

e−ı(ω(~r j)−ω(~rk))ti ≈L

∑l=1

bil e−ı(ω(~r j)−ω(~rk))τl

TTT = AAA′AAA≈L

∑l=1

DDD′lTTT lDDDl ,DDDl , diag

{e−ıω(~r j)τl

}

[TTT l ] jk , ∑Ni=1 |P(~κi)|

2bil e−ı2π~κi ·(~r j−~rk).

Each TTT l is Toeplitz =⇒ TTT fff using L pairs of FFTs.

(Fessler et al., IEEE T-SP, Sep. 2005, brain imaging special issue)

44

Page 46: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Toeplitz Results

1 64

Image and support1

64 0

2.5

1 64

Fieldmap: Brain1

64

Hz

−20

0

20

40

60

80

100

120

Uncorrected Conj. Phase, L=6

CG−NUFFTL=6

CG−ToeplitzL=8

0

2.5

45

Page 47: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Toeplitz Acceleration

Precomputation NRMS % vs SNRMethod L BBB,CCC AAA′DDDyyy bbb = AAA′yyy TTT l 15 iter Total Time ∞ 50 dB 40 dB 30 dB 20 dBConj. Phase 6 0.4 0.2 0.6 30.7 37.3 46.5 65.3 99.9CG-NUFFT 6 0.4 5.0 5.4 5.6 16.7 26.5 43.0 70.4CG-Toeplitz 8 0.4 0.2 0.6 1.3 2.5 5.5 16.7 26.4 42.9 70.4

• Reduces CPU time by 2× on conventional workstation (Mac G5)• No SNR compromise• Eliminates k-space interpolations =⇒ ideal for FFT hardware

46

Page 48: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Joint Field-Map / Image Reconstruction

Signal model:

yi = s(ti)+ εi, s(t) =Z

f (~r)e−ıω(~r) t e−ı2π~κ(t) ·~r d~r .

After discretization:

yyy = AAA(ωωω) fff + εεε, ai j(ωωω) = P(~κi)e−ıω jti e−ı2π~κi ·~r j .

Joint estimation via regularized (nonlinear) least-squares:

( fff , ωωω) = argminfff∈CM,ωωω∈RM

‖yyy−AAA(ωωω) fff‖2+β1R1( fff )+β2R2(ωωω).

Alternating minimization:• Using current estimate of fieldmap ωωω,

update fff using CG algorithm.

• Using current estimate fff of image,update fieldmap ωωω using gradient descent.

Use spiral-in / spiral-out sequence or “racetrack” EPI.(Sutton et al., MRM, 2004)

47

Page 49: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Joint Estimation Example

(a) uncorr., (b) std. map, (c) joint map, (d) T1 ref, (e) using std, (f) using joint.

48

Page 50: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Activation Results: Static vs Dynamic Field Maps

49

Page 51: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Functional results for the two reconstructions for 3 human subjects.

Reconstruction using the standard field mapfor (a) subject 1, (b) subject 2, and (c) subject 3.

Reconstruction using the jointly estimated field mapfor (d) subject 1, (e) subject 2, and (f) subject 3.

Number of pixels with correlation coefficients higher than thresholdsfor (g) subject 1, (h) subject 2, and (i) subject 3.

Take home message: dynamic field mapping is possible, usingiterative reconstruction as an essential tool.(Standard field maps based on echo-time differences work poorlyfor spiral-in / spiral-out sequences due to phase discrepancies.)

50

Page 52: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Tracking Respiration-Induced Field Changes

51

Page 53: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Regularization Variations

52

Page 54: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Regularization Revisited

• Conventional regularization for MRI uses a roughness penaltyfor the complex voxel values:

R( fff )≈M

∑j=1

| f j− f j−1|2 (in 1D).

• Regularizes the real and imaginary image components equally.• In some MR studies, including BOLD fMRI:◦ magnitude of f j carries the information of interest,◦ phase of f j should be spatially smooth.◦ This a priori information is ignored by R( fff ).

• Alternatives to R( fff ):◦ Constrain fff to be real?

(Unrealistic: RF phase inhomogeneity, eddy currents, ...)◦ Determine phase of fff “somehow,” then estimate its magnitude.◦ Non-iteratively (Noll, Nishimura, Macovski, IEEE T-MI, 1991)

◦ Iteratively (Lee, Pauly, Nishimura, ISMRM, 2003)

53

Page 55: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Separate Magnitude/Phase Regularization

Decompose fff into its “magnitude” mmm and phase xxx:

f j(mmm,xxx) = mj eıx j , mj ∈ R, x j ∈ R, j = 1, . . . ,M.

(Allow “magnitude” mj to be negative.)

Proposed cost function with separate regularization of mmm and xxx:

Ψ(mmm,xxx) = ‖yyy−AAA fff (mmm,xxx)‖2+ γR1(mmm)+βR2(xxx) .

Choose β� γ to strongly smooth phase estimate.

Joint estimation of magnitude and phase via regularized LS:

(mmm, xxx) = argminmmm∈RM, xxx∈RM

Ψ(mmm,xxx)

Ψ is not convex =⇒ need good initial estimates (mmm(0),xxx(0)).

54

Page 56: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Alternating Minimization

Magnitude Update:

mmmnew= argminmmm∈RM

Ψ(mmm,xxxold

)

Phase Update:xxxnew= argmin

xxx∈RMΨ(mmmnew,xxx),

Since f j = mj eıx j is linear in mj, the magnitude update is easy.Apply a few iterations of slightly modified CG algorithm(constrain mmm to be real)

But f j = mj eıx j is highly nonlinear in xxx. Complicates “argmin.”

Steepest descent?

xxx(n+1) = xxx(n)−λ∇xxxΨ(mmmold,xxx(n)

).

Choosing the stepsize λ is difficult.

55

Page 57: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Optimization Transfer

56

Page 58: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Surrogate Functions

To minimize a cost function Φ(xxx), choose surrogate functions φ(n)(xxx)that satisfy the following majorization conditions:

φ(n)(xxx(n))

= Φ(xxx(n))

φ(n)(xxx) ≥ Φ(xxx), ∀xxx∈ RM.

Iteratively minimize the surrogates as follows:

xxx(n+1) = argminxxx(n)∈RM

φ(n)(xxx) .

This will decrease Φ monotonically; Φ(xxx(n+1))≤Φ(xxx(n)).

The art is in the design of surrogates.Tradeoffs:◦ complexity◦ computation per iteration◦ convergence rate / number of iterations.

57

Page 59: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Surrogate Functions for MR Phase

L(xxx) , ‖yyy−AAA fff (mmm,xxx)‖2 =N

∑i=1

hi([AAA fff (mmm,xxx)]i),

where hi(t) , |yi− t|2 is convex.

Extending De Pierro (IEEE T-MI, 1995), for πi j ≥ 0 and ∑Mj=1πi j = 1:

[AAA fff (mmm,xxx)]i =M

∑j=1

bi j eıx j =

M

∑j=1

πi j

[bi j

πi j

(

eıx j−eıx(n)j

)

+ y(n)

i

]

,

where bi j , ai jmj, y(n)

i , [AAA fff (mmm,xxx(n))]i. Choose πi j ≥ 0 and ∑Mj=1πi j = 1.

Since hi is convex:

hi([AAA fff (mmm,xxx)]i) = hi

(M

∑j=1

πi j

[bi j

πi j

(

eıx j−eıx(n)j

)

+ y(n)

i

])

≤M

∑j=1

πi j hi

(bi j

πi j

(

eıx j−eıx(n)j

)

+ y(n)

i

)

,

with equality when xxx = xxx(n).58

Page 60: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Separable Surrogate Function

L(xxx) =N

∑i=1

hi([AAA fff (mmm,xxx)]i)≤N

∑i=1

M

∑j=1

πi j hi

(bi j

πi j

(

eıx j−eıx(n)j

)

+ y(n)

i

)

=M

∑j=1

N

∑i=1

πi j hi

(bi j

πi j

(

eıx j−eıx(n)j

)

+ y(n)

i

)

︸ ︷︷ ︸

Q j(x j;xxx(n))

.

Construct similar surrogates {Sj} for (convex) roughness penalty...

Surrogate: φ(n)(xxx) =M

∑j=1

Q j(x j;xxx(n))+βSj(x j;xxx

(n)).

Parallelizable (simultaneous) update, with 1D minimizations:

xxx(n+1) = argminxxx(n)∈RM

φ(n)(xxx) =⇒ x(n+1)

j = argminx j∈R

Q j(x j;xxx(n))+βSj(x j;xxx

(n)).

Intrinsically guaranteed to monotonically decrease the cost function.59

Page 61: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

1D Minimization: cos + quadratic

... Q j(x j;xxx(n))≡−

∣∣∣r (n)

j

∣∣∣cos

(

x j−x(n)

j −∠r (n)

j

)

,

r (n)

j =(

f (n)

j

)∗

[AAA′(yyy−AAAxxx(n))] j + |mj|2M

N

∑i=1

|P(~κi)|2

−2π −π 0 π 2π 0

1

2

3

4

5

6

7

8

9

t

surr

ogat

e(t)

m(1−cos(t−p)) + bt + c/2 t2

−5 0 5 10 150

0.5

1

1.5

2

2.5

3Surrogates for sinusoids

t

Simple 1D optimization transfer iterations...60

Page 62: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Final Algorithm for Phase Update

Diagonally preconditioned gradient descent:

xxx(n+1) = xxx(n)−DDD(xxx(n))∇Φ(xxx(n))

where the diagonal matrix DDD has elements that ensure Φ decreasesmonotonically.

Alternate between magnitude and phase updates...

61

Page 63: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Preliminary Simulation Example

−π 0 π−π

0

πUndersampled Spiral

ωX

ωY

1 32

|x| true1

280

2

1 32

∠ x true1

28−0.1

0.6

1 32

|x| old1

280

2

1 32

∠ x old1

28−0.1

0.6

1 32

|x| new1

280

2

1 32

∠ x new1

28−0.1

0.6

62

Page 64: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Parallel Imaging

63

Page 65: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Sensitivity encoded (SENSE) imaging

Use multiple receive coils (requires multiple RF channels).Exploit spatial localization of sensitivity pattern of each coil.

Note: at 1.5T, RF is about 60MHz.=⇒ RF wavelength is about 3·108m/s/60·106Hz = 5 meters

RF coil sensitivity patternsArray coil images

1 64

1

64

Regularized sensitivity maps

1 64

1

64

0

1.4

Pruessmann et al., MRM, 199964

Page 66: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

SENSE Model

Multiple coil data:

yli = sl(ti)+ εli , sl(t) =Z

f (~r) scoill (~r)e−ı2π~κ(t) ·~r d~r, l = 1, . . . ,L = Ncoil

Goal: reconstruct f (~r) from coil data yyy1, . . . ,yyyL

“given” sensitivity maps{

scoill (~r)

}L

l=1 .

Benefit: reduced scan time.

Left: sum of squares; right: SENSE.65

Page 67: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

SENSE Reconstruction

Signal model:

sl(t) =Z

f (~r) scoill (~r)e−ı2π~κ(t) ·~r d~r

Discretized form:

yyyl = AAADDDl fff + εεεl , l = 1, . . . ,L,

where AAA is the usual frequency/phase encoding matrix andDDDl contains the sensitivity pattern of the l th coil: DDDl = diag

{scoil

l (~r j)}

.

Regularized least-squares estimation:

fff = argminfff

L

∑l=1

‖yyyl−AAADDDl fff‖2+βR( fff ).

Can generalize to account for noise correlation due to coil coupling.Easy to apply CG algorithm, including Toeplitz/NUFFT acceleration.

For Cartesian SENSE, iterations are not needed.(Solve small system of linear equations for each voxel.)

66

Page 68: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

RF Pulse Design

67

Page 69: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Example: Iterative RF Pulse Design(3D tailored RF pulses for through-plane dephasing compensation)

68

Page 70: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Multiple-coil Transmit Imaging Pulses (Mc-TIP)

69

Page 71: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Summary

• Iterative reconstruction: much potential in MRI

• Even nonlinear problems involving phase terms eıx are tractableby using optimization transfer.

• Computation: reduced by tools like NUFFT / Toeplitz

• Optimization algorithm design remains important(cf. Shepp and Vardi, 1982, PET)

Some current challenges

• Sensitivity pattern mapping for SENSE

• Through-voxel field inhomogeneity gradients

•Motion / dynamics / partial k-space data

• Establishing diagnostic efficacy with clinical data...

70

Page 72: Jeffrey A. Fessler EECS Department The University of ...p2,slide,bw.pdf · Image reconstruction methods for MRI Jeffrey A. Fessler EECS Department The University of Michigan ISBI

Advertisement

“Image Reconstruction: Algorithms and Analysis”book in preparation.

Email [email protected] for notification of web publication.(Some chapters should be available in Summer 2006.)

71