bayesian mixture models for background-source separationaws/guglielmetti.pdf · 2012-07-17 ·...

40
Bayesian mixture models for Bayesian mixture models for background-source separation background-source separation Fabrizia Guglielmetti Max-Planck-Institut fu̎r extraterrestrische Physik In collaboration with: Rainer Fischer, Volker Dose Max-Planck-Institut fu̎r Plasmaphysik Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Upload: others

Post on 30-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Bayesian mixture models for Bayesian mixture models for background-source separationbackground-source separation

Fabrizia Guglielmetti Max-Planck-Institut fu ̎r extraterrestrische Physik

In collaboration with:

Rainer Fischer, Volker Dose Max-Planck-Institut fu ̎r Plasmaphysik

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 2: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

OutlineOutline

1. Introduction

2. The Bayesian mixture model technique

✔ Guglielmetti F., Fischer R., Dose V., 2009, MNRAS, 396, 165

➢ Source detection and characterization

3. Applications

4. Summary & Conclusions

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 3: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

IntroductionIntroduction

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Simulated sky imageSimulated sky image

[erg/s/cm²/deg²]

Simulated sky image

[erg/s/cm²/deg²]

X-ray sky image

[photon count/pixel]

Simulated eROSITA image for 2 ks observing time. Image includes expected particle and instrumental background, population of AGN, effects due to PSF and Poisson noise.

Credits to: Pace, F. (ICG, UK)Roncarelli, M. (UniBo, Italy) Credits to: Mühlegger, M.

Page 4: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

IntroductionIntroduction

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Simulated sky imageSimulated sky image

[erg/s/cm²/deg²]

Simulated sky image

[erg/s/cm²/deg²]

X-ray sky image

[photon count/pixel]

Simulated eROSITA image for 2 ks observing time. Image includes expected particle and instrumental background, population of AGN, effects due to PSF and Poisson noise.

Credits to: Pace, F. (ICG, UK)Roncarelli, M. (UniBo, Italy) Credits to: Mühlegger, M.

Page 5: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

IntroductionIntroduction

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Simulated sky imageSimulated sky image

[erg/s/cm²/deg²]

Simulated sky image

[erg/s/cm²/deg²]

X-ray sky image

[photon count/pixel]

Simulated eROSITA image for 2 ks observing time. Image includes expected particle and instrumental background, population of AGN, effects due to PSF and Poisson noise.

Credits to: Pace, F. (ICG, UK)Roncarelli, M. (UniBo, Italy) Credits to: Mühlegger, M.

Page 6: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

IntroductionIntroduction

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

● Difficulties to overcome in image analysis:

1. Ill-posed inverse problem

2. 0-few counts per pixel

3. Diffuse background plus celestial objects: a) Background is not constant;

b) Sources show large variety of source morphologies

4. Instrumental complexities

➔ Increase statistical and systematic errors in the data

Page 7: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

IntroductionIntroduction

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 8: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

IntroductionIntroduction

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 9: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Why is it important?Why is it important?

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

● Address astrophysical problems, as:

– Study physical properties of detected objects

– Test models of structure formation (as for clusters of galaxies)

– Explore stellar and galaxy evolution

– Understand the nature of dark energy and dark matter

– Provide insight for the origin and the ultimate fate of the Universe

– ....

We need to detect both point-like and extended sources

Page 10: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Standard detection approachStandard detection approach

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

From: ”Astronomical Image and Data Analysis” Starck, J.-L. and Murtagh, F. Springer Verlag 2006

● Objects of interest are superposed on a relatively flat signal: Background signal

● Background must be accurately estimated, or bias on flux estimation is introduced

● (Common) Background estimation:

➔ Cut out of sources (ebox)

➔ Histogram after partitioning image into blocks (Median filtering)

● Statistical fluctuations: thresholds are used for tuning the number of false sources

➔ False positives and negatives

Page 11: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

DesiderataDesiderata & & ChallengesChallenges

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

1. Preserves statistics

2. Detect faint sources

3. Detect point-like and extended sources

4. Reliable background model

5. Properly include exposure

6. Uncertainty of estimates

1. Poisson, background fluctuations

2. Joint background+sources,

model parameters estimated from the data

3. Large variety of source morphologies

4. Steep gradients

5. Instrumental complexities

6. Quantification

Page 12: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Bayesian mixture modelsBayesian mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

D={dij}∈ℕ

Bij :d ij=bijijBij :d ij=bijsijij

✔ Single observed data set:

✔ Bayesian Probability Theory (BPT)

✔ Two complementary hypotheses for each pixel:

✔ Assumptions:

I. b smoother than sII.

✔ 2D spline (Thin-Plate spline)

✔ BPT with probabilistic mixture model

b , s∈ℝ+

Page 13: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

t x = E x∑l= 1

N

l f x − xl , with x ∈ℝ2

Number of supporting points

plane Radial Basis Function: f x− x l=r2 lnr 2

weights

Thin-Plate spline (TPS)Thin-Plate spline (TPS)

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

● Requirements:

1) is 2nd order differentiable

2)

3)

satisfy the interpolation conditions, evaluate the TPS

t x

t x i=z i

∥t2∥=I [ f x , y ]=∬ℝ

2

f xx22 f xy

2 f yy

2

Page 14: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

p dij∣ Bij , bij , sij =bij sij

d ij

dij!e−bij s ij , when Bij is true

p dij∣Bij , bij =bijdij

dij!e−b ij , when Bij is true

p D∣b,∗ ,∗=∏ij

[∗p dij∣Bij ,bij1−

∗p dij∣Bij ,bij ,

∗]

p Bij = , p Bij= 1−

Poisson Likelihood

Marginal Poisson Likelihood

Likelihood for the mixture model

mean expected intensity

p sij∣=e−sij /

Page 15: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

p dij∣ Bij , bij , sij =bij sij

d ij

dij!e−bij s ij , when Bij is true

p dij∣Bij , bij =bijdij

dij!e−b ij , when Bij is true

p D∣b,∗ ,∗=∏ij

[∗p dij∣Bij ,bij1−

∗p dij∣Bij ,bij ,

∗]

p Bij = , p Bij= 1− p sij∣ ,a=e−a/s ijsij

− a−1

−1

Poisson Likelihood

Marginal Poisson Likelihood

Likelihood for the mixture model

Slope Cut-off params

Page 16: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

p dij∣ Bij , bij , sij =bij sij

d ij

dij!e−bij s ij , when Bij is true

p dij∣Bij , bij =bijdij

dij!e−b ij , when Bij is true

p D∣b,∗ ,∗=∏ij

[∗p dij∣Bij ,bij1−

∗p dij∣Bij ,bij ,

∗]

Poisson Likelihood

Marginal Poisson Likelihood

Likelihood for the mixture model

max ,

p ,∣D∗ ,∗Hyper-parameters: Laplace approximation

Page 17: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Hyperparameters: Laplace approximation max ,

p ,∣D ∗ ,∗

p ,∣D= p D∣ ,p p pD

Page 18: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 19: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 20: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Likelihood for mixture modelsLikelihood for mixture models

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 21: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Background modelBackground model

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

TPS Observatory exposure time

p b∣D∝p D∣b,∗ ,∗×p bPosterior PDF ofbackground:

maxb

p b∣Db∗ Estimate of Background Map

t x ×x

Page 22: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Posterior pdf for source detectionPosterior pdf for source detection

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

p Bij∣dij ≈1

1 ∗

1−∗⋅

p dij∣Bij ,bij∗

p dij∣Bij ,bij∗ ,∗

Page 23: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Posterior pdf for source detectionPosterior pdf for source detection

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

p Bij∣dij ≈1

1 ∗

1−∗⋅

p dij∣Bij ,bij∗

p dij∣Bij ,bij∗ ,∗

b∗={bij∗}

Page 24: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Posterior pdf for source detectionPosterior pdf for source detection

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

p Bij∣dij ≈1

1 ∗

1−∗⋅

p dij∣Bij ,bij∗

p dij∣Bij ,bij∗ ,∗

Bayes factors

Page 25: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Detection of faint sources and Detection of faint sources and complex morphologiescomplex morphologies

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

1. Multi resolution analysis:

2. Multi band analysis:

Statistical combination of data from different energy bands

pdfs assigned correlating the information

of neighbouring pixels:

Source Probability Maps (SPM)

p Bij∣d ijcomb=1−∏k=1

n

[1− p B ij∣d ij k ]

Page 26: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Detection of faint sources and Detection of faint sources and complex morphologiescomplex morphologies

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

SPM 4”

SPM 6”SPM 8”

SPM 10”

SPM 12”

Page 27: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Detection of faint sources and Detection of faint sources and complex morphologiescomplex morphologies

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

SPM 4”

SPM 6”SPM 8”

SPM 10”

SPM 12”

Page 28: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Detection of faint sources and Detection of faint sources and complex morphologiescomplex morphologies

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

LSS image Photon count smoothed

SPM 4''

SPM 6''

Detection of two clusters (merging)

Page 29: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

PhotometryPhotometry

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Dij=bijG ij ∀ {ij }∈ {k } Data of a source in detection area 'k'

Function describing the photon counts distribution of detected sources

p x , y , x , y , , I∣b ,d ∝∏ij Dijd ij e

−D ij

d ij !

Max of posterior pdf:

∀ {ij }∈ {k }

Page 30: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Application to RASSApplication to RASS

The Vela SNR d=( ) pc (Cha et al.1999) Age=( ) yr (Aschenbach et al. 1995)

250±3018000±9000

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

cou

nts

/pix

el

So

urce

pro

ba

bility

Page 31: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

So

urce

pro

ba

bility

So

urce

pro

ba

bilityS

ou

rce

pro

ba

bili

tyco

un

ts/p

ixe

l

Page 32: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Vela SNR background modelVela SNR background model

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 33: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

The Vela PulsarThe Vela Pulsar

BSS technique:

XMM-Newton (2008):

~3% difference < 5% expected divergence

F X [0.5−2.0]keV =3.176±0.009×10−11erg /s /cm2

F X [0.5−2.0]keV =3.285±0.004×10−11 erg /s /cm2

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

So

urce

pro

ba

bility

cou

nts

/pix

el

Page 34: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

RASS: varying exposureRASS: varying exposure

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Page 35: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

RASS: varying exposureRASS: varying exposure

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

(0-9) counts/pixel

cou

nts

/pix

el

So

urce

pro

ba

bility

Page 36: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

RASS: varying exposureRASS: varying exposure

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

(0-9) counts/pixelACO S 340 (Abell et al, 1989) z=0.068 (De Propris et al., 2002)

cou

nts

/pix

el

Page 37: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

CDF-SCDF-S

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Photon counts/pixel (smoothed)

SPM (3 arcsec)

Page 38: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

CDF-SCDF-S

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Ms/pixel Background counts/pixel

Page 39: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

CDF-S: XID 594, zCDF-S: XID 594, z∼0.735∼0.735

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

Color composite image (B,R,I) -WFI telescope

Superposed: X-ray contours (SPM, 20”)

1.5 arcmin [638 kpc]

Cluster of galaxy with cD galaxy (#3) not located at the centre of the cluster

and contaminated by surrounding galaxies

Page 40: Bayesian mixture models for background-source separationaws/Guglielmetti.pdf · 2012-07-17 · Introduction Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012 Simulated

Summary & ConclusionsSummary & Conclusions

Fabrizia Guglielmetti – Bayes Forum @ MPE – July 6, 2012

● Analysis of Poisson images is awkward because of:

➔ Few counts per pixel, Poisson noise, instrumental complexities, large variety of source morphologies

● BPT supplies a general and consistent frame for logical inference

● BPT combined with a probabilistic mixture model allows one to gain insight into the coexistance of background and sources

● The BSS technique:

✔ Provide detection of both point-like and extended soucres

✔ Is capable to automatically separate point-like from diffuse emission

✔ Is capable to detect sources independently to their morphology also features as filaments

● The BSS method is currently under a feasibility study for being applied to eROSITA mission, with the goals to provide important insight for the quests of: Dark matter, Dark Energy and distribution of matter in the Universe