department of biology jonathan z. simon - umd · pdf filesignal processing of ... owens....
TRANSCRIPT
![Page 1: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/1.jpg)
Signal Processing ofAuditory Responses fromMagnetoencephalography (MEG)Jonathan Z. Simon
Department of Electrical & Computer EngineeringDepartment of Biology
University of Maryland, College Park
![Page 2: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/2.jpg)
ComputationalSensorimotorSystemsLaboratory
CollaboratorsDavid PoeppelNikos KanlisDidier Depireux
StudentsAhmad GheithJuanjuan Xiang
Lab ManagersShantanu RayJeff Richardson (CNL)
Special ThanksShihab ShammaTony Owens
![Page 3: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/3.jpg)
Outline
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Ripple Stimuli & ICA with EEG
• Spectral/Frequency Methods
![Page 4: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/4.jpg)
Functional Imaging
Non-invasive recordingfrom human brain(Functional brainimaging)
Positron emissiontomographyPET
Functional magneticresonance imagingfMRI
ElectroencephalographyEEG
Excellent spatial resolution( ~ 1-2 mm)
Poor temporal resolution( ~ 1 s)
Poor spatial resolution( ~ 1 cm)
Excellent temporal resolution( < 1 ms)
Hemodynamictechniques
Electromagnetictechniques
MagnetoencephalographyMEG
PET, EEG requireacross-subjectaveraging
fMRI and MEG cancapture effects insingle subjects
![Page 5: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/5.jpg)
MEG Magnetic Signal
Non-invasive measurementDirect measurement
~ 104 neurons
![Page 6: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/6.jpg)
Magnetic Field Strengths
Earth field
Urban noise
Contamination at lung
Heart QRS
MuscleFetal heart
Spontaneous signal(α-wave)
Signal from retina
Intrinsic noise of SQUID
Inte
nsity
of m
agn
etic
sig
nal( T
)
Evoked signal
Biomagnetism
EYE (retina) Steady activity Evoked activity
LUNGS Magnetic contaminants
LIVER Iron stores
FETUS Cardiogram
LIMBS Steady ionic current
BRAIN (neurons) Spontaneous activity Evoked by sensory stimulation
SPINAL COLUMN (neurons) Evoked by sensory stimulation
HEART Cardiogram (muscle) Timing signals (His Purkinje system)
GI TRACK Stimulus response Magnetic contaminations
MUSCLE Under tension
~ 104 neurons
![Page 7: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/7.jpg)
Magnetic Flux Detectors
Superconductivity
Magnetic flux quantization
Josephson Effect
SQUID = Superconducting QuantumInterference Device
= 2 eh
= 2.07 10 WbΦ0 × -15
= 2 eh
= Φ n n Φ0
![Page 8: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/8.jpg)
Sensor ConfigurationsNoise reduction fromDifferential measurement
Planar type
Magnetometer Gradiometer
Axial type
50 mm base line
![Page 9: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/9.jpg)
Magnetically Shielded Room
![Page 10: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/10.jpg)
MEG
MEG (vs. EEG)
EEG
Temporal resolution high as EEGFast, easy set-upMagnetic fields are not attenuated,unlike electric fields
Higher spatial resolution
ExpensiveInverse problem worse(?)
Complementary Techniques
![Page 11: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/11.jpg)
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Ripple Stimuli & ICA with EEG
• Spectral/Frequency Methods
Outline
![Page 12: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/12.jpg)
Sensor Layout
Recording from 160 channelsResponse peak at 98 ms after onset of an auditory stimulus,in the left and right temporal lobes.
![Page 13: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/13.jpg)
Butterfly Plot
Overlay of all channels above right temporal lobe
Response peak at 98 ms after onset of an auditory stimulus
![Page 14: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/14.jpg)
Contour Plot
Distribution of magnetic field at peak response
t = 98 ms
![Page 15: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/15.jpg)
Magnetic Source Imaging
MEG + MRI
Dipole fit at response peak, 98ms after onset of stimulus
![Page 16: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/16.jpg)
M100 Latency
Latency decreases withincreasing harmonics
M100 PeakLatency decreases withincreasing frequency
![Page 17: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/17.jpg)
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Ripple Stimuli & ICA with EEG
• Spectral/Frequency Methods
• Ripple Stimuli & ICA with EEG
• Spectral/Frequency Methods
Outline
• Introduction to MEG
• Auditory MEG Signals
![Page 18: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/18.jpg)
MEG Variability
dp4_500_R2_2-2_no_A108.par
![Page 19: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/19.jpg)
We should be able to do betterthan mean and variance of responses tomultiple presentations of one stimulus
Jitter across responses cancelso we lose variance of latencies
Coherence across channels ignored
Blind Source Separation (BSS)? ICA…
Beyond Averaging
![Page 20: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/20.jpg)
X
W
U Y
g()
mixedrecordings
unknownmixingprocess
blindseparation
Independent Component Analysis (ICA)(1) unmixes the separate sources’ activity, and(2) reduces the information overlap between components
estimatedindependentcomponents
uniformlydistributedindependentcomponents
non-linearity
Learned weights approximateinverse of mixing matrix
Independent Component Analysis
![Page 21: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/21.jpg)
MEG Waveform & ICAIndependent Component Analysis
![Page 22: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/22.jpg)
Independent Component Analysis
![Page 23: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/23.jpg)
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Ripple Stimuli & ICA with EEG
• Spectral/Frequency Methods
Outline
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Spectral/Frequency Methods
![Page 24: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/24.jpg)
Systems Theory and Speech• Speech
Broadband, DynamicSpectrotemporally richAlgorithmically complex
• Systems TheoryComplex objects can beexpressed as sum of simplerobjects
• Dynamic RipplesBroadband, DynamicSpectrotemporally richAlgorithmically Simple
![Page 25: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/25.jpg)
.25
.5
1
2
4
8
0 250Time (ms)
Fre
quen
cy (
kHz)
Fourier Spacerepresentation
Ω
-0.4 cyc/oct
w4 Hz–4 Hz
0.4 cyc/oct
The Fourier transformof a single movingsinusoid has supportonly on a single point(and its complexconjugate).
Spectro-Temporal representation(Spectrogram)
S(t,x)= sin(2πwt + 2πΩx + φ)
x = log2(f / f0)w = ripple velocity,
e.g. 4 Hz = 4 cycles/sΩ = ripple density,
e.g. 0.4 cycles/octave= 2 cycles/5 octaves
c.f. visualcontrast gratings
Simple Spectrally Dynamic Stimulus
∫ [.] exp(±2πjΩx±2πjwt)
w = 4 Hz
Ω = 0.4 cyc/oct
Single Moving Ripple
![Page 26: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/26.jpg)
Miniature EEG
![Page 27: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/27.jpg)
Cortical Surface EEG Before ICA
![Page 28: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/28.jpg)
ICA & Cortical Surface EEG
![Page 29: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/29.jpg)
ICA Reveals Cortical Traveling Wave
![Page 30: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/30.jpg)
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Ripple Stimuli & ICA with EEG
• Spectral/Frequency Methods
Outline
• Introduction to MEG
• Auditory MEG Signals
• Independent Component Analysis(ICA)
• Ripple Stimuli & ICA with EEG
![Page 31: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/31.jpg)
0 5 10 15 20 25 30
0
16 H
z, 2
c/o
8 H
z, 2
c/o
4 H
z, 2
c/o
Nor
mal
ized
diff
eren
ce (
dB)
Frequency (Hz)
Max Mean Power Spectral DensityR – L
Power Spectral Density Follows Ripple Speed
!"
#$% &
![Page 32: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/32.jpg)
Asymmetric Sampling in Time (AST)
![Page 33: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/33.jpg)
0 10 20 30 40 50 60
-0.8
-0.4
0
0.4
0.8
noise.5,1.5,2.5,4.5,8.5,162,12,22,42,82,16
Frequency (Hz)
Total Power Spectral Density L – R
Pow
er D
ensi
ty A
sym
met
ry (
dB)
Total Power Spectra: Hemispheric Asymmetry
$" '"
"" &()*+',-
!"
#$% &
![Page 34: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/34.jpg)
'".
$( ' /
00 1 (
23.---
4
56$"
!. #"
." "
( "!
"
7" "8--" "
Conclusions
![Page 35: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic](https://reader031.vdocument.in/reader031/viewer/2022030411/5a9db2ef7f8b9a28388d3467/html5/thumbnails/35.jpg)