cost action b27, wg1 theoretical study on oscillation & cognition, polish contributions reported...
TRANSCRIPT
COST COST Action Action B27B27, WG1, WG1Theoretical Study on Oscillation & Cognition, Theoretical Study on Oscillation & Cognition,
Polish contributionsPolish contributions
Reported by Włodzisław Duch (Google: Duch)
Department of Informatics, Nicolaus Copernicus University,
Torun, Poland
School of Computer Engineering, Nanyang Technological University,
Singapore
NotesNotes
Summer time ... not all responded on a short notice.
Most people do theory and applications and work in several places ... I will talk about activities of 4 groups:
• Andrzej Cichocki, Warsaw Univ. Technology & RIKEN Brain Science Institute, Wako-shi
• Rafał Bogacz, Bristol, Uni. Wrocław & Princeton• Wiesław Kamiński, Maria Curie-Skłodowska University,
Lublin• Włodzisław Duch, Nicolaus Copernicus University
& Nanyang Technological University, Singapore
Laboratory for Laboratory for Advanced Brain Signal Advanced Brain Signal
ProcessingProcessingAndrzej Cichocki
http://www.bsp.brain.riken.jp/~cia/ RIKEN, Brain Science Institute, JAPAN
& Warsaw University of Technology, POLAND
Laboratory for Advanced Brain Signal ProcessingLaboratory for Advanced Brain Signal ProcessingRiken Brain Science Institute, JapanRiken Brain Science Institute, Japan
Research mission and central research interest:
The laboratory for Advanced Brain Signal Processing isfocused on developing novel and state of the art methods to: • extract, detect, recognize, • find functional connectivity • classify brain signals and to use the insights gained to build intelligent feature extraction systems for Early Detection and Classification of Dementia, especially Alzheimer Disease (AD), evaluation of aging of the brain using Blind Signal Processing (BSP) and Time Frequency Representation (TFR) of EEG and fMRI/PET.
Research Projects of the Research Projects of the Laboratory for Advanced Brain Signal ProcessingLaboratory for Advanced Brain Signal Processing
Analysis
MUR
Experiments, collecting and preprocessing
EEG, EOG, EMG , PET, fMRI, MUR data
Modeling
Olfactory,
Auditory S
Brain
Computer
Interface
Diagnosis
of Dementia,
AD
Analysis of
EEG/ERP
Electronic Nose
Electronic Ears
Intelligent Communication
Human with machine Detection, Enhancement
Classification,
Extraction. Functional Connectivity
Database
BLIND SIGNAL
PROCESSINGMACHINE LEARNING
DATA MINING
Spike Sorting
Information Retrieval
Clustering
One of the main objective of the Laboratory is to develop and apply novel blind signal processing (BSP) and Machine Learning (ML) algorithms and methods including: Sparse Components Analysis (SCA), Time-Frequency Component Analyzer (TFCA), Independent Components Analysis (ICA), Blind Deconvolution - Equalization and Hierarchical Clustering to analyze multi-sensory, multi-modal biomedical signals, especially high density array EEG signals.
Research ObjectivesResearch Objectives
High Density Array EEG Recording/Analysis High Density Array EEG Recording/Analysis Systems in LABSP, RIKEN BSISystems in LABSP, RIKEN BSI
LABSP Research ProjectsLABSP Research Projects
1. Developments and Implementation of Novel Blind Signal Processing and Machine Learning Techniques for Analysis, Finding Functional Relationships and Modeling of Brain Signals.
2. Intelligent Communication between Human Brain and Machine - Development of Software/Hardware for Human/Brain Computer Interface (H/BCI) and Classification of Various Mental States.
3. Early Detection and Classification of Dementia, especially Alzheimer Disease (AD) using Blind Signal Processing (BSP) and Time-Frequency Representation (TFR) of EEG and Other Neuroimaging Techniques.
4. Modeling Some Aspects of Auditory System and Olfactory System: Contribution to Development of Electronic Ears and Electronic Nose – Artificial Olfaction.
Unique Results Unique Results
1. Development of novel models for BSP (State space, Kalman filter, multilayer, recurrent NN, BSE NN using linear predictability).
2. Development, implementation, integration and theoretical analysis of new associative learning algorithms for ICA, SCA, BSE, MBD, NMF and SPCA.
3. Applications of BSP algorithms to real-world problems 1. Early detection of Alzheimer’s disease (Clinical Neurophysiology)2. Analysis of high density array EEG data (extraction of unique
components and elimination of dependent artifacts, investigation validity and reliability, improvements in source localization)
3. Reduction of artifacts in simultaneous recording EEG and fMRI4. Speech separation, enhancement and modeling auditory cortex5. Support clinical diagnosis of brain death using ICA.
Procedure for extracting markers of ADProcedure for extracting markers of AD
Processing flow of the developed method. The main novelty lies in ordering and selection of only few significant AD markers (components), back-projecting (deflation) of these components on the scalp level and processing them in the time frequency domain using approximated sparsification. Advanced pattern recognition and machine learning techniques are applied for classification and analysis of the data.
P rep ro cess in g :A rtifac ts rem o v a l;
D en o is in g ;F ilte r in g ;
M o d e l red u c tio n
W av e le t T F R ,
S p a rse b u m pm o d e lin g
R an k in gan d
c lu s te rin g o f co m p o n en ts
C la ss if ic a tio n
N eu ra l n e tw o rk
B S S /B S E :IC A , S C A , N M F,
T F C A
( )W
F ea tu reE x trac tio n
B ack p ro jec tio n
( )W +
D iag n o sis
R awE E GD ata
C leanE E GD ata
E n h an cedE E G
A D /M C I
N o rm a l
E n h an cedE E G
C o m p o n en ts
S ig n ifican tm ark e rs
N o isesu b sp ace
S ig n a lsu b sp ace
E E G u n it
RafaRafałł Bogacz BogaczBristol/Princeton/WrocBristol/Princeton/Wrocłławaw
Theory of Event Related Potentials (ERP)
• ERPs are computed by averaging EEG signals over many trials, time locked to an event in psychological experiment (e.g. stimulus presentation).
• Should ERP’s be regarded as uncorrelated with the background EEG, or generated by the event-related reorganization of this ongoing rhythmic activity?
• Detection of phase resetting in electroencephalogram; paper with Nick Yeung, Clay Holroyd, Jonathan D. Cohen.
Theories of ERP originTheories of ERP origin
“Classical view”
(phasic peak)
Pure phase
resetting
… ……
Phase resetting
and enhancement
Indi
vidu
al
EE
G e
poch
s
AveragedERP
Evaluation of methodsEvaluation of methods
• We evaluated a number of methods previously used to support the phase-resetting theory of ERP origin.
• We generated artificial EEG signals by superimposing phasic peak on noise (according to classical view).
• When applied to the simulated data, the methods in question produced results that have been previously interpreted as evidence of synchronized oscillations, even though no such synchrony was present.
WiesWiesłław Kamiaw Kamiński, Grzegorz Wójcikński, Grzegorz WójcikDivision of Complex SystemsDivision of Complex Systems and Neurodynamicsand Neurodynamics
Institute of Computer ScienceInstitute of Computer Science, Maria Curie-Sklodowska , Maria Curie-Sklodowska University, Lublin, PolandUniversity, Lublin, Poland
• Neurocomputing• Brain and Visual System Modelling• Parallel Processing• Physical analysis• Software development and Visualisation
[email protected]@gmail.com
Brain and Visual System ModellingBrain and Visual System Modelling
• Modeling and investigation of large biological neural networks
• Visual systems simulations and models of cortex• Dynamical analysis and applications of Artificial Neural
Networks (ANN)• Liquid State Machines (LSM), etc.
Analysis Based on Physics
• Thermodynamic and statistical physics methods in network’s dynamics analysis
• Analysis based on informational theory• Self Organising Criticality (SOC) investigations• Chaos theory and applications
Parallel Processing/VisualizationParallel Processing/Visualization
• Grids and large clusters for simulations
• Adaptation of GENESIS/MPGENESIS simulators for MPI environment
• Development of visualisation methods for the cortex dynamics and comparison with experimental results.
• Participation in the CLUSTERIX project (National Linux Cluster, more than 800 Itanium processors).
Włodzisław Duch & Co (Google: Duch)Włodzisław Duch & Co (Google: Duch)Department of Informatics, Nicolaus Copernicus University, Torun, Poland, and School of Computer Engineering, Nanyang Technological University (NTU), Singapore
Done many smaller projects on: • Hebbian associative memories with chaotic itinerancy and large Lyapunow exponents for mixed pattern separation (P. Matykiewicz).
• Visualization of trajectories in such networks and stability analysis of locally Hopfield nets with highly correlated patterns (F. Piękniewski, L. Rybicki)• Fuzzy symbolic dynamics for simplification of neurodynamics.• A-life biots based on Boltzman machines (L. Rybicki)
• Global Brain Simulations – just starting ... • Cognitive architectures, integration of perception with cognition – just starting ...
Attention-Based Artificial Cognitive Control Attention-Based Artificial Cognitive Control Understanding System (ABACCUS)Understanding System (ABACCUS)
First attempt: large EU integrated project, with 9 participants: King’s College London (John G. Taylor, coordinator).
New version: BRAin as Complex System (BRACS), on a smaller scale, more focused on simulations and understanding the principles of complex brain-like information processing.
The time of large scale global brain simulations has come!• Computer speeds have just reached brain power (about 1016 binop/s), but computers are far from brain’s complexity/style. • Science: understand how high-level cognition arises from low-level interactions between neurons, build powerful research tool; to understand complex systems is to be able to build them.
• Practical: humanized, cognitive computer applications require a brain-like architecture (either software or hardware) to deal with such problems efficiently; it is at the center of cognitive robotics.
Scheme of the brain ...Scheme of the brain ...
High-level sketch of the brain structures, with connections based on different types of neurotransmiters marked in different colors.
BRACS Assumptions & GoalsBRACS Assumptions & Goals• Assumption: gross neuroanatomical brain structure is critical for
its function, therefore it should be preserved. • Should be founded on neuro-scientific understanding of attention
and the sensory and motor systems it controls, development in children, simplified modeling, computer power.
• Fusion of the appropriate brain-based models, guided by the overall architecture of the brain and developmental learning stages should lead to high-level cognitive processing.
• Develop an attention control systems for focusing in sensory surveillance tasks, and for image searching.
• Development of control structures for autonomous machines. • Create its own goals in an autonomous fashion. • Darwin VII small robot (G. Edelman) works with 53K mean firing
+phase neurons, 1.7 M synapses, modeling 28 brain areas and achieving sensorimotor integration; our project is larger and more structured, hopefully higher cognitive functions emerge ...
Sketch of the BRACS systemSketch of the BRACS system
Rough sketch of the BRACS system, based on simplified spiking neurons.
Computational Platform, Simulation Environment and Integration
Neuroscience and Development
Vision
Memory System
Drive and Intrinsic reward
system
Atomization system
Reasoning System
Feedback Attention Control
Motor Control
Speech TactileLearning of PFC goals
Working Memory
Value Maps
Action/Object reward system