uroscience welcome to cse2330 introduction to …
TRANSCRIPT
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
1
Wel
com
e to
CS
E2
33
0 I
ntr
od
uct
ion
to
Co
mp
uta
tio
na
l N
euro
scie
nce
D
r. A
ndre
w P
apli
nsk
i
Sch
ool
of
Com
pute
r S
cien
ce a
nd S
oft
war
e E
ngin
eeri
ng (
CS
SE
), M
onas
h U
niv
ersi
ty
Dr.
Len
nar
t G
ust
afss
on
Dep
t. o
f C
om
pute
r S
cien
ce a
nd E
lect
rica
l E
ngin
eeri
ng,
Lule
a U
niv
ersi
ty o
f T
echnolo
gy
, L
ule
a, S
wed
en
Res
earc
h i
nte
rest
: M
odel
ling l
earn
ing i
n a
uti
sm w
ith n
eura
l net
work
s, i
.e. ap
ply
ing c
once
pts
and
tech
niq
ues
fro
m c
om
puta
tional
neu
rosc
ience
to g
ain i
nsi
ghts
into
the
my
ster
ies
of
auti
sm
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
2
Co
urs
e li
tera
ture
: W
.W.
Ly
tton:
Fro
m C
om
pute
r to
Bra
in;
Foundati
ons
of
Com
puta
tional
Neuro
scie
nce, S
pri
nger
,
ISB
N 0
-387-9
5528-3
A t
ext
full
of
insi
ghts
that
does
n’t
rel
y h
eavil
y o
n m
athem
atic
s.
The
idea
l in
troduct
ion a
t an
under
gra
duat
e le
vel
.
E.T
. R
oll
s an
d A
. T
reves
: N
eura
l N
etw
ork
s and B
rain
Functi
on, O
xfo
rd U
niv
ersi
ty P
ress
, IS
BN
0-1
9-8
524 3
(pbk)
Cover
s a
wid
e var
iety
of
neu
ral
net
work
model
s an
d p
lace
s th
em i
n p
roper
cen
tral
ner
vous
syst
em c
onte
xt
but
does
n’t
tre
at m
odel
ling o
f neu
rons
at a
ny
det
ail.
A v
aluab
le c
om
ple
men
tary
tex
t.
P.
Day
an a
nd L
.F.
Abbott
: T
heore
tical
Neuro
scie
nce C
om
puta
tional
and M
ath
em
ati
cal
Modeli
ng o
f N
eura
l Syst
em
s, T
he
MIT
Pre
ss,
ISB
N 0
-262-0
4199-5
A c
om
pre
hen
sive
text
whic
h d
oes
rel
y h
eavil
y o
n m
athem
atic
s.
The
idea
l in
troduct
ion a
t a
post
gra
duat
e le
vel
.
Addit
ional
sugges
tions
for
read
ing o
n p
arti
cula
r to
pic
s w
ill
be
giv
en a
s th
e co
urs
e pro
ceed
s.
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
3
Co
urs
e o
utl
ine,
lec
ture
s T
he
lect
ure
wil
l la
rgel
y f
oll
ow
the
pre
senta
tion i
n L
ytt
on b
ut
som
e ad
dit
ional
mat
eria
l w
ill
be
cover
ed.
Ly
tton d
ivid
es h
is b
ook i
nto
four
sect
ions
whic
h w
e w
ill
trea
t ac
cord
ing t
o:
Per
spec
tives
(ai
min
g a
t tw
o l
ectu
res)
C
om
pute
rs (
aim
ing a
t p
arts
of
one
lect
ure
)
Cy
ber
net
ics
(aim
ing
at
six
lec
ture
s)
Bra
ins
(aim
ing a
t fo
ur
lect
ure
s)
Unsu
per
vis
ed l
earn
ing a
nd r
einfo
rcem
ent
lear
nin
g a
s w
ell
as a
ttem
pts
to m
odel
Alz
hei
mer
’s
dis
ease
and t
he
auti
stic
spec
trum
dis
ord
ers
wil
l al
so b
e co
ver
ed i
n l
ectu
res,
aim
ing a
t fo
ur
lect
ure
s.
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
4
Co
urs
e o
utl
ine,
pra
cs
The
pra
ctic
al e
xer
cise
s w
ill
be
dev
ote
d t
o m
odel
ling n
euro
ns,
neu
ral
net
work
s an
d t
o
appli
cati
ons
of
com
puta
tional
neu
rosc
ience
to i
llust
rate
and g
ain u
nder
stan
din
g i
n p
arti
cula
r of
edge
enhan
cem
ent
in v
isio
n
as
soci
ativ
e m
emory
and A
lzhei
mer
’s d
isea
se
at
tem
pts
to u
nder
stan
d a
spec
ts o
f au
tism
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
5
Wh
at
is a
pro
per
ro
le f
or
com
pu
tati
on
al
neu
rosc
ien
ce?
F
rom
Ly
tton (
pag
e 36):
Neu
roan
atom
y i
s th
e st
udy
of
form
. N
euro
phy
siolo
gy
would
lik
e to
be
the
study
of
funct
ion.
Unfo
rtunat
ely,
it o
nly
occ
asio
nal
ly r
ises
to t
his
idea
l. W
e
are
oft
en s
o c
luel
ess
as t
o w
hat
’s g
oin
g o
n t
hat
neu
rophy
siolo
gy
bec
om
es
more
a d
escr
ipti
on o
f th
e dy
nam
ics
than
an e
xpla
nat
ion o
f it
s m
eanin
g o
r
inte
nt.
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
6
Wh
at
is a
pro
per
ro
le f
or
com
pu
tati
on
al
neu
rosc
ien
ce?
(c
on
t’)
Com
puta
tional
neu
rosc
ience
pro
pose
s to
fin
d m
eanin
g a
nd i
nte
nt
in t
he
form
and d
ynam
ics
of
neu
ral
syst
ems.
w
ww
.cyb
erti
me.
net
/~aj
go
od
/ad
den
dum
.htm
l -
53
k
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
7
If y
ou
th
ink
th
at’
s b
oa
stfu
l, c
on
sid
er t
he
foll
ow
ing
: R
ose
nbla
tt, in
ven
tor
of
the
per
ceptr
on:
It i
s si
gnif
ican
t th
at t
he
indiv
idual
ele
men
ts, or
cell
s, o
f a
[bio
logic
al]
ner
ve
net
work
hav
e nev
er
bee
n d
emonst
rate
d t
o p
oss
ess
any
spec
ific
ally
psy
cholo
gic
al f
unct
ions,
such
as
“mem
ory
”,
“aw
aren
ess”
, or
“inte
llig
ence
”.
Such
pro
per
ties
, th
eref
ore
, pre
sum
ably
res
ide
in t
he
org
aniz
atio
n a
nd f
unct
ionin
g o
f th
e net
work
as a
whole
, ra
ther
than
in i
ts e
lem
enta
ry p
arts
.
In o
rder
to u
nder
stan
d h
ow
the
bra
in w
ork
s, i
t th
us
bec
om
es n
eces
sary
to i
nves
tigat
e th
e
conse
quen
ces
of
com
bin
ing s
imple
neu
ral
elem
ents
in t
opolo
gic
al o
rgan
izat
ions
anal
ogous
to
that
of
the
bra
in.
We
are
ther
efore
inte
rest
ed i
n t
he
gen
eral
cla
ss o
f su
ch n
etw
ork
s, w
hic
h i
ncl
udes
the
bra
in a
s a
spec
ial
clas
s.
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
8
So
me
oth
er p
oss
ible
vie
ws
on
co
mp
uta
tio
na
l n
euro
scie
nce
P
icas
so
S
alvad
or
Dal
i
Len
nar
t G
ust
afss
on C
ours
e note
s C
SE
2330
P
age
3
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
9
Wh
at
is a
th
eory
go
od
for?
Lots
of
fact
s ar
e know
n f
rom
exper
imen
ts.
A t
heo
ry o
ffer
s
a w
ay t
o r
elat
e th
ese
fact
s to
eac
h o
ther
(a
“theo
reti
cal
fram
ework
”)
see
som
e fa
cts
as c
onse
quen
ces
of
oth
er f
acts
a w
ay t
o p
redic
t th
e outc
om
e fr
om
new
exper
imen
ts
A s
cien
ce a
ssum
es t
he
exis
tence
of
a th
eory
.
A g
ood t
heo
ry i
s a
ver
y p
ract
ical
thin
g.
A g
ood t
heo
ry s
hould
be
expre
ssed
in a
“co
mpute
r m
odel
”, t
o a
llow
for
“com
pute
r
exper
imen
ts”.
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
10
Wh
at
fact
s a
bo
ut
the
cen
tra
l n
erv
ou
s sy
stem
do
we
incl
ud
e in
a t
heo
ry?
(or
may
be
rath
er m
od
el)
Fac
ts a
bout
the
synap
se
the
neu
ron
fi
ring r
ule
s
pla
stic
ity
rule
s
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
11
We
sho
uld
in
clu
de
fact
s a
bo
ut
(i.e
. m
od
el)
the
con
nec
tiv
ity
am
on
g n
euro
ns
org
an
ized
In
six
hori
zonta
l la
yer
s (i
n c
ereb
ral
cort
ex)
in
mil
lions
of
ver
tica
l m
inic
olu
mns
per
pen
dic
ula
r to
the
six l
ayer
s
in
mac
roco
lum
ns
com
pri
sed o
f a
num
ber
of
min
icolu
mns
in
lar
ger
str
uct
ure
s in
the
neo
cort
ex
in
oth
er s
truct
ure
s in
, e.
g. ce
rebel
lum
but
we
do a
poor
job o
f it
… a
good o
pport
unit
y f
or
fundam
enta
l re
sear
ch !
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
12
Arr
an
gin
g t
he
ner
vo
us
syst
em i
n a
hie
rarc
hy
of
stu
dy
acc
ord
ing
to
Ly
tto
n:
ion
s
tran
smit
ters
an
d r
ecep
tors
spin
es,
den
dri
tes
and
sy
nap
ses
neu
ron
s
net
wo
rks
syst
ems
beh
avio
r o
r th
ou
gh
t
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
13
Lev
els
of
org
an
iza
tio
n a
cco
rdin
g t
o T
rap
pen
ber
g
(in T
.P.T
rappen
ber
g,
Fundam
enta
ls o
f C
om
puta
tional
Neu
rosc
ience
, O
xfo
rd U
niv
ersi
ty P
ress
)
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
14
Bu
t, a
ma
zin
gly
, w
e k
no
w t
ha
t V
ern
on
Mo
un
tca
stle
wa
s ri
gh
t in
19
57
:
“What
ever
the
level
in
the
pro
cess
ing h
iera
rchy
,
and t
he
par
ticu
lar
task
ther
e is
a c
om
mon
arch
itec
ture
: th
e neu
ral
colu
mns
(min
i- a
nd
mac
roco
lum
ns)
” O
nly
rar
ely
is
this
know
ledge
inco
rpora
ted
into
model
s!
Fro
m M
ountc
astl
e: ”
Th
e co
lum
nar
org
aniz
atio
n o
f th
e
neo
cort
ex”,
Bra
in 1
997,
pp. 701-7
22
Len
nar
t G
ust
afss
on pag
e
Cours
e note
s C
SE
2330
15
Ch
ap
ter
1,
Intr
od
uct
ion
, in
Ly
tto
n
T
his
chap
ter
is
w
ritt
en i
n a
good m
ood
(im
med
iate
ly o
bvio
us)
fu
ll o
f in
sights
(w
ill
hopef
ull
y g
radual
ly b
ecom
e cl
ear)
en
coura
ges
you t
o b
elie
ve
this
is
the
stuff
for
the
futu
re
bet
ter
read
by
the
studen
t th
an t
old
by
the
lect
ure
r
T
her
efo
re:
ple
ase
read
an
d e
njo
y u
nti
l nex
t le
cture
!