talk 2 baldock atlas
TRANSCRIPT
-
8/18/2019 Talk 2 Baldock Atlas
1/83
Atlas-Based Bioinformatics
Richard BaldockMRC Human Genetics Unit Institute of Genetics and Molecular MedicineEdinburgh, UK
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
2/83
R A Baldock Dundee 2012 2
eMouseAtlas - Development and Gene-Expression
GENE EXPRESSION
Carol Wicking, University of Queensland
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
3/83
R A Baldock Dundee 2012 2
eMouseAtlas - Development and Gene-Expression
GENE EXPRESSION
Carol Wicking, University of Queensland
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
4/83
R A Baldock Dundee 2012 2
eMouseAtlas - Development and Gene-Expression
TRANSGENICS
cre induced-LacZ expression
W. Hsu, University of RochesterAcridine OrangeJ. Burns
University of Bristol
APOPTOSIS
Sigolène MeilhacInstitut Pasteur
CELL LINEAGE
anti-BrdU staining J. McDearmid
McGill University
CELL DIVISION
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
5/83
R A Baldock Dundee 2012 2
eMouseAtlas - Development and Gene-Expression
TRANSGENICS
cre induced-LacZ expression
W. Hsu, University of RochesterAcridine OrangeJ. Burns
University of Bristol
APOPTOSIS
Sigolène MeilhacInstitut Pasteur
CELL LINEAGE
anti-BrdU staining J. McDearmid
McGill University
CELL DIVISION
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
6/83
R A Baldock Dundee 2012 3
eMouseAtlas Framework
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
7/83
R A Baldock Dundee 2012 3
eMouseAtlas Framework
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
8/83
R A Baldock Dundee 2012 4
VPH
Atlas-Based Infrastructures
emage
Population
Organism
Tissue
Cell
Organelle
Molecule
Basic research Clinical practice
Hudsen Virtual
Patient
Personal
Atlas
Visible
Human
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
9/83
R A Baldock Dundee 2012 5
eMouseAtlas
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
10/83
R A Baldock Dundee 2012 5
eMouseAtlas
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
11/83
R A Baldock Dundee 2012 5
eMouseAtlas
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
12/83
R A Baldock Dundee 2012 5
eMouseAtlas
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
13/83
R A Baldock Dundee 2012 6
EMAGE - current status
~22K submissions
Range Theiler 7-25
! MGI/GXD (~1,300)! Direct submission (~300)
! Large scale screens (~16K)
Repository DB: 38.4K entries
submissionsThursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
14/83
R A Baldock Dundee 2012 6
EMAGE - current status
~22K submissions
Range Theiler 7-25
! MGI/GXD (~1,300)! Direct submission (~300)
! Large scale screens (~16K)
Repository DB: 38.4K entries
submissionsThursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
15/83
R A Baldock Dundee 2012 7
EMAGE Embryo Space
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
16/83
R A Baldock Dundee 2012 7
EMAGE Embryo Space
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
17/83
R A Baldock Dundee 2012 7
EMAGE Embryo Space
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
18/83
R A Baldock Dundee 2012 8
BioAtlas - data mapping
• image collection - no mapping all spatialinterpretation left to user
• implicit mapping - data interpreted andannotated with controlled vocabulary or
ontology, image requires interpretation butsome query and pattern analysis possible -
“simple”
• explicit mapping, full spatial delineation ofinformation e.g. expression pattern.
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
19/83
R A Baldock Dundee 2012 9
BioAtlas - data mapping
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
20/83
R A Baldock Dundee 2012 9
BioAtlas - data mapping
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
21/83
R A Baldock Dundee 2012 9
BioAtlas - data mapping
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
22/83
R A Baldock Dundee 2012 10
Spatial Data Mapping
• Manual tie-point alignment (WlzWarp)! mesh-based constrained distance transform
! interactive
! arbitrary complexity
• Automated fine tuning (ITK/ANTS)
• Editor review
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
23/83
R A Baldock Dundee 2012 11
3D Data Mapping - WlzWarp
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
24/83
R A Baldock Dundee 2012 11
3D Data Mapping - WlzWarp
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
25/83
R A Baldock Dundee 2012 11
3D Data Mapping - WlzWarp
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
26/83
R A Baldock Dundee 2012 12
3D Mapping - Wnt signalling pathway
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
27/83
R A Baldock Dundee 2012 12
3D Mapping - Wnt signalling pathway
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
28/83
R A Baldock Dundee 2012 13
3D Visualisation
• Applications:! SectionBrowser, JAtlasViewer
! Format conversion -> a.n.other
• Browser-Based! canned views & movies
! Tiled zoom-viewer
! Extended to 3D protocol (IIP3D)
! Multi-layer
! Interactive overlays
! WebGL
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
29/83
R A Baldock Dundee 2012 14
OME Project Objectives
To use and extend OMERO to meet mouse atlas andIGMM requirements:
•Embed woolz images
•Sparse reconstruction & mapping•large image data
•Annotation overlay and visualisation
•3D mapping - e.g. OPT images
•IGMM imaging - archiving and analysis
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
30/83
R A Baldock Dundee 2012 15
Woolz images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
31/83
R A Baldock Dundee 2012 15
Woolz images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
32/83
R A Baldock Dundee 2012 15
Woolz images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
33/83
R A Baldock Dundee 2012 15
Woolz images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
34/83
R A Baldock Dundee 2012 15
Woolz images
• 330K lines Ansi C code
• 184K lines application code
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
35/83
R A Baldock Dundee 2012 16
Woolz Images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
36/83
R A Baldock Dundee 2012 16
Woolz Images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
37/83
R A Baldock Dundee 2012 16
Woolz Images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
38/83
R A Baldock Dundee 2012 16
Woolz Images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
39/83
R A Baldock Dundee 2012 16
Woolz Images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
40/83
R A Baldock Dundee 2012 16
Woolz Images
• Arbitrary bounding box
• Interval coding - compact• Fast binary & morphological operations
• Separation of domain from values enables valuedata sharing
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
41/83
R A Baldock Dundee 2012 17
Woolz Images
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
42/83
R A Baldock Dundee 2012 17
Woolz Images
• value types: ubyte, short, int, float,double, rgba, bitmap• Value table can be shared by manyobjects
• Compact coding without compression• Iterators to navigate data• Tiled data can be memory mappedfor very fast access - minimal coding
change
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
43/83
R A Baldock Dundee 2012 17
Woolz Images
• value types: ubyte, short, int, float,double, rgba, bitmap• Value table can be shared by manyobjects
• Compact coding without compression• Iterators to navigate data• Tiled data can be memory mappedfor very fast access - minimal coding
change
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
44/83
R A Baldock Dundee 2012 18
Woolz image objects
• Polylines, boundary lists• histograms
• meshes - 2D & 3D
• transforms! affine
! basis function
! mesh
! conforming mesh
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
45/83
R A Baldock Dundee 2012 18
Woolz image objects
• Polylines, boundary lists• histograms
• meshes - 2D & 3D
• transforms! affine
! basis function
! mesh
! conforming mesh
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
46/83
R A Baldock Dundee 2012 18
Woolz image objects
• Polylines, boundary lists• histograms
• meshes - 2D & 3D
• transforms! affine
! basis function
! mesh
! conforming mesh
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
47/83
R A Baldock Dundee 2012 18
Woolz image objects
• Polylines, boundary lists• histograms
• meshes - 2D & 3D
• transforms! affine
! basis function
! mesh
! conforming mesh
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
48/83
R A Baldock Dundee 2012 18
Woolz image objects
• Polylines, boundary lists• histograms
• meshes - 2D & 3D
• transforms! affine
! basis function
! mesh
! conforming mesh
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
49/83
R A Baldock Dundee 2012 19
Sparse Image Reconstruction & Mapping
•EurExpress project
! 19.5K in situ probes, 350K images
! ~24 images per in situ probe
! ~0.5 micron resolution in plane
! 150 micron plane separation
• EmbryoExpress - 20K images
• Allen Brain Atlas - 200K images
• Require automation - Advanced Normalisation Tool (ANTs)! sparse image, matching mask
! Full 3D affine then non-linear warping.
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
50/83
R A Baldock Dundee 2012 20
• Semi-automatic reconstruction
• Automated segmentation
•Manual mapping
• 2D pseudo wholemount
• full 3D in progress
Pseudo Wholemount Mapping to Emap - done
Thursday, 16 February 2012
P d Wh l M E d
-
8/18/2019 Talk 2 Baldock Atlas
51/83
R A Baldock Dundee 2012 20
• Semi-automatic reconstruction
• Automated segmentation
•Manual mapping
• 2D pseudo wholemount
• full 3D in progress
Pseudo Wholemount Mapping to Emap - done
Thursday, 16 February 2012
P d Wh l M i E d
-
8/18/2019 Talk 2 Baldock Atlas
52/83
R A Baldock Dundee 2012 20
• Semi-automatic reconstruction
• Automated segmentation
•Manual mapping
• 2D pseudo wholemount
• full 3D in progress
Pseudo Wholemount Mapping to Emap - done
Thursday, 16 February 2012
P d Wh l M i E d
-
8/18/2019 Talk 2 Baldock Atlas
53/83
R A Baldock Dundee 2012 20
• Semi-automatic reconstruction
• Automated segmentation
•Manual mapping
• 2D pseudo wholemount
• full 3D in progress
Pseudo Wholemount Mapping to Emap - done
Thursday, 16 February 2012
3D M i
-
8/18/2019 Talk 2 Baldock Atlas
54/83
R A Baldock Dundee 2012 21
3D Mapping to emap
Thursday, 16 February 2012
3D M i
-
8/18/2019 Talk 2 Baldock Atlas
55/83
R A Baldock Dundee 2012 21
3D Mapping to emap
Thursday, 16 February 2012
3D M i t
-
8/18/2019 Talk 2 Baldock Atlas
56/83
R A Baldock Dundee 2012 21
3D Mapping to emap
Thursday, 16 February 2012
3D M i t
-
8/18/2019 Talk 2 Baldock Atlas
57/83
R A Baldock Dundee 2012 21
3D Mapping to emap
Thursday, 16 February 2012
3D M i t
-
8/18/2019 Talk 2 Baldock Atlas
58/83
R A Baldock Dundee 2012 21
3D Mapping to emap
Thursday, 16 February 2012
Large Image Data
-
8/18/2019 Talk 2 Baldock Atlas
59/83
R A Baldock Dundee 2012 22
Large Image Data
• Single reconstructions already 30+GB• New EM embryo data ~0.5TB
• OPT data - small (200MB) but many - 5K
• Typical requirement to browse as sections• Require arbitrary angle re-sectioning
• BLB - want to browse online using no more thata web-browser
Thursday, 16 February 2012
Tiled Image Servers
-
8/18/2019 Talk 2 Baldock Atlas
60/83
R A Baldock Dundee 2012 23
Tiled Image Servers
[maps.google.com]
[Shawn Mikula, Issac Trotts, James M. Stone, and Edward G. Jones,Internet-Enabled High-
Resolution Brain Mapping and Virtual Microscopy, Neuroimage, vol 35(1), p. 11, 2007]
Thursday, 16 February 2012
Sectioning Parameters
-
8/18/2019 Talk 2 Baldock Atlas
61/83
R A Baldock Dundee 2012 24
Sectioning Parameters
• Angles:
! Pitch, Yaw, Roll
• Position:
! Fixed point (f) &distance
• Scale
• Tiling depends onorientation & scale
Thursday, 16 February 2012
IIP3D Extensions
-
8/18/2019 Talk 2 Baldock Atlas
62/83
R A Baldock Dundee 2012 25
IIP3D - Extensions
Thursday, 16 February 2012
IIP3D
-
8/18/2019 Talk 2 Baldock Atlas
63/83
R A Baldock Dundee 2012 26
IIP3D
Thursday, 16 February 2012
IIP3DWeb App Architecture
-
8/18/2019 Talk 2 Baldock Atlas
64/83
R A Baldock Optos PLC, 22/3/11 27
IIP3D Web-App Architecture
Thursday, 16 February 2012
IIP3DWeb App Architecture
-
8/18/2019 Talk 2 Baldock Atlas
65/83
R A Baldock Optos PLC, 22/3/11 27
IIP3D Web-App Architecture
DB image server
Remote Object
protocol
Thursday, 16 February 2012
Performance
-
8/18/2019 Talk 2 Baldock Atlas
66/83
R A Baldock Optos PLC, 22/3/11 28
Performance
Thursday, 16 February 2012
Performance
-
8/18/2019 Talk 2 Baldock Atlas
67/83
R A Baldock Optos PLC, 22/3/11 28
Performance
Thursday, 16 February 2012
IIP3D Clients
-
8/18/2019 Talk 2 Baldock Atlas
68/83
R A Baldock Optos PLC, 22/3/11 29
IIP3D Clients
• Javascript! Ajax
! MVC design, uses MooTools & Yahoo Widgets
• Multi-section at high resolution
• Volume overlays
• Anatomy & gene-expression overlays
• Controls! viewing angles - virtual sections
! zoom
! distance, fixed point
! section locator & view angle feedback
! distance measurement, query by image value
! ......
Thursday, 16 February 2012
Annotation Overlay & Visualisation
-
8/18/2019 Talk 2 Baldock Atlas
69/83
R A Baldock Dundee 2012 30
Annotation Overlay & Visualisation
• Atlas models include ontology and domains -image regions for anatomical terms. Typicallyexclusive
• Gene-expression data, open ended, multipleoverlapping patterns
Thursday, 16 February 2012
Layers Overlays & Indexed Objects
-
8/18/2019 Talk 2 Baldock Atlas
70/83
R A Baldock Optos PLC, 22/3/11 31
Layers, Overlays & Indexed Objects
• Multiple layers via html image overlay including opacity! currently layers constrained to identical domains
• Regional overlays using an indexed object! currently using “compound object” - regions can overlap
! TBD - standard indexed volume - regions spatially exclusive
Thursday, 16 February 2012
Image Processing IIP3D extensions
-
8/18/2019 Talk 2 Baldock Atlas
71/83
R A Baldock Optos PLC, 22/3/11 32
Image Processing IIP3D extensions
Thursday, 16 February 2012
IIP3D Examples
-
8/18/2019 Talk 2 Baldock Atlas
72/83
R A Baldock Dundee 2012 33
IIP3D Examples
Thursday, 16 February 2012
IIP3D Examples
-
8/18/2019 Talk 2 Baldock Atlas
73/83
R A Baldock Dundee 2012 33
IIP3D Examples
Thursday, 16 February 2012
IIP3D Examples
-
8/18/2019 Talk 2 Baldock Atlas
74/83
R A Baldock Dundee 2012 33
IIP3D Examples
Thursday, 16 February 2012
IIP3D Examples
-
8/18/2019 Talk 2 Baldock Atlas
75/83
R A Baldock Dundee 2012 33
IIP3D Examples
Thursday, 16 February 2012
WebGL
-
8/18/2019 Talk 2 Baldock Atlas
76/83
R A Baldock Dundee 2012 34
•IIP3D viewer extension to 3D visualisation
! Use X3Dom - Javascript binding to X3D
• navigation feedback
• Anatomy visualisation! see demo
• Extend to 4D
Thursday, 16 February 2012
3D mapping - WlzWarp
-
8/18/2019 Talk 2 Baldock Atlas
77/83
R A Baldock Toshiba Medical Visualisation Systems Europe 21/4/11
3D mapping WlzWarp
•Allows placement of landmarks (points of
equivalence) on source and target on volume
renders instead of isosurfaces
• On-the-fly feedback of warping progress
• Uses constrained distance transform (CDT) inwarping• Woolz, Qt, Coin3D(+SIMVoleon)• Linux, OS X, Windoes
• Open Source (Free!)
Thursday, 16 February 2012
-
8/18/2019 Talk 2 Baldock Atlas
78/83
3D mapping - WlzWarp
-
8/18/2019 Talk 2 Baldock Atlas
79/83
R A Baldock Toshiba Medical Visualisation Systems Europe 21/4/11
3D mapping WlzWarp
•Allows placement of landmarks (points of
equivalence) on source and target on volume
renders instead of isosurfaces
• On-the-fly feedback of warping progress
• Uses constrained distance transform (CDT) inwarping• Woolz, Qt, Coin3D(+SIMVoleon)• Linux, OS X, Windoes
• Open Source (Free!)
Thursday, 16 February 2012
Lineage & the Brain
-
8/18/2019 Talk 2 Baldock Atlas
80/83
R A Baldock Dundee 2012 36
g
•Embryo development 7-5-8.5 dpc
• 11-fold growth of ectoderm cell layer
• complex folding
• lineage clones via HRP cell labelling(iontophoresis)
• pattern recognition very difficult
• conformal transform of ectodermal surface to “flat-map”
Thursday, 16 February 2012
Lineage & the Brain
-
8/18/2019 Talk 2 Baldock Atlas
81/83
R A Baldock Dundee 2012 37
g
A Camus, K Lawson, W Hill et al
Development 2011
Thursday, 16 February 2012
Lineage & the Brain
-
8/18/2019 Talk 2 Baldock Atlas
82/83
R A Baldock Dundee 2012 37
g
A Camus, K Lawson, W Hill et al
Development 2011
Thursday, 16 February 2012
eMouseAtlas
-
8/18/2019 Talk 2 Baldock Atlas
83/83
MRC Human Genetics Unit, Edinburgh
EMAGE:Chris Armit
Shanmugasundaram VenkataramanLorna RichardsonPeter Stevenson
EMAP:Albert Burger
Bill HillNick BurtonYiya YangJulie MossLiz Graham
Allyson Ross
Duncan DavidsonRichard Baldock
Other
Jonathan BardMatt Kaufman
NIH GUDMAP:Simon Harding
Bernard HaggertyKoosum Roochum
BBSRC:Mike Wicks
FP7 RICORDO:Xu Gu
Wellcome OME:Jianguo Rao
University of Edinburgh
Douglas ArmstrongNestor Milyeav
Institute of Human Genetics, Newcastle University
Susan LindsayJanet Kerwin
Colin SemplePedro Coutinho
Ian Overton
Heriot Watt University
Albert Burger