christopher mitchell the cooper union fluorescent microscopy, eigenobjects, and the cellular density...
TRANSCRIPT
![Page 1: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/1.jpg)
Christopher MitchellThe Cooper Union
Fluorescent Microscopy, Eigenobjects, and the
Cellular Density Project
Christopher MitchellThe Cooper UnionStevens REU 2007
![Page 2: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/2.jpg)
Christopher MitchellThe Cooper Union
Overview
Previous Work: Cell Density & Fluorescent Microscopy
Outline of Project Methodology
How Eigenobjects Work
Applying Eigenobjects to Nuclear Density
The Future of the CDP
Note to any future presenters: most of the content is in the accompanying Slide Notes
![Page 3: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/3.jpg)
Christopher MitchellThe Cooper Union
Fluorescent Microscopy
Attach marker chemical to protein Take picture of tissue Analyze marker distribution and
concentration
![Page 4: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/4.jpg)
Christopher MitchellThe Cooper Union
Fluorescent Microscopy Uses
Examine tissue structure Identify malignant cellular growth Bind to nuclear protein to view
distribution of nuclei in tissue High density indicative of pre-malignant
growth
![Page 5: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/5.jpg)
Christopher MitchellThe Cooper Union
Example of Fluorescent Microscopy
Example from webpage analyzed for this presentation:
![Page 6: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/6.jpg)
Christopher MitchellThe Cooper Union
Cellular Attributes
Normal Cells Well-organized Moderate density Specific protein
distribution
Malignant Cells Chaotic
arrangement High density Different protein
distribution
![Page 7: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/7.jpg)
Christopher MitchellThe Cooper Union
Advantages of Fluorescent Microscopy
Less invasive Earlier detection More precise identification
![Page 8: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/8.jpg)
Christopher MitchellThe Cooper Union
The Future of Fluorescent Microscopy
More precise tagging of proteins to identify structures
Ability to tag multiple proteins to gather more information about each cell
Greater understanding of inter-cell and intra-cell structure as a cause and symptom of malignant cellular growth
![Page 9: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/9.jpg)
Christopher MitchellThe Cooper Union
Project Methodology
Application of some fluorescent microscopy methods to photographic microscopy
Primarily uses variance in cellular density and nuclear proportions between normal and malignant cells
Mechanical identification of suspect samples for further human or other analysis
![Page 10: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/10.jpg)
Christopher MitchellThe Cooper Union
Advantages ofPhotographic Microscopy Easier to mechanically classify Cheaper to acquire images Human-readable with minimal training
![Page 11: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/11.jpg)
Christopher MitchellThe Cooper Union
Disadvantages ofPhotographic Microscopy Less cellular detail Fewer unique indicators of normal or
malignant nature
![Page 12: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/12.jpg)
Christopher MitchellThe Cooper Union
Nuclear Identification Methods
Wavelet method Signal processing-based (mathematical) solution
Eigencell method Computer science (algorithmic) solution
![Page 13: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/13.jpg)
Christopher MitchellThe Cooper Union
The Signals Method
Increase image contrast Edge detection using wavelets Count nuclei and create density array Apply statistical analysis
![Page 14: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/14.jpg)
Christopher MitchellThe Cooper Union
The Algorithmic Method
Creating training set of eigennuclei Apply image space > eigennucleus space
> image space transform, find Mean Squared Errors
Identify and count cells Apply statistical analysis
![Page 15: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/15.jpg)
Christopher MitchellThe Cooper Union
Method Evaluation
For scope of project, algorithmic method chosen
Easier to code, easier to understand without a Signals background
More precise even though less efficient
![Page 16: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/16.jpg)
Christopher MitchellThe Cooper Union
Using Eigenobjects
To create a training array of eigenobjects, need to start with several training images.
All images must be the same dimensions Example training set:
Varied sizes and rotations, but all 24x24 pixel images
![Page 17: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/17.jpg)
Christopher MitchellThe Cooper Union
Using Eigenobjects 2
Next, all images packed from rectangles into rows
Eigenvectors created from each row and sorted by associated eigenvalues
![Page 18: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/18.jpg)
Christopher MitchellThe Cooper Union
Using Eigenobjects 3
In order to streamline the process, the outer product of each row is taken and packed
Yields square, symmetric matrix Each row multiplied by original image
produces one eigenobject
![Page 19: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/19.jpg)
Christopher MitchellThe Cooper Union
Using Eigenobjects 4
Trained set of eigenobjects is complete and packed into a single array for comparison
To compare an image to the training set, it must be converted to object space and back to image space.
Examples of eigenfaces, eigenobjects made from faces:
![Page 20: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/20.jpg)
Christopher MitchellThe Cooper Union
Using Eigenobjects 5
Results of image > object > image space transformations:
To determine if the image is the same type of object as training set, take Mean Squared Error (MSE) between input and output
![Page 21: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/21.jpg)
Christopher MitchellThe Cooper Union
Finding Objects in an Image
Method can be applied to find objects in a larger image
All possible subimages of training set dimensions taken, MSEs calculated
Threshold-filtered to find objects
![Page 22: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/22.jpg)
Christopher MitchellThe Cooper Union
Applications to Nuclear Density and the CDP
Using eigennuclei, center of all cells in microscope image can be found
Image broken into regions, number of cells in each region found
Statistical analysis to determine cancer presence
![Page 23: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/23.jpg)
Christopher MitchellThe Cooper Union
The Future of the CDP
Optimizations Multipass approach
Scaling/rotation
Further identification metrics
![Page 24: Christopher Mitchell The Cooper Union Fluorescent Microscopy, Eigenobjects, and the Cellular Density Project Christopher Mitchell The Cooper Union Stevens](https://reader036.vdocument.in/reader036/viewer/2022070404/56649f385503460f94c5490f/html5/thumbnails/24.jpg)
Christopher MitchellThe Cooper Union
References Cytodiagnosis of Cancer Using Acridine Orange with Fluorescent Microscopy
(http://caonline.amcancersoc.org/cgi/reprint/10/4/118)
New Cell Imaging Method Identifies Aggressive Cancers Early (http://www.sciencedaily.com/releases/2006/03/060307085017.htm)
The Cellular Density Project (http://beta.cemetech.net/projects/item.php?id=1)
Eigenfaces Group – Algorithmics(http://www.owlnet.rice.edu/~elec301/Projects99/faces/algo.html)
Eigenfaces (http://www.cs.princeton.edu/~cdecoro/eigenfaces/)