eman2 - baylor college of medicine

57
EMAN2 1 Monday, March 14, 2011

Upload: others

Post on 16-Feb-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EMAN2 - Baylor College of Medicine

EMAN2

1Monday, March 14, 2011

Page 2: EMAN2 - Baylor College of Medicine

Changes to Tutorial

Small set for ribosome -> ~2000 ptcl

Use far from focus images for the small sets.

Note that many tasks really need a large/high resolution monitor.

2Monday, March 14, 2011

Page 3: EMAN2 - Baylor College of Medicine

EMAN2 Architecture

C++ Core

Python Core

Command-Line Programs

High-Level Programs

Workflow Interface

Integrated DesktopEase of Use

Flexibility

3Monday, March 14, 2011

Page 4: EMAN2 - Baylor College of Medicine

EMAN2 Architecture

C++ Core

Python Core

Command-Line Programs

High-Level Programs

Workflow Interface

Integrated Desktop

SPARX

Qt & OpenGL

GUI Tools

GUI Core

4Monday, March 14, 2011

Page 5: EMAN2 - Baylor College of Medicine

MRC R/W IMAGIC R/W

SPIDER R/W HDF5 R/W

PIF R/W ICOS R/W

VTK R/W PGM R/W

Amira R/W Xplor W

Gatan DM2 R Gatan DM3 RTIFF R/W Scans-a-lot R

LST R/W PNG R/W

Video-4-Linux R JPEG W

File FormatsBDB +

5Monday, March 14, 2011

Page 6: EMAN2 - Baylor College of Medicine

BDBEmbedded database

No server, easy maintenance

Fast

Multiple processors on 1 machine - No file corruption !

Arbitrary metadata (header information)

Widely used (now owned by Oracle, but free)

EMAN2DB directories

6Monday, March 14, 2011

Page 7: EMAN2 - Baylor College of Medicine

BDB WarningsPLEASE READ:

http://blake.bcm.edu/emanwiki/EMAN2/DatabaseWarning

e2bdb.py -c

Do NOT move files within an EMAN2DB directory around !

If you need to remove files from an EMAN2DB directory: e2bdb.py -c

Do NOT delete or rename directories containing EMAN2DB directories without running e2bdb.py -c first.

If you DO get a message saying there is a database error: e2bdb.py -c

Beware of network mounted filesystems.

7Monday, March 14, 2011

Page 8: EMAN2 - Baylor College of Medicine

Extensible CoreType Description #

Processor Generic image processing algorithms, filters, masks, thresholds, etc. 175

Aligner Algorithms used to align 2 images or volumes to each other 22

Projector Routines to generate 2-D projections of 3-D objects 6

Reconstructor Routines to reconstruct 3-D objects from 2-D projections 11

Cmp Similarity metrics used to compare two images or volumes 10

Averager Average together stacks of images in various ways 7

Analyzer Perform various operations on sets of images, such as classification or PCA 6

Orientgen Routines describing how projections cover the asymmetric triangle 6

8Monday, March 14, 2011

Page 9: EMAN2 - Baylor College of Medicine

Processors(categories & examples)

filter

filter.lowpass.gauss

filter.homomorphic.tophat

mask

mask.sharp

mask.gaussian

math

math.sqrt

math.laplacian

misc

misc.localnorm

normalize

normalize

normalize.edgemean

testimage

testimage.scurve

threshold

threshold.binary

threshold.clampminmax

xform

xform.centerofmass

xform.fourierorigin.tocenter

9Monday, March 14, 2011

Page 10: EMAN2 - Baylor College of Medicine

Similarity Metrics(cmp)

With Default options, SMALLER -> more similar

dot - dot product (negative by default)frc - Fourier ring correlation (weighted)optvariance - ‘optimized variance’ (EMAN1)phase - mean phase errorquadmindot - Worst of quadrant dot productssqeuclidean - sum (a-b)2/n

10Monday, March 14, 2011

Page 11: EMAN2 - Baylor College of Medicine

ProgramsCommand-Line Programs (EMAN2)

syntax:

e2<name>.py --help

e2<name>.py <file> [--option=value] [--option] [-O]

<> - required parameter

[] - optional parameter

11Monday, March 14, 2011

Page 12: EMAN2 - Baylor College of Medicine

GUIe2workflow.py - Primary workflow dialog

e2display.py - General image/volume display

e2boxer.py - Interactive particle picker

e2helixboxer.py - Filament picker

e2tomoboxer.py - Interactive tomogram picker

e2ctf.py - Various CTF operations

e2eulerxplor.py - Look at particle orientations

e2simmxxplor.py - Evaluate how well orientations can be determined

e2cmpxplor.py - Evaluate how different similarity metrics work

12Monday, March 14, 2011

Page 13: EMAN2 - Baylor College of Medicine

High Level Programse2refine2d.py - reference free class-averagese2initialmodel.py - Make initial models from a few class-averagese2refine.py - Standard single particle analysis 3-D refinemente2eotest.py - even/odd test for resolution assessemente2refinevariance.py - Compute a variance mape2refinemulti.py - multiple map simultaneous refinemente2classifyligand.py - Split data into 2 groups based on 2 modelse2refinetofrealign.py - Set up for a Frealign run based on an EMAN2 refinemente2runfrealign.py - Execute Frealigne2refinefromfrealign.py - Process the results of a Frealign run

13Monday, March 14, 2011

Page 14: EMAN2 - Baylor College of Medicine

Utility Programs

e2version.py - Display version infoe2speedtest.py - Test machine performancee2help.py - Documentation for modular functionse2bdb.py - database manipulation and queryinge2iminfo.py - general image information toole2proc2d.py - 2d image processing of stacks and single imagese2proc3d.py - 3d image processing of 3-D stacks and single volumese2parallel.py - Used for some parallelism operationse2.py - Python command-line for EMAN2

14Monday, March 14, 2011

Page 15: EMAN2 - Baylor College of Medicine

Which to Choose ?

Get started on the tutorial

GroEL

mm-cpn

e-coli ribosome + SecY

15Monday, March 14, 2011

Page 16: EMAN2 - Baylor College of Medicine

16Monday, March 14, 2011

Page 17: EMAN2 - Baylor College of Medicine

M(s) = F(s) C(s)2 E(s)2 + N(s)2

N(s)

C(s) E(s) + N(s)

CTF Correction

17Monday, March 14, 2011

Page 18: EMAN2 - Baylor College of Medicine

Measured Image Ideal Particle Random Noise

18Monday, March 14, 2011

Page 19: EMAN2 - Baylor College of Medicine

19Monday, March 14, 2011

Page 20: EMAN2 - Baylor College of Medicine

20Monday, March 14, 2011

Page 21: EMAN2 - Baylor College of Medicine

21Monday, March 14, 2011

Page 22: EMAN2 - Baylor College of Medicine

22Monday, March 14, 2011

Page 23: EMAN2 - Baylor College of Medicine

23Monday, March 14, 2011

Page 24: EMAN2 - Baylor College of Medicine

M(s)2

F(s) C(s)2 E(s)2 + N(s)2

24Monday, March 14, 2011

Page 25: EMAN2 - Baylor College of Medicine

CTF Correction in EMAN2

25Monday, March 14, 2011

Page 26: EMAN2 - Baylor College of Medicine

e2ctf demo

26Monday, March 14, 2011

Page 27: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

27Monday, March 14, 2011

Page 28: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

28Monday, March 14, 2011

Page 29: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

29Monday, March 14, 2011

Page 30: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

30Monday, March 14, 2011

Page 31: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

31Monday, March 14, 2011

Page 32: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

32Monday, March 14, 2011

Page 33: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

Determine Particle

Orientation

?

33Monday, March 14, 2011

Page 34: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

Orientation of Average

34Monday, March 14, 2011

Page 35: EMAN2 - Baylor College of Medicine

Initial 3D Model

Uniform Projections

Build New 3D Model

Final 3D Model

Align and Average Classes

Classify Particles

Particle Images

Global Minimization

35Monday, March 14, 2011

Page 36: EMAN2 - Baylor College of Medicine

Model Bias ?

36Monday, March 14, 2011

Page 37: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toNoisyBase

37Monday, March 14, 2011

Page 38: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toNoisy (~10% contrast)Base

38Monday, March 14, 2011

Page 39: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toBase Noisy (~10% contrast)

39Monday, March 14, 2011

Page 40: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toNoisyBase

40Monday, March 14, 2011

Page 41: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toNoisyBase

Iter x4

41Monday, March 14, 2011

Page 42: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toNoisyBase

Iter x8

42Monday, March 14, 2011

Page 43: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toBase Noisy (~10% contrast)

43Monday, March 14, 2011

Page 44: EMAN2 - Baylor College of Medicine

Model Bias

25 100 250 1000 2000

Align toNoisyBase

Iter x4

44Monday, March 14, 2011

Page 45: EMAN2 - Baylor College of Medicine

4096 Particles of Noise

refine 6 mask=56 hard=90 sym=d7 ang=1.6071 pad=160 xfiles=2,800,99 amask=15,.9,16 phasecls classkeep=10 sep=3

How About 3-D ?

45Monday, March 14, 2011

Page 46: EMAN2 - Baylor College of Medicine

Initial Model 1 Iter. 2 Iter.

3 Iter. 4 Iter. 5 Iter.

no iteration

46Monday, March 14, 2011

Page 47: EMAN2 - Baylor College of Medicine

47Monday, March 14, 2011

Page 48: EMAN2 - Baylor College of Medicine

Initial Model 1 Iter. 2 Iter.

3 Iter. 4 Iter.

1 iteration

48Monday, March 14, 2011

Page 49: EMAN2 - Baylor College of Medicine

Initial Model 1 Iter. 2 Iter.

3 Iter. 4 Iter.

6 iterations

49Monday, March 14, 2011

Page 50: EMAN2 - Baylor College of Medicine

Initial Model 1 Iter. 2 Iter.

3 Iter. 4 Iter.

6 iterations(8 A lowpass)

50Monday, March 14, 2011

Page 51: EMAN2 - Baylor College of Medicine

51Monday, March 14, 2011

Page 52: EMAN2 - Baylor College of Medicine

(In EMAN) use classiter>3 for a few rounds

Use several different (random) starting models and insure that you get a good answer

Compare 3D models with results of 2D analysis

How Do we Stop This ?

52Monday, March 14, 2011

Page 53: EMAN2 - Baylor College of Medicine

53Monday, March 14, 2011

Page 54: EMAN2 - Baylor College of Medicine

9.3, 8.8, 8.2 Å

8.2, 7.9, 7.1 Å

???

Best MapWorst Map

54Monday, March 14, 2011

Page 55: EMAN2 - Baylor College of Medicine

9.3, 8.8, 8.2 Å

8.2, 7.9, 7.1 Å

Adding Noise

55Monday, March 14, 2011

Page 56: EMAN2 - Baylor College of Medicine

10.9, 10.1 Å

8.4, 8.4 Å

Adding Noise with Classiter

56Monday, March 14, 2011

Page 57: EMAN2 - Baylor College of Medicine

Acknowledgements

Supported by NIH Roadmap Initiative, NCRR, NIGMS, and the Welch Foundation.

Graphics produced using UCSF Chimera and EMANimator.

BCM • David Woolford• Guang (Grant) Tang• Liwei Peng• Ian Rees• Phil Baldwin• Deepy Mann• Wen Jiang (Purdue)

Via SPARX•Pawel Penczek (UTH)•Wei Zhang (UTH)•Zhengfan Yang (UTH)•Julien Bert (UTH)•Stefan Raunser (MPI)•Christian Spahn (Charité)•Justus Loerke (Charité)•Chao Yang (LBNL)

EMAN2

57Monday, March 14, 2011