the best of both worlds: speeding up drug research with mongodb & oracle (genentech)

34
Speeding Up Drug Research with MongoDB Introducing MongoDB into an RDBMS Environment

Upload: mongodb

Post on 12-May-2015

664 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Speeding Up Drug Research with MongoDB

Introducing MongoDB

into an RDBMS Environment

Page 2: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Doug Garrett

• Genentech Research and Early Development (gRED)

Bioinformatics and Computational Biology (B&CB)

Software Engineer

Page 3: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

gRED: Disease and Drug Research

Page 4: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Bioinformatics Customers: Scientists

Page 5: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Most of All: Patients

Page 6: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Bioinformatics: Not Your Typical IT

Page 7: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

MongoDB

• Not just about big dataMongoDB has a flexible schema

• Not just about new systemsMongoDB easily integrates with RDBMS

• Not just about softwareIt’s about saving lives

Page 8: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Time to Introduce New Genetic TestW

eeks

Page 9: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Drug Development Process

9

NewDrug

Page 10: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Drug Development Process

10

NewDrug

Page 11: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Drug Development Process

11

NewDrug

Page 12: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

New Mouse Model - Genetic Testing

File (csv)

Page 13: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

J. Colin Cox Sept. 2013 Presentation

Growth In Genetic Testing(t

hou

san

ds)

Samples

Genotypes

Page 14: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

6 months 3 months

Page 15: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

6 months 3 months

Page 16: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

6 months 3 months

Page 17: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)
Page 18: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)
Page 19: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Varies by Genetic Test

Page 20: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Case Study: New Genetic Test Instrument

20

New Instrument!

Impact?

Bio-RadCFX384

ABI7900HT

Page 21: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Case Study: New Genetic Test Instrument

21

New Instrument!

Impact?

DB Schema? No Impact

Project? 3 weeks

Bio-RadCFX384

ABI7900HT

Page 22: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Going Live…

22

Page 23: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Failure Mode

Page 24: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Failure Mode

Page 25: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Synch MongoDB with RDBMS

db.NewRdbmsMongoId .find().forEach(function(doc){ db. TestResults .update({'_id':doc._id}, {'$inc':{useCount:1}})})

db. db. TestResults.remove({'useCount':0});

Page 26: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

But Wait! There’s More…

• Flexible data collection

Page 27: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Load CSV to MongoDB

"_id" : ObjectId(“…."),“plate_wells” : [ { "Well" : "A01", "Sample" : "308…", … }]

Page 28: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Add Fields to CSV

"_id" : ObjectId(“…."),“plate_wells” : [ { "Well" : "A01", "Sample" : "308…", … "New1" : "New Value" }]

Page 29: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Future – What If…

Avoiding the typical “Catch 22”:

1.Is it worth collecting the data?

2.What is the value of the data?

3.Need the data to find the value

Page 30: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Future Analytics

MongoDB Aggregation Framework

RMatlab

Page 31: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

MongoDB Aggregation Framework

40% Discount Thru July 4Use Code: mdbdgcf

Page 32: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

Under Discussion

CSV

JSON

XML

Other

Lab Instruments

GovernmentAgencies

Third PartySources

MongoDB

Load to RDBMS

Process Directly

Page 33: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

MongoDB

• Not just about big dataMongoDB has a flexible schema

• Not just about new systemsMongoDB easily integrates with RDBMS

• Not just about softwareIt’s about saving lives

Page 34: The Best of Both Worlds: Speeding Up Drug Research with MongoDB & Oracle (Genentech)

“You better do it fast”

For my Father

Who I hope would have enjoyed this talk