big and bigger: big data in the pharma industry 2014 tt presentations/tt07.pdf · big data in the...

22
12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 1 Entimo AG Big and Bigger: Big Data in the Pharma Industry

Upload: volien

Post on 05-Feb-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 1

Entimo AG

Big and Bigger: Big Data in the Pharma Industry

Page 2: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Agenda

§  Big Data Characteristics §  Big Data Sources in Pharma §  Project Specifics §  Process §  Analytical Approaches and Insights §  Technological Constrains §  New Age §  Achievements/Conclusions

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 2

Page 3: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Definitions and Characteristics

§  Wikipedia: §  “Big data usually includes data sets with sizes

beyond the ability of commonly used software tools to capture, curate, manage, and process data within a tolerable elapsed time”

§  Gartner: §  “Big data is high-volume, high-velocity and

high-variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making” + variablity = complexity

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 3

Big Data is a moving target!

Page 4: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Dimensions

§  Industries: §  Lufthansa: 40 years of full traffic information

available for online queries §  Facebook: 300 petabytes** §  Ebay.com: 47.5 PB data warehouse + 40 PB

Hadoop cluster* §  Pharma:

§  Why leaping behind?

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 4

*Source: http://en.wikipedia.org/wiki/Big_data ** Source: https://www.facebook.com/notes/facebook-engineering/presto-interacting-with-petabytes-of-data-at-facebook/10151786197628920

Page 5: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Why Big Data Processing in Pharma?

§  Driving Factors: §  Pressure for faster innovation / controlled risks §  Interconnected world with fast-spreading

diseases §  Outcomes-based reimbursement §  Protection from drug theft §  Better monitoring of the social media for brand

protection

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 5

Page 6: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Big Data Sources

§  Claim data §  Patient registries §  Electronic health records §  Administrative data §  Population health surveys…

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 6

Slide: Greg Moody „Powering Holistic Data Review and Decision Making Using Visual Analytics “

Page 7: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Project Setup

§  Objectives: §  Implement a unified system to manage the

business workflows including program code and data for research and analytics

§  Enable collaboration, knowledge sharing, and reuse of artifacts

§  Provides annotation capabilities, project metadata management, search, indexing, auditing, security, and versioning

§  Handle TD data volumes with good performance

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 7

Page 8: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Common Project Traits

§  Duration: 1 day to several months §  Stakeholders: Clinical, Medical, Marketing,

Manufacturing… §  Data Volumes:

§  Identify and retrieve study patients - TB §  Processing of these data - GB §  Retrieve relevant data from source - TB §  Process data to create analytic files - GB §  Analytic datasets - MB/GB

§  Outputs: Data, graphics 12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 8

Page 9: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Top-Level Scientific Process

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 9

Capture Request

Gather Info

Create Design

Perform Analysis

Finalize Results

Publish and

Archive Project

Page 10: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Metadata Layer - Project Attributes

§  Request: §  Project Status, Project Description, Project Focus,

Project Type, Rationale, Research Question, Business Purpose…

§  Design: §  Protocol, Study Objectives, Study Rationale, Study

Design, Study Population, Data Collection Methods, Sample Size/Power, Limitations/Strengths…

§  Analysis: §  Drug Codes, Diagnoses, Treatment Patterns,

Conditions, Trends, Code Comments, Methods Used §  Outcomes:

§  Methods, Code…

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 10

Page 11: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Access Approaches (1)

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 11

Client

SAS

File  System Database  (Teradata)

Design 1: SAS call using PROC SQL (implicit SQL), result as SAS dataset

Page 12: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Access Approaches (2)

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 12

Client

SAS

File  System Database  (Teradata)

Design 2: SAS call using PROC SQL (implicit SQL), result as Teradata table

Page 13: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Access Approaches (2)

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 13

Client

SAS

File  System Database  (Teradata)

Design 3: SAS call using PROC SQL (“explicit SQL pass-through“), result as Teradata table

Page 14: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Access Approaches (3)

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 14

Client

SAS

File  System Database  (Teradata)

Design 4: Explicit SQL

Page 15: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

SAS vs SQL Insights

§  Test Design (extract a large dataset from TD): 1.  Run a SAS call using PROC SQL and store the result

in a new SAS dataset 2.  Run a SAS call using PROC SQL and store the result

as a new Teradata table 3.  Run a SAS call using PROC SQL with “SQL pass-

through” 4.  Run SQL in Teradata

§  Results: §  #4 is the fastest §  #2 and #4 are almost as fast if SAS “knows” specific

SQL statements §  #2 does not support all SQL flavors §  #3 supports almost all SQL flavors

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 15

Page 16: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Constrains and Influence Factors

§  Social: §  Existing skill set (SAS vs PL/SQL)

§  Technology: §  Network Proximity - client, database, SAS, file

server) §  Storage concept - shared storage (SAN, NAS) vs.

direct-attached storage (SSD, SATA) §  Challenges:

§  Mapping of non-structured to structured data sources

§  Barriers for learning algorithms due to validation requirements

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 16

Page 17: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Project Achievements

§  Project Repository enables users to: §  Search previous studies/projects to leverage method(s) §  Define project/program ontology to refine search /reuse §  Store and retrieve project documentation, and

publications §  Archive of protocol, analysis plans, programs, datasets… §  Achieve traceability and reproducibility §  Track and document project decisions in real-time

§  Analysis Library enables users to: §  Create a reusable library of standard programs §  Maintain the central library of code lists and standard

listings, templates of table shells §  Design templates for easy project creation

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 17

Page 18: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

New? Technological Age in Pharma

§  Transactor based architectures (e.g. Scala/Akka)

§  MapReduce (e.g. Hadoop) §  NoSQL Databases (Key-Value, Graph…) §  Grids…

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 18

Page 19: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

New Initiatives (1)

§  Nextgov (FDA)*: §  Tender “to crawl 20 million biomedical journal

abstracts and citations housed on a National Library of Medicine database to uncover drugs that are disproportionately associated with “adverse events.””

§  “… a program to monitor the Web for illegal sales of drugs, medical devices, cosmetics and veterinary products as well as counterfeit food and adulterated or misbranded vaccines”

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 19

*  source:  h+p://www.fedtechmagazine.com/ar9cle/2013/04/fda-­‐launches-­‐three-­‐big-­‐data-­‐ini9a9ves

Page 20: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

New Initiatives (2)

§  Roche*: §  “Social analytics” §  “Data exploration” - the analysis and

detection of meaningful structures within unstructured text

§  Alliances**: §  Roche and Astra Zeneca (AZ) §  TransCelerate §  GSK and Pfizer §  AZ and BMS, AZ and Roche…

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 20

Sources: • * http://www.roche.com/de/media/roche_stories/roche-stories-2014-07-21.htm • ** http://online.wsj.com/news/articles/SB10001424127887323998604578567682985587790

Page 21: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

Conclusions

§  Current Pharma Trends: §  BIG ambitions (RWE) §  Rigid technological attitude §  Data legacy

§  Future Trends:

12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 21

Point of Singularity

Page 22: Big and Bigger: Big Data in the Pharma Industry 2014 TT Presentations/TT07.pdf · Big Data in the Pharma Industry . Agenda ! ... Ebay.com: 47.5 PB data warehouse + 40 PB Hadoop cluster*

The End… or just Beginning

Big Thanks for

Your Attention! 12-Oct-2014 © Entimo AG | Stralauer Platz 33-34 | 10243 Berlin | www.entimo.com - confidential - 22