fda's mini-sentinel program to evaluate the safety of ... · data refreshes: data partner data...
TRANSCRIPT
![Page 1: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/1.jpg)
FDA's Mini-Sentinel Program to
Evaluate the Safety of Marketed
Medical Products
Progress and Direction
Progress and Direction
Richard PlattHarvard Pilgrim Health Care Institute
Harvard Medical School
for the Mini-Sentinel Investigators
January 31, 2013
![Page 2: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/2.jpg)
Mini-Sentinel
• Develop scientific operations for active medical product
safety surveillance
• Create a coordinating center with continuous access to
22
• Create a coordinating center with continuous access to
automated healthcare data systems, and the following
capabilities:
– Develop and evaluate scientific methods that might later be
used in a fully-operational Sentinel System.
– Offer FDA the opportunity to evaluate safety issues in existing
automated healthcare data system(s) and learn more about
barriers and challenges.
![Page 4: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/4.jpg)
Initial needs
� Policies
• Privacy
• Governance
� Data model
� Procedures at FDA, at Coordinating Center, at Partner sitesEverything!
� Procedures at FDA, at Coordinating Center, at Partner sites
• White papers
• Standard operating procedures
� Infrastructure at FDA, at Coordinating Center, at Partner sites
• Personnel
• Hardware
• Software
Everything!
![Page 5: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/5.jpg)
Mini-Sentinel Distributed Analysis1- User creates and
submits query
(a computer program)
2- Data partners
retrieve query
3- Data partners
review and run query
review and run query
against their local data
4- Data partners
review results
5- Data partners
return results via
secure network
6 Results are
aggregated
![Page 6: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/6.jpg)
Mini-Sentinel Journal Supplement• Supplement to
Pharmacoepidemiology and
Drug Safety
• 34 peer reviewed articles
• Goals, organization, privacy
policy, data systems,
policy, data systems,
systematic reviews, stats/epi
methods, record retrieval
and review, protocols for
drug/vaccine studies...
• Open access!
• http://onlinelibrary.wiley.com/doi/
10.1002/pds.v21.S1/issuetoc
![Page 7: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/7.jpg)
Drugs
www.fda.gov/Drugs/DrugSafety/ucm326580.htm; Nov 2, 2012
“This assessment [2used2] FDA’s Mini-Sentinel pilot...”
![Page 9: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/9.jpg)
“�we commend the Food and Drug Administration
for developing the Mini-Sentinel�”
Katz. Arch Intern Med. 2012;172:1590
![Page 10: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/10.jpg)
www.mini-sentinel.org/work_products/Statistical_Methods/Mini-Sentinel_Methods_Re-use-of-Mini-Sentinel-Data.pdf
![Page 11: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/11.jpg)
www.mini-sentinel.org/work_products/Statistical_Methods/Mini-Sentinel_Methods_Framework-f
or-Assessment-of-Signal-Refinement-Positive-Results.pdf
![Page 12: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/12.jpg)
In theory there is no difference
between theory and practice.
In practice there is.
In practice there is.
Yogi Berra
www.brainyquote.com/quotes/quotes/y/yogiberra141506.html#gsD0IBx3dytirLPX.99
![Page 13: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/13.jpg)
Mini-Sentinel Distributed Analysis1- User creates and
submits query
(a computer program)
2- Data partners
retrieve query
3- Data partners
review and run query
review and run query
against their local data
4- Data partners
review results
5- Data partners
return results via
secure network
6 Results are
aggregated
![Page 14: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/14.jpg)
PopMedNet Architecture – Deployment Overview
HTTPS, TLS
System
Administrator
(Two Factor
AuthN)
Fir
ew
allInternet
FISMA Compliant Data Center
Ne
two
rk
Se
curi
ty (
IDS
/IP
S, V
PN
/RS
A)
DataMart Management
(Metadata,
Authorization)
User and DataMart
Provisioning
And Administration
Workflow
Job
Scheduling
Request/
Response
Mgr
We
b S
erv
ers
/ R
ev
ers
e P
roxi
es/
Loa
d
Ba
lan
cers
Fir
ew
all
HTTPS, Mutual TLS
Fir
ew
all
Data Partner Organization
Data Mart
Client
Data
Source
(Common
Data
REST
Internet
Data Administrators
& Reviewers
(Two Factor AuthN)HTTPS,
TLS
DMZ Internal
Investigator
Enhanced
Investigator
Observer
Ne
two
rk
Se
curi
ty (
IDS
/IP
S, V
PN
/RS
A)
PMN Portal
User Account
Management
(Groups/Roles/User
Accounts)
User
Interface
We
b S
erv
ers
/ R
ev
ers
e P
roxi
es/
Loa
d
Ba
lan
cers
DMZ Non DMZ (Internal Components)
HTTPS, Mutual TLSData
Model)
DataWarehouse
/ Repositories
Optional
Audit
ETL
Optional Site to
Site VPN
• PMN Software – Supports multiple deployment models
• Agnostic to data center infrastructure and complements existing network infrastructure
• VM based deployments enabling ease of disaster recovery and planning
• Seamless overlay of VPN Connections (Remote Access, Site to Site, Two Factor User Authentication)
• Supports consolidation of remote sites into the data center for central management (Data Partner Components
can be hosted in a central data center similar to the PMN Portal)
• Secure End to End connection (Encrypted Transport using X.509 certificates)
• Supports industry standard RBAC configuration for users
• Supports Data Source provisioning based on RBAC and additional data source specific metadata
• Queries distributed using a PULL model instead of PUSH model
![Page 15: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/15.jpg)
Mini-Sentinel Distributed Analysis1- User creates and
submits query
(a computer program)
2- Data partners
retrieve query
3- Data partners
review and run query
review and run query
against their local data
4- Data partners
review results
5- Data partners
return results via
secure network
6 Results are
aggregated
![Page 16: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/16.jpg)
A Mini-Sentinel week
� Distributed dataset development/maintenance
� Query tool development /use
� Protocol development / implementation
� Methods development / implementation
� Methods development / implementation
� Develop new capacity
� Contribute to establishing a national resource for
evidence development
![Page 18: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/18.jpg)
Data Refreshes: Data Partner
Data Manager
Data Manager
Technical Analyst
Technical Analyst
Data Data
Data Manager
Data Manager
Technical Analyst
Technical Analyst
Data Data
10. Manage Data Update Process
3. Verify
1. Create
Data Update Work Plan
2. Review Data
Data Partner
Data Partner
Technical Analyst
Technical Analyst
Data Quality Analyst
Data Quality Analyst
Data Partner
Data Partner
Technical Analyst
Technical Analyst
Data Quality Analyst
Data Quality Analyst
6. Transform
& Load Data
into CDM
4.
Verify/Modify
ETL Process
3. Verify Source Data
Availability
5. Extract Data from
Source
System
7. Validate
Data Load
8. Create
Query Tool
Files
Data Quality Checking &
Profiling
MSOCMSOC Data PartnerData Partner
2. Review Data Update Work
Plan
![Page 19: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/19.jpg)
Data Refreshes: Operations Center
Technical Analyst
Technical Analyst
Data Quality Analyst
Data Quality Analyst
Technical Analyst
Technical Analyst
Data Quality Analyst
Data Quality Analyst
2. Run
Quality
Checking
Programs
1. Verify
Current SAS
Software
Versions
13. Manage Data Quality Checking & Profiling Process
Data
Updates
4. Deliver
3. Review &
Remediate
Outputs
Analyst Analyst
Data Quality Analyst
Data Quality Analyst
Data Manager
Data Manager
Analyst Analyst
Data Quality Analyst
Data Quality Analyst
Data Manager
Data Manager
MSOCMSOC Data PartnerData Partner
6. Approve
Data Partner
Update
Data
Updates
4. Deliver
Summary
Outputs
5. Review
Summary
Outputs
![Page 20: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/20.jpg)
� 120 core data refreshes received since MS began
Data Refreshes
How long does it
take to approve a
refresh?
Three weeks to
three months
![Page 23: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/23.jpg)
Data Visualization: After 8th refresh, partner A
New time period
New data problem in old time period
![Page 25: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/25.jpg)
• “Eternal vigilance is the
price of liberty”
-- attributed to
Thomas Jefferson
• “Eternal vigilance is the
price of reliable data"
-- Mini-Sentinel
![Page 26: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/26.jpg)
A Mini-Sentinel week
� Distributed dataset development/maintenance
� Query fulfillment tools development /use
![Page 27: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/27.jpg)
Typical Input to Modular Programs
• Look back XX days • Outcome(s)
Start of new treatment episode
Start Date End Date
• Look back XX days
• Inclusion/exclusion condition
• Outcome(s)
• Optional: blackout days
• Optional: extension days
Index Date Time
![Page 29: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/29.jpg)
When existing programs aren’t enough
� Modify a modular program, or
� Create a new program
![Page 31: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/31.jpg)
Uses of the distributed database
1500
Modular Programs
100
Ad Hoc Programs
0
500
1000
Feb
-11
Jun
-11
Oct
-11
Feb
-12
Jun
-12
Oct
-12
MP Queries
MP Reports
MP Scenarios
0
50
Feb
-11
Ma
y-1
1
Au
g-1
1
No
v-1
1
Feb
-12
Ma
y-1
2
Au
g-1
2
No
v-1
2
![Page 32: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/32.jpg)
A Mini-Sentinel week
� Distributed dataset development / maintenance
� Query tool development / use
� Protocol development / implementation
![Page 33: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/33.jpg)
Protocols in the field now
� Impact of labeling change on use of long acting beta
agonists
� Rotavirus vaccine and intussusception
� Human papillomavirus vaccine and
� Human papillomavirus vaccine and
thromboembolism
� Anti-diabetic drugs and acute myocardial infarction
![Page 34: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/34.jpg)
Protocols under development
� Influenza vaccine safety
(same season, sequential analysis)
� Metabolic effects of atypical antipsychotics in
children and adolescents
children and adolescents
� Influenza vaccine and febrile seizures
� Dabigatran and stroke / bleeding
� Influenza vaccine and birth defects,
spontaneous abortion
� IV iron products and anaphylactoid reactions
� IV immune globulins and thromboembolic events
![Page 35: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/35.jpg)
A Mini-Sentinel week
� Distributed dataset development / maintenance
� Query tool development / use
� Protocol development / implementation
� Methods development / implementation
� Methods development / implementation
![Page 36: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/36.jpg)
Methods
� Improving confounder adjustment
� Validation of health outcomes of interest
� Data mining for vaccine adverse events
� Implementing routine prospective surveillance of
� Implementing routine prospective surveillance of
new products using sequential methods
![Page 37: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/37.jpg)
A Mini-Sentinel week
� Distributed dataset development / maintenance
� Query tool development / use
� Protocol development / implementation
� Methods development / implementation
� Methods development / implementation
� Develop new capacity
![Page 38: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/38.jpg)
Coming in 2013
� Prospective surveillance of new products
� New query tools
� New bandwidth to respond to more queries
� New data
� New data
• Links to state birth and immunization registries
• Explore use of inpatient data
![Page 39: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/39.jpg)
A Mini-Sentinel week
� Distributed dataset development/maintenance
� Query tool development /use
� Protocol development / implementation
� Methods development / implementation
� Methods development / implementation
� Develop new capacity
� Contribute to establishing a national resource for
evidence development
![Page 41: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/41.jpg)
Continue external engagements
� NIH Health Care System Collaboratory
� Observational Medical Outcomes Partnership (OMOP)
� Clinical Trials Transformation Initiative
� Clinical Trials Transformation Initiative
� ONC Standards & Interoperability Framework
(Query Health)
� IOM Roundtable on Value and Science-Driven Health
Care
� Academy Health EDM Forum
� Other new partners as opportunities present
![Page 43: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/43.jpg)
Key contributors to Mini-Sentinel’s progress
� Close, frequent, coordinated interactions between FDA, data
partners, content experts, epidemiologists, and statisticians
� Distributed data network
� Public health practice
� Focus on defined populations with sufficiently complete data
� Focus on defined populations with sufficiently complete data
• First: Claims and administrative data, plus access to full text records
• Then: electronic medical records, registries, …
� Rapid cycle development of capabilities
� Ability to respond quickly to predefined needs
![Page 44: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/44.jpg)
“2highlights the necessity of proactive planning2”
Salmon Health Affairs 2012; 31:2518
![Page 45: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/45.jpg)
Costs and benefits
� Up to date distributed database +
hundreds of rapid response queries
� Protocol based study
� Protocol based study
� Being prepared for pandemic
or other crisis
![Page 46: FDA's Mini-Sentinel Program to Evaluate the Safety of ... · Data Refreshes: Data Partner Data Manager Technical Analyst Data 10. Manage Data Update Process 3. Verify 1. Create Data](https://reader033.vdocument.in/reader033/viewer/2022042922/5f6cb8886ca0b75e435b8910/html5/thumbnails/46.jpg)
Expectations confirmed
� Standard programs can help FDA quickly interpret
signals from other sources:
• Dabigatran and bleeding
• Olmesartan and celiac disease
• Varenicline and cardiac events
� Many sophisticated analyses do not require exchange
of protected health information