gxp data integrity –what really matters · 2018. 12. 20. · gxp data integrity –what really...

28
GxP Data Integrity – What really matters Dr Andrew Gray – Head MHRA Inspectorate EBF 11 th Open Symposium - Barcelona 21 st November 2018

Upload: others

Post on 06-Mar-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

GxP Data Integrity – What really mattersDr Andrew Gray – Head MHRA InspectorateEBF 11th Open Symposium - Barcelona21st November 2018

Page 2: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

2

Data IntegrityGuidance Published March 2018Data integrity has always been central to what we do -• As regulators

• As quality professionals

So what's the new?The way we look at data integrity controls?

Page 3: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

3

Data Integrity – International Focus

Page 4: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

4

Data Integrity – What’s New?

What's New

Awareness

Concepts

Ways of Working

Fraud

IT Systems

Operational Complexity

Page 5: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

5

Data Integrity Controls

Concepts

Thinking

Approach

Page 6: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

6

Data Integrity - ConceptsData lifecycle - “All phases in the life of the data (including raw data) from initial generation and recording through processing (including transformation or migration), use, retention, archiving, retrieval and destruction”

• Collection• Processing• Reporting• Review• Archival

Data Lifecycle

Page 7: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

7

Data Integrity - ConceptsData Governance – “The sum total of arrangements to ensure that data irrespective of the format in which it is generated, is recorded, processed, retained and used to ensure a complete, consistent and accurate record throughout the data lifecycle.”

• Process & Systems• Ownership• Monitoring/Audit• Environment• Training

Data Governance

Page 8: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

8

Assessing DI Risk

Page 9: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

9

Assessing DI Risk

• Risk assessment

• Identify areas of risk

• Implement proportionate risk mitigation measures

• Assess residual risk

Page 10: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

10

Assessing DI Risk

Is all data retained? • Including metadata, event logs, audit trails.

Can data be excluded from the decision-making process?• What is the justification for doing so?• Is this visible?

Page 11: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

11

Assessing DI Risk

Is QA review/inspection appropriately focused

• Including e-data? (or only when the reviewer thinks there is a problem?)

• Does e-data review include meaningful metadata? Is this in the SOPs / training?

Page 12: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

12

Proportionality

Comfortable with residual risks

Page 13: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

13

Organisational culture and risk awareness

IgnoranceDenial

Under-standing

‘Policing’System maturityHigh risk

Low risk.

Page 14: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

14

Compliance & Culture

Attitudes

BeliefsBehaviours

Page 15: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

15

Attitudes Quality adds value!

Page 16: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

16

Behaviours

• Management attitudes• Open reporting culture• Inter-department cooperation

• Corrective Actions / Preventative Actions• Realism

• Pragmatism

Page 17: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

17

Beliefs

The work we do mattersPublic Health

Patient safety

Environmental impact

It’s easy to become detached

Page 18: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

18

Beliefs

Context should be at the centre of any training programme

……It provides purpose and meaning

……It will impact on attitudes

……It will impact on compliance

Page 19: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

19

What we see

Page 20: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

20

Common Inspection Findings User Permission Settings

• None in place / shared log-ins• Multiple log-ins per user with different permissions (for different

activities) but no checks to ensure used appropriately• Person assigning user permissions is also a user of the system• Poor control of assigned users (removal of permissions)

Page 21: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

21

Common Inspection Findings

Quality Control / Quality Assurance

• Checks conducted against paper ‘source’ data rather than electronic raw data

• No review of audit trails / permissions• Lack of clear explanations of discrepancies or changes to data.

Page 22: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

22

Laboratory DI Issues

• The facility utilised a generic login termed “autospec” which was used by multiple users.• Data could be deleted via windows explorer.• The main audit trail functionality had not been installed – gaps in the audit trail.• The run log which was used as the basis for confirming all data was present could be edited.• Quality assurance (QA) did not have access to the electronic data and were provided with paper print

outs of the data. • Operating software was installed with basic security configuration.

The manipulation of data within analytical runs combined with the set up of the system has cast significant doubt over the validity of the data generated.

DI Deficiencies

Page 23: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

23

Laboratory DI Issues cont..

• Falsification of temperature data

• Continued in CAPA response to inspectorate!

*****• The generation of results from data acquired by the MassLynx software included a process step

where modifications could be made to the data. A .txt file could be generated as an output from the software, edited and then uploaded to the LIMS system.

• QA review of data acquired by the MassLynx software was limited to review of data held in LIMSsystem and printed chromatograms. The was no review of essential supporting data which would potential identify DI issues.

Page 24: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

24

Lab DI Issues

Falsification of data – company culture

• Loss on drying weight• LOD results as part of in-process testing• Falsification of calibration records• Disposal of settle plates when inspectors arrived unannounced• ‘Made-up’ pH meter calibration values recorded

Page 25: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

25

Lab DI Issues

Falsification of mixing steps for over 60 batches

• Identified error in stirring rpm and so changed the records

• Could have been fixed with a change control & impact assessment

• Fraud orchestrated by a manager and involved multiple members of staff

Page 26: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

26

Do we understand our processes?

• Data lifecycles • Data Governance • Where are opportunities for data integrity issues to occur?• Bad practices; do we have any? • Do we understand what our residual risks are and are we happy to live with

and justify them?

Is our culture conducive to maintaining a focus on data integrity?

Summary

Page 27: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

27

Thank you for your attention

Page 28: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona

28

© Crown copyright 2018