advertorial rbm objectives, design and deployment: how ...€¦ · hope the real life experiences...

2
ADVERTORIAL ADVERTORIAL 22 APPLIED CLINICAL TRIALS December 2014 RBM Objectives, Design and Deployment: How Covance Transforms Risks into Returns Adam Baumgart, BSc, CPM, Director, Process Excellence & Process Lead, Risk-Based Monitoring, Clinical Development Services, Covance Inc. G uidance released by FDA and EMA in 2011 and 2013 has by now generated an array of very different risk-based monitoring (RBM) approaches, tools and systems. But a key question remains: what makes an RBM implementation effective, such that it helps meet regu- lator expectations and transforms risks into returns? Covance has leveraged a decade’s worth of experience implementing risk- based approaches to create a unique, end-to-end RBM enterprise solution, powered by its own proprietary, state- of-the-art analytics platform. This article focuses on real life experiences from our ongoing RBM implementation, including the benefits of RBM and recommenda- tions on how to implement RBM effi- ciently by “keeping it simple.” Keeping it Simple One of the guiding principles and objec- tives of the Covance RBM implementa- tion roll out is Simple Process & Organi- zation. We have identified the following key components to what “keeping it sim- ple” looks like: 1. Roles and organizational structures that are simple to understand and follow 2. Holistic, robust, end-to-end clinical trial RBM systems and tools from the Request-for-Proposal stage to the final Clinical Study Report 3. Pilot studies to refine and develop processes and test tools and to further develop future roles and organizational structures 1. Simple Roles & Organization At first glance, it might appear easy to inadvertently over-complicate RBM and its implementation. For example, in the traditional monitoring paradigm, the re- sponsibility for data quality at the in- vestigator site primarily rests with the CRA. In risk-based approaches, however, this responsibility becomes distributed among the CRA, in-house CRAs, data managers, statisticians, physicians, etc. In this case, we have found the simple approach is to take one role at a time and examine and determine the extent of change and then consolidate, train and manage, before moving on to the next impacted role. New RBM Roles The need for change in the RBM para- digm doesn’t just impact processes, but also the people side of the equation, as we have found RBM requires new skill sets and roles. One such role that Co- vance has introduced is that of an RBM Subject Matter Expert (SME). We have trained a series of experienced Project Managers as RBM SMEs, to proactively guide study teams throughout the RBM project lifecycle and make recommen- dations based on study data. The RBM SME works closely with study teams from the proposal stage to study close, focusing primarily on risk identification and management. Each RBM SME has oversight of a portfolio of studies and helps transfer and apply best practices. This new, specialized role has helped us scale up RBM rapidly, and assimilate knowledge and best practices to con- tinuously enhance our RBM solution. 2. Robust Processes, Systems and Tools Covance has made significant invest- ments to design simple, scalable RBM processes. These processes have gener- ated our system requirements which in turn have resulted in easy-to-use sys- tems and tools. Instead of rolling out everything at once, we’ve deployed a staged process, targeting the most im- portant elements first. For example, the definition of critical data and processes is a significant element of the regulatory guidance. Correspondingly, it is one of the first RBM processes to be formalized with a new SOP. Continuously share the high level RBM process Our high level RBM process map has 11 simple to understand steps. We are continuously using this visual to call at- tention to the RBM roll out and how it

Upload: others

Post on 09-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AdvertoriAl RBM Objectives, Design and Deployment: How ...€¦ · hope the real life experiences shared in this article including the application of RBM processes into ongoing stud-ies,

AdvertoriAl

ADVERTORIAL22 Applied CliniCAl TriAlS December 2014

RBM Objectives, Design and Deployment: How Covance Transforms Risks into ReturnsAdam Baumgart, BSc, CPM, Director, Process Excellence & Process Lead, Risk-Based Monitoring, Clinical Development Services, Covance Inc.

Guidance released by FDA and

EMA in 2011 and 2013 has by

now generated an array of very

different risk-based monitoring

(RBM) approaches, tools and

systems. But a key question remains:

what makes an RBM implementation

effective, such that it helps meet regu-

lator expectations and transforms risks

into returns?

Covance has leveraged a decade’s

worth of experience implementing risk-

based approaches to create a unique,

end-to-end RBM enterprise solution,

powered by its own proprietary, state-

of-the-art analytics platform. This article

focuses on real life experiences from our

ongoing RBM implementation, including

the benefits of RBM and recommenda-

tions on how to implement RBM effi-

ciently by “keeping it simple.”

Keeping it SimpleOne of the guiding principles and objec-

tives of the Covance RBM implementa-

tion roll out is Simple Process & Organi-

zation. We have identified the following

key components to what “keeping it sim-

ple” looks like:

1. Roles and organizational structures

that are simple to understand and follow

2. Holistic, robust, end-to-end clinical

trial RBM systems and tools from the

Request-for-Proposal stage to the final

Clinical Study Report

3. Pilot studies to refine and develop

processes and test tools and to further

develop future roles and organizational

structures

1. Simple Roles & OrganizationAt first glance, it might appear easy to

inadvertently over-complicate RBM and

its implementation. For example, in the

traditional monitoring paradigm, the re-

sponsibility for data quality at the in-

vestigator site primarily rests with the

CRA. In risk-based approaches, however,

this responsibility becomes distributed

among the CRA, in-house CRAs, data

managers, statisticians, physicians, etc.

In this case, we have found the simple

approach is to take one role at a time

and examine and determine the extent

of change and then consolidate, train

and manage, before moving on to the

next impacted role.

New RBM RolesThe need for change in the RBM para-

digm doesn’t just impact processes, but

also the people side of the equation, as

we have found RBM requires new skill

sets and roles. One such role that Co-

vance has introduced is that of an RBM

Subject Matter Expert (SME). We have

trained a series of experienced Project

Managers as RBM SMEs, to proactively

guide study teams throughout the RBM

project lifecycle and make recommen-

dations based on study data. The RBM

SME works closely with study teams

from the proposal stage to study close,

focusing primarily on risk identification

and management. Each RBM SME has

oversight of a portfolio of studies and

helps transfer and apply best practices.

This new, specialized role has helped

us scale up RBM rapidly, and assimilate

knowledge and best practices to con-

tinuously enhance our RBM solution.

2. Robust Processes, Systemsand ToolsCovance has made significant invest-

ments to design simple, scalable RBM

processes. These processes have gener-

ated our system requirements which in

turn have resulted in easy-to-use sys-

tems and tools. Instead of rolling out

everything at once, we’ve deployed a

staged process, targeting the most im-

portant elements first. For example, the

definition of critical data and processes

is a significant element of the regulatory

guidance. Correspondingly, it is one of

the first RBM processes to be formalized

with a new SOP.

Continuously share the high level RBM processOur high level RBM process map has

11 simple to understand steps. We are

continuously using this visual to call at-

tention to the RBM roll out and how it

Page 2: AdvertoriAl RBM Objectives, Design and Deployment: How ...€¦ · hope the real life experiences shared in this article including the application of RBM processes into ongoing stud-ies,

ADVERTORIAL

ADVERTORIAL

Applied CliniCAl TriAlS 23December 2014

impacts staff functions, and to refer the

staff back to the current RBM step that

the study they support is going through

at a given point in time. Also, the pro-

cess map is shared with RBM process

users on a continuous basis through our

intranet. This continuous use of the RBM

visuals, language and terminology has

in and of itself proven to be an effective

agent for change.

Maturing toolsets drive escalating adoptionOur experience shows that once risk fac-

tor visualizations and operational met-

ric dashboards are mature and widely

available, the study staff will proac-

tively adopt and advocate the use of

risk-based approaches and systems in

their studies. In addition, as the staff

increasingly realizes that RBM tools and

approaches can benefit their studies be-

cause of improved overall control and

proactively addressing risks, demand

escalates for implementation of the RBM

tools and process.

3. Pilot Studies and ImplementationIn theory, RBM can be deployed in any

clinical trial of any phase. Pragmatically,

Covance made a decision to begin the

rollout of RBM in Phase III studies as

they tend to involve a larger number

of patients, be longer in duration and

therefore more costly. Such a study pro-

file provides a greater opportunity for

quality improvements over time lead-

ing to higher potential cost efficiencies.

Phase I and II studies generally include

fewer patients and are shorter in dura-

tion so there may be less value from

changes in the monitoring strategy, and

the implementation of an RBM dash-

board may not be as cost effective as in

later phases.

At the same time, Covance continues

to meet with sponsors and evaluate the

RBM implementation in other phases.

It is clear that risks identified and expe-

rienced in Phase I and II studies inform

those in Phase III studies, therefore im-

plementing RBM in early phase studies

can potentially save even more time and

effort across the development program.

Accordingly, Covance will extend the

implementation of RBM to early phase

studies as well.

In addition, by cross-training staff

from our Phase IV and lifecycle man-

agement teams, we aim to use the best

principles of their more minimal, long

established approaches to help refine

RBM principles. Therefore approaches

from Phase IIIb and IV studies will be

used to provide ideas and inputs to fur-

ther develop RBM in Phase I-III.

RBM pilot studies – lessons learnedCovance has already piloted the RBM

processes in a number of clinical trials

and has gained useful experience across

several areas, for instance:

• Initial high level study risk assess-

ments have been carried out using

a tool similar to the TransCelerate

RACT. This tool has been deployed as

early as at the Request-for-Proposal

stage, providing study teams a head

start deploying key RBM approaches

in the event of a study award

• For over five years, Covance has been

using a Risk Management Register in

the planning stages to perform de-

tailed assessments of study operation

risk. With RBM, this Register is be-

ing enhanced to include clear, docu-

mented ownership of risk identifica-

tion and mitigation

Finally, based on positive pilot study

deployment experiences, Quality by De-

sign techniques such as the two exam-

ples above will be used in wider portfo-

lio level governance and will no longer

be limited only to studies considered

RBM trials.

In-flight RBM implementationThe increase in deployment of RBM ap-

proaches in new studies has prompted

a wave of interest in adopting RBM for

studies that are already in-flight. For

example, one of our Asia Pacific-based

clients and project teams approached

us to implement a risk dashboard in an

ongoing trial. Once launched, this dash-

board is expected to reduce the cost and

effort required to review risk factors that

the study team had been tracking manu-

ally. In addition, the RBM dashboard will

introduce a richer suite of risk indica-

tors and operational KPIs which in turn

enables the study team to better assess

patient safety and data quality.

Let the data do the talkingOne of the main tenets of the FDA and

EMA quality and risk guidance is cen-

tralized monitoring or centralized review

of data. These processes are proving a

challenge as they impact long-estab-

lished structures, processes and distrib-

uted data sources in clinical operations,

data management, statistical analysis

and medical monitoring. However, hav-

ing access to an experienced in-house

group of data scientists has helped over-

come this challenge: their experience in

visualizing clinical trial data and trends

has enabled the data to “do the talking”

in ways that simply didn’t exist before.

Further, implementation experiences

have taught us that the process of de-

signing trial data visualizations is an

evolution: end user feedback is dynami-

cally shaping and optimizing the visu-

alizations. This agile software develop-

ment approach has helped to convince

key clinical trial stakeholders, such as

clinical trial investigators, by being in-

clusive of their feedback and input.

For Covance, the RBM implementa-

tion journey is far from complete. We

hope the real life experiences shared

in this article including the application

of RBM processes into ongoing stud-

ies, the development of specialized risk

management roles, the selection of

which development phase to implement

RBM, and our lessons learned in “keep-

ing it simple” are of help and inspiration

– and indeed illustrative of how RBM

makes it possible to transform risks into

returns. Further examples including

RBM case studies and white papers are

available at www.covance.com/rbm.