Click to edit Master subtitle style
CDRH Vision - Total Product Life Cycle
CDRH Science Review
Planning of Review - Nov 1999 Internal Review – March 2001External Review –
June 21, 2001 (Orientation)July 24 to 26, 2001
Science Board Report – Nov 2001Science Review Implementation
Broad Areas of Focus: CDRH Internal & External
Reviews
Review seeks information about the Center’s decision making process
Scientific decision makingImpact of decision made by CDRHResources requiredIntegration of decisions madeProcesses and feedback mechanisms to document decisions and enhance organizational learningPreparedness to address future science issues
Internal Review
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
“Top 10 list” of recommendations for science-based regulation at CDRH
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
1. CDRH is not always recognized as a science-based organization by:
parts of CDRH and FDA, the Department of Health and Human Services, Congress and Industry.
Recommendation:CDRH needs to communicate its scientific vision and the scientific basis for its regulatory actions.CDRH needs advocates for its scientific role in medical devices and radiological health, including the FDA Science Board
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
2. The Center leadership does not always communicate science as a priority. We miss opportunities to creating the time and resources for our scientists to have the training and experiences to stay current and build their scientific expertise. Budget and resource planning is often reactive and short term and not well used to “walk the talk” of the priority of science.
Recommendation:The Center leadership needs to demonstrate the priority of science in how it allocates its human resources, and through strategies to maintain and build science capacity in the Center.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
3. CDRH’s scientific staff is “graying” and an anticipated wave of retirement will exacerbate the shortages of some types of expertise. Replacement hiring will also create challenging opportunities.
Recommendation:CDRH needs to implement the Magnet for Excellence goal area of its strategic plan which seeks to recruit and retain the type of employees that will help us accomplish our public health mission.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
4. Budget policies of the last eight years have markedly reduced operating dollars leaving laboratory programs and information technology infrastructure funded at a subsistence level.
Recommendation:Rich or poor, the Center needs to assure that there are enough operating dollars (vs. salary dollars) to provide the funds needed to maintain the effectiveness of our employees.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
5. New staff is trained largely by apprenticeship with insufficient attention to assuring the development of the core competencies needed for science-based regulation.
Recommendation:CDRH needs to identify core competencies and the types of experiences that will develop them to create a flexible scientific workforce able to meet future challenges.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
6. Premarket deadlines, acute problems, and “squeaky wheels” dominate resource allocation and leave programs disconnected and sometimes out of balance.
Recommendation:The Center’s strategic vision of assuring the public health throughout the total product life cycle and having meaningful measures of the impact of our efforts are strategies that will allow us to prioritize work better by the impact that it has.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
7. Scientific communication opportunities are underutilized, whether with scientific peers, medical device users or the general public. This limits our mission effectiveness.
Recommendation:The goal area of Knowledge Management in the Center’s strategic plan provides an approach not only to the acquisition and management of new knowledge, but also to the dissemination to our stakeholders to promote our mission.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
8. We solve many problems too slowly in a rapidly changing world. While decision making is often timely, implementation is often not.
Recommendation:CDRH should set goals, choose important problems, assess how to measure impact, create the team needed and be accountable for timely results from its efforts.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
9. Peer review is underutilized as a method for prioritizing efforts and evaluation. Choices are heavily driven by regulatory needs and evaluation is usually done through the organizational hierarchy.
Recommendation:Peer review should be routinely incorporated into the science-based decision making and science-based efforts by peers within and from outside the Center to supplement other methods of assessing scientific quality and effectiveness.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
10.Scientific partnerships with NIH, NAS, Universities, professional societies exist, but are underdeveloped.
Recommendation:Scientific partnerships with NIH, NAS, Universities, professional societies exist, should be developed as a source of external expertise, as sources of recruitment, and for partnerships in mission related activities.
Evaluation of External Review
Survey of External Panel Members(11/12 responded)
CDRH Science Review Evaluation
1. Opening the scope of the review to include the entire Center, i.e., not limited to a laboratory science review mean = 4.9
2. The early planning/kick-off meeting in Atlanta on June 21, 2001 mean = 4.2
3. Background materials on CDRH’s Mission and Organization mean = 4.5
No Use Essential
CDRH Science Review Evaluation
4. Case Studies: - the concept mean = 4.1
- the materials mean = 3.8
- the staff Interviews mean = 4.8
No Use Essential
CDRH Science Review Evaluation
8. “On the Spot”: - the concept mean = 4.0
- the materials mean = 2.7
- the staff Interviews mean = 4.1
No Use Essential
CDRH Science Review Evaluation
6. Role Playing Sessions mean = 3.8
7. The Industry Interviews mean = 4.1
9. The callback writing session mean = 4.7
No Use Essential
CDRH Science Review Evaluation
Open Ended Questions:10.What was the best/most useful activity or
component of the Science Review?11.What was the worst/least useful activity or
component of the Science Review?12.Which of the Committee’s recommendations
do you believe: CDRH must address in the near term to address a critical flaw?
13.Which of the Committee’s recommendations do you believe: CDRH must address to assure our place as a scientific leader in the medical device community?
What was the best/most useful activity or component of the Science Review?
case studies and industry interviews
the thought that preceded the committees work allowed more substantive activity as did the excellent prepared materials
interviews with the management and staff (2)
staff interviews – all were great & essential to further our understanding of the issues and way CDRH processes information discussion with staff and case studies
the background materials were essential to getting up to speed. The interviews were essential to understanding realities of the Center beyond the public persona or management view
staff interviews
interfacing with staffdiscussion of
recommendations
What was the worst/least useful activity or component of the Science Review?• role playing sessions (2)
• “on the spot” was least useful as it was difficult for the review team to know what to ask for. Not really necessary. Would have been better to have more time for discussions with CDRH staff
• preselection of case studies
• science review committee was too heavily weighted towards an industry bias. Insufficient “federal” scientific stakeholder representation•it was a bit scripted, and some things slipped past before we realized they needed more thoughts
• “on the spot” • every part was good• the “on the spot” activities were unfocused and for more work than was valuable. This time could have been better spent.• the case studies were good but need to be very carefully selected or they are not useful• “on the spot” binder – lists of documents not helpful• “on the spot” materials• trying to understand the materials and cope with the quantity
Which of the Committee’s recommendations do you believe: CDRH must address in the near term to address a critical flaw?
all of themmanpower distributionworkload distributionmore transparent communicationStrong immediate need to re-evaluate OST – structure, if OST exists, must change to reflect current and future science. Recommendation #3CDRH should consider outsourcing some of its review activities, although it was not contained in the committee’s final recommendations, CDRH should consider charge back for industry“keep current and support staffRec #13 & 14 – quality metrics and evaluationAssessment of needs (#7)
develop a strategic staffing plan to accommodate expected turnover/attrition/retirement & fill technical gaps with respect to future technologiesDevelop a plan for cross office communication (#4)Establish an electrtonic database for decisions and inventory (#5)Add human factors expertise to panels (#10)Funding which drives workloadRec #1 & 2 – define and communicate a vision and from that the organization and resources needed to meet that vision. Don’t start with the budget.Position it’s staff for the next 20 years challenge
Which of the Committee’s recommendations do you believe: CDRH must address to assure our place as a scientific leader in the medical device community?
all of themit’s difficult, but planned ready enrichment must be viewed as a core not supplemental activitystaff evaluation is needed to have a clear picture or required hiring to maintain (attain) expertise needed for biological/technological “revolution” (Rec #7)see Rec #7Be scientific! See Rec #7 develop a strategic staffing plan to accommodate expected turnover/attrition/retirement & fill technical gaps with respect to future technologiesRec #7 & 9 – expertise of staffImprove career path (#
More outreach (#12) that’s the only way to keep up and connectedReassess what laboratory programs to support – some are outdated & in other areas critical new fields of science are not covered at allVision is extremely importantIdentification of those technologies and development of an in-house capability in those technologies that will support approval of future medical devicesAdd new staff to cope with new technology
Science Review Next Steps
Establishment of CDRH Recommendations Committee
CDRH Science Recommendations Committee
Frances Benedict, OCDBob Cangelosi, OHIPJames Dillard, ODEPatricia Dubill, OSTPhilip Frappaolo, OCDAnita Rayner, OSB
Donald Serra, OCMitchell Shein, ODEToni Nearing, OCDKathleen Walker, OSMCheryll Wells, OC
Representatives from every Office
2 Quality systems experts
Science Review Next Steps
Establishment of CDRH Recommendations Committee
Scheduling of Division Directors Go-Away to address recommendations in light of strategic goal areas (Dec 6, 2001)
Science Review Next Steps
Establishment of CDRH Recommendations CommitteeScheduling of Division Directors
Go-Away to address recommendations in light of strategic goal areas (Dec 6, 2001)
Internet posting of Final Report
www.fda.gov/cdrh/science
CDRH Science Review Committee
CDRH Recommendations Committee
to prioritize the recommendations from the review (long and short term priorities), and make suggestions to Sr. Staff on
how to merge these recommendations into our strategic plan
New Technology
Scan Horizon
New Technology
Develop Regulatory Path
New Technology
Identify External Experts
New Technology
Build Internal Capacity
New Technology
ConsolidateTPLC Team
Center for Devices and Radiological Health
Strategic Goal AreasTotal Product Life Cycle product
managementMagnet for Excellence to attract
and develop the staff to accomplish our missionKnowledge ManagementMeaningful Metrics
Center for Devices and Radiological Health
Mission:
CDRH promotes and protects the
health of the public by ensuring the safety and effectiveness of medical devices and the safety of radiological products.
“Top 10 list” of the greatest challenges and problems for science-based regulation at CDRH
1. CDRH is not always recognized as a science-based organization by: parts of CDRH and FDA, the Department of Health and Human Services, Congress and Industry.
2. The Center leadership does not always communicate science as a priority. We miss opportunities to creating the time and resources for our scientists to have the training and experiences to stay current and build their scientific expertise. Budget and resource planning is often reactive and short term and not well used to “walk the talk” of the priority of science.
3. CDRH’s scientific staff is “graying” and an anticipated wave of retirement will exacerbate the shortages of some types of expertise. Replacement hiring will also create challenging opportunities.
4. Budget policies of the last eight years have markedly reduced operating dollars leaving laboratory programs and information technology infrastructure funded at a subsistence level.
5. New staff is trained largely by apprenticeship with insufficient attention to assuring the development of the core competencies needed for science-based regulation.
6. Premarket deadlines, acute problems, and “squeaky wheels” dominate resource allocation and leave programs disconnected and sometimes out of balance.
7. Scientific communication opportunities are underutilized, whether with scientific peers, medical device users or the general public. This limits our mission effectiveness.
8. We solve many problems too slowly in a rapidly changing world. While decision making is often timely, implementation is often not.
9. Peer review is underutilized as a method for prioritizing efforts and evaluation. Choices are heavily driven by regulatory needs and evaluation is usually done through the organizational hierarchy.
10.Scientific partnerships with NIH, NAS, Universities, professional societies exist, but are underdeveloped.
“Top 10 list” of recommendations for science-based regulation at
CDRH 1. CDRH needs to communicate its scientific vision
and the scientific basis for its regulatory actions. It needs advocates for its scientific role in medical devices and radiological health, including the FDA Science Board.
2. The Center leadership needs to demonstrate the priority of science in how it allocates its human resources, and through strategies to maintain and build science capacity in the Center.
3. CDRH needs to implement the Magnet for Excellence goal area of its strategic plan which seeks to recruit and retain the type of employees that will help us accomplish our public health mission.
4. Rich or poor, the Center needs to assure that there are enough operating dollars (vs. salary dollars) to provide the funds needed to maintain the effectiveness of our employees.
5. CDRH needs to identify core competencies and the types of experiences that will develop them to create a flexible scientific workforce able to meet future challenges.
6. The Center’s strategic vision of assuring the public health throughout the total product life cycle and having meaningful measures of the impact of our efforts are strategies that will allow us to prioritize work better by the impact that it has.
7. The goal area of Knowledge Management in the Center’s strategic plan provides an approach not only to the acquisition and management of new knowledge, but also to the dissemination to our stakeholders to promote our mission.
8. CDRH should set goals, choose important problems, assess how to measure impact, create the team needed and be accountable for timely results from its efforts.
9. Peer review should be routinely incorporated into the science-based decision making and science-based efforts by peers within and from outside the Center to supplement other methods of assessing scientific quality and effectiveness.
10.Scientific partnerships with NIH, NAS, Universities, professional societies exist, should be developed as a source of external expertise, as sources of recruitment, and for partnerships in mission related activities.