NPCR FeedbackData Evaluation Reports

& Data Quality Indicators

Tara Hylton, FL DOHBrad Wohler, FCDS

July 28, 2005

CDCNAACCRNPCR

FCDS

NPCR Reports• Standard Status Report

• Quality• Completeness• Timeliness

• Submission Summary Report• Single & Inter-field Errors• % of Over-rides

• Data Quality Indicators• Core Surveillance Data• Advanced Surveillance Data

Standard Status Report• % Completeness

• @ 12 & 24 months

• Unresolved Dups• % DCO• % Missing Data

• Age, Sex, Race & County

• % Passing Edits

Standard Status Report

12 Months 2003 92.37 0.00 0.00 0.00 0.02 0.42 0.00 100.002002 102.95 0.00 2.93 0.00 0.02 0.56 0.00 100.002001 105.31 0.00 2.82 0.01 0.04 0.53 0.00 100.002000 105.09 0.00 3.26 0.01 0.03 0.57 0.00 100.001999 104.32 0.00 3.50 0.00 0.02 0.52 0.00 100.001998 102.28 0.00 3.68 0.01 0.00 0.52 0.00 100.00

90.00 N/A N/A N/A N/A N/A N/A 97.0095.00 <=1 <=3 <=2 <=2 <=3 <=2 99.00NPCR 24 Month Standard

24+ Months

STANDARDNPCR 12 Month Standard

Percent Death

Certificate Only

Cases

Percent Passing Core

Single and Inter-field

Edits

Percent Missing or UnknownCore Data Elements

Age Sex Race County

NPCR Standards Grouping

Diagnosis Year**

Percent Completeness Adjusted for Duplicates*

Unresolved Duplicates Rate (per

1,000)

Submission Summary Report• records (#, %) with errors• % of Over-Rides

• 10 fields• Age/site/morph• Seqno/dxconf• Site/lat/seqno• Site/type• Histology• Report source• Ill-define site• Leuk, lymphoma• Site/behavior• Site/lat/morph

Submission Summary Report 2005

n % n % n % n % n % n %Total Records with Errors 0 0.00 0 0.00 0 0.00 0 0.00 0 0.00 0 0.00

Total Errors 0 - 0 - 0 - 0 - 0 - 0 -

2000 1999 1998Edit Name

2003 2002 2001

Submission Summary Report 2005

Age/Site/ SeqNo/ Site/Lat/ Site/TypeMorph DxConf SeqNoAge, Diagnostic Site/Histology/ Primary Site, 1 = 2 = Diagnostic 3 = Both

Diagnosis Primary Site, Confirm, Seq Laterality/ Morphology- Morphology-- Confirmation, 1 and 2Year Morphology Num--Central Sequence Type Check Type&Behavior Behavior Code Apply2003 0.11 0.54 0.11 0.63 0.02 0.00 0.002002 0.08 0.55 0.09 0.45 0.05 0.00 0.002001 0.08 0.55 0.05 0.46 0.03 0.00 0.002000 0.07 0.53 0.09 0.41 0.06 0.00 0.001999 0.06 0.53 0.08 0.41 0.06 0.00 0.001998 0.07 0.57 0.02 0.39 0.05 0.00 0.00

0.19 0.73 0.23 1.84 0.08 0.00 0.00SEER OVER-RIDE FLAG QUALITY MEASURES**

Histology

Submission Summary Report 2005 cont.

Report Ill-define Leuk, Site/ Site/Lat/Source Site Lymphoma Behavior Morph Percentage

Type of Report Seq Num-- Diagnostic Primary Site, Laterality, of RecordsDiagnosis Srce(DC),Seq Central, Primary Confirmation, Behavior Primary Site, with Over-

Year Num--Central Site, Morph Histologic Type Code Morphology Ride Flags*2003 0.02 0.42 0.01 0.00 0.01 1.622002 0.04 0.39 0.02 0.00 0.00 1.622001 0.01 0.41 0.03 0.00 0.01 1.562000 0.00 0.50 0.00 0.00 0.01 1.671999 0.00 0.50 0.00 0.00 0.00 1.641998 0.00 0.50 0.00 0.00 0.01 1.60

0.14 0.51 0.07 0.01 0.00SEER OVER-RIDE FLAG QUALITY MEASURES**

Data Quality Indicators• 24 month data• Core & Advanced items• Graphs

• 7 indicators

• Comparison across NPCR

Data Quality Indicators 2005 Core

NPCR Avg

Not in US but NOS (998) 0.08 0.05 0.03 0.04 0.05 0.28 Unknown (999, blank) 62.33 62.54 62.52 62.39 63.12 60.57

Year (<1850 or >2003, blank) 0.01 0.00 0.01 0.01 0.00 0.01

Spanish/Hispanic Origin (9, blank) 0.54 0.42 0.92 1.03 0.99 11.21

Unknown (99, blank) 8.38 7.51 6.09 5.75 5.21 76.75 Analytic Cases only 4.76 3.87 2.75 2.69 1.96

2001 2002

Patient Socio-demographic Birthplace [250]

Birthdate [240]

Race and Ethnicity [190]

Primary Payer at Diagnosis [630]

1999 20001998

Data Quality Indicators 2005 Core

NPCR Avg

Month (99, blank) 0.00 0.00 0.00 0.00 0.00 0.48 Analytic Cases Unknown Month 0.02 0.02 0.01 0.02 0.00

Other/Ill Defined Sites (C76.0 - C76.8) 0.06 0.04 0.05 0.05 0.05 0.08 Unknown Primary Site (C80.9) 2.68 2.80 2.67 2.40 2.37 2.43

Non-specific Neoplasms (8000 - 8001) 5.74 5.70 5.75 5.32 5.38 3.70 Non-specific Neoplasms (8002 - 8005) 0.04 0.02 0.03 0.02 0.02 0.02 Analtyic Cases Neoplasms (8000-8005) 2.00 1.95 2.04 2.08 2.05

Tumor CharacteristicsDate of Diagnosis [390]

Topography [400]

Morphology [420]

2000 2001 20021998 1999

Data Quality Indicators 2005 Core

NPCR Avg

Not Microscopically Confirmed (5, 6, 7, 8) 3.00 2.91 3.11 2.97 3.12 3.45 Unknown (9) and Blank 0.31 0.32 0.53 0.40 0.31 1.26

Two or more (01 - 35) 24.99 24.99 24.11 24.03 23.14 18.37 Unspecified (99) 0.00 0.00 0.00 0.00 0.00 0.00

VIN III, VAIN III, AIN III 0.00 0.00 0.00 0.00 0.00 0.00

Grade [440] (9, blank) excludes DCO, C80.9 35.42 35.21 36.22 35.65 35.15 32.32 Analytic cases excludes DCO, C80.9 32.81 33.12 34.28 34.33 34.41 Laterality [410] paired organs only Only 1 side and side NOS (3) 0.10 0.13 0.11 0.10 0.16 0.38 Unknown (9, blank) 3.93 3.96 4.11 3.81 3.87 2.61 Analytic cases Unknown laterality 2.20 2.23 2.35 2.23 2.25

2000 2001 2002

Diagnostic Confirmation [490] excludes DCOTumor Characteristics continued

1998

Sequence Number--Central [380]

Reportable Cancers

1999

Tumor Miscellaneous

Data Quality Indicators 2005Advanced

NPCR Avg

Not Tracted (000000) 0.00 0.00 0.00 0.00 0.00 4.26 Tracted, but Not Available (999999) 0.00 0.00 0.00 0.00 0.00 1.22 Blank 0.57 0.70 1.26 2.20 9.01 49.60 Invalid Codes 0.30 0.30 0.34 0.29 0.25 0.17

Blank 0.57 0.70 1.26 2.20 9.01 26.32 Unknown (9) 0.00 0.00 0.00 0.00 0.03 2.63

Blank 0.00 0.00 0.00 0.00 0.00 0.00 Unknown (999) 0.00 0.00 0.00 0.00 0.00 0.07 Out of State Resident (998) 0.00 0.00 0.00 0.00 0.00 0.02 Valid County Recode (000) 0.00 0.00 0.00 0.00 0.00 3.68

Substate Geography Census Tract [130]

Census Tr Cert [365]

County at Diagnosis [90]

2001 20021998 1999 2000

Data Quality Indicators 2005Advanced

NPCR Avg

Blank 0.00 0.00 0.00 0.00 0.00 58.55 Surgery, NOS (90) 4.46 3.79 3.20 1.28 1.06 0.37 Unknown (99) 4.52 4.45 4.54 3.68 3.89 1.24 Analytic Cases Unknown 0.77 0.76 0.89 0.79 0.84

Blank 0.00 0.00 0.00 0.00 0.00 74.15 Unknown (9) 97.65 94.94 86.19 16.46 16.60 7.65 Analytic Cases Unknown (excludes brain, CNS, lymphomas, leukemias and misc)

Blank 0.00 0.00 0.00 0.00 0.00 74.15 Unknown (9) 96.74 93.41 83.27 4.01 4.08 5.33 Analytic Cases Unknown 98.47 95.11 84.87 0.81 0.88

1998 1999

First Course Treatment

98.49 95.33 84.89

RX Summ Surg Prim Site [1290]

RX Summ Scope Reg LN Sur [1292]

1.14 1.37

2000 2001 2002

RX Summ Surg Oth Reg/Dis [1294]

Data Quality Indicators 2005Advanced

NPCR Avg

Blank 0.00 0.00 0.00 0.00 0.00 2.26

Year (invalid) 0.00 0.00 0.00 0.00 0.00 0.02 Year (unknown or missing year) 0.00 0.00 0.00 0.00 0.00 2.31

Blank 0.00 0.00 0.00 0.00 0.00 19.61 Death Cert. Avail., But No COD (7797) 0.00 0.00 0.00 0.00 0.00 1.42 Death Certificate Not Available (7777) 0.00 0.00 0.00 0.00 0.00 4.50

Vital Status and Cause of Death Vital Status [1760] (blank)

Date of Last Contact [1750] decedents only

Cause of Death [1910]

1998 1999 2000 2001 2002

% Other, Ill-defined, and NOS Primary Site [400]All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

1

2

3

41 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 FL 44 45 46

NP

CR

State registries

Per

cen

tag

e

Unknown primary site (C80.9) Other and ill-defined (C76.0-76.8)

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.

% Non-specific Morphology [420]All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

2

4

6

8

101 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 FL 44 45 46

NP

CR

State registries

Per

cen

tag

e

Non-specific neoplasms (8000-8005)

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.

% Unknown Diagnostic Confirmation or Not Microscopically Confirmed [490]All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

2

4

6

8

101 2 3 4 5 6 7 8 9

FL 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46

NP

CR

State registries

Per

cen

tag

e

(9) Unknown (5,6,7,8) Not microscopically confirmed

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder. Death certificate only cases were also excluded.

% Unknown or Unspecified Laterality [410] Paired Organs Only, All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

2

4

6

8

10

12

14

161 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 FL 36 37 38 39 40 41 42 43 44 45 46

NP

CR

State registries

Per

cen

tag

e

(9) Paired site, but no information concerning laterality; midline tumor (3) Only one side-side unspecified

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.

% Unknown Race [160] All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

1

2

3

4

51 2 3 4 5 6 7 8 9 10

11

12

13

14

15

16

17

18

FL 20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

NP

CR

State registries

Per

cen

tag

e

Unknown

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.

% Death Certificate Only [500]All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

1

2

3

4

5

61 2 3 4 5 6 7 8 9 10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

FL 38

39

40

41

42

43

44

45

46

NP

CR

State registries

Per

cen

tag

e

Death certificate only

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.

% Unknown Summary Stage 2000 [759]All Sites Combined*, Both Genders

Individual State Registries and NPCR Registries Combined, 2001 diagnosis year

0

5

10

15

20

251 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 FL 39 40 41 42 43 44 45

NP

CR

State registries

Per

cen

tag

e

Unknown

*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder. Death certificate only, pathology laboratory only, and unknown primary site cases were also excluded.

Conclusions

• Florida é Quality Data

• Generally unremarkable

• Room for improvement

Conclusions

• Site/lat/morphology • paired organs w/ insitu behavior

• Analytic cases• Unknown payor

• é % Unknown birthplace