Skip to main content

Diagnostic concordance among pathologists interpreting breast biopsy specimens.

Elmore JG, Longton GM, Carney PA, Geller BM, Onega T, Tosteson AN, Nelson HD, Pepe MS, Allison KH, Schnitt SJ, O'Malley FP, Weaver DL

Publication: JAMA (2015) • Vol 313 • Page 1122-32PMID: 25781441View on PubMed

Purpose

This paper assessed how patient age and breast density, pathologist workload, and practice size and academic affiliation influences the diagnostic concordance of breast cancer among pathologists.

Conclusion

The diagnostic agreement between 126 pathologists and the reference diagnosis assigned by 3 pathologists was 75.3% for (5194 out of 6900 interpretations). Diagnostic agreement among pathologists was stronger for certain diagnoses, as 96% of interpretations were concordant for specimens ultimately diagnosed as invasive breast cancer, 87% for ductal carcinoma in situ (DCIS), and 82% diagnosed as benign without atypia, but only 54% when the diagnosis was atypia. For atypia, over- and underestimation rates were similar. Diagnostic agreement was also influenced by breast density, patient age, case difficulty, the pathologist’s clinical setting and experience.

Studies (1)

Purpose

This study assessed how patient age and breast density, pathologist workload, and practice size and academic affiliation influences the diagnostic concordance of breast cancer among pathologists. A single H&E stained slide was chosen for each of the 240 breast biopsies evaluated, and an initial diagnosis of benign without atypia (30% of biopsies, including 10% non-proliferative and 20% proliferative without atypia), atypia (30% of biopsies), DCIS (30% of biopsies), and invasive carcinoma (10% of biopsies) was established based upon the consensus of three pathologists. A 60 case subset was then re-evaluated in a blind study by 126 different pathologists with more than 1 year of experience diagnosing breast biopsies. 

Summary of Findings

The initial three pathologists agreed on a diagnosis for 75% of the 240 cases examined, and for 90.3% of the 720 interpretations (650 of 720). Diagnostic agreement for the same cases was poorer among the 126 additional participting pathologists, which produced a consensus diagnosis in 75.3% of interpretations. Diagnostic agreement among pathologists was stronger for certain diagnoses; for example,  agreement was 96% among specimens diagnosed as invasive breast cancer, 87% for DCIS, and 82% for those diagnosed as benign without atypia, but only 54% for those with atypia. Further, for atypia the underestimation rate (where the actual diagnosis was benign without atypia) was 19% and the overestimation rate (where the actual diagnosis was DCIS) was 27%. Diagnostic agreement rates were lower among specimens with greater  breast density (P<0.001), specifically when pathologists ranked the case as difficult or borderline between diagnostic categories or when the pathologist stated they were less confident in their interpretation or would seek a second opinion. Concordance with the reference diagnosis occurred most frequently when the pathologists worked in an academic setting (OR=0.799, P=0.006), worked in a practice with 10 or more pathologists (OR=0.849, P=0.0399), or evaluated 10 or more breast cases per week (OR=0.799, P=0.006). When the patient was 40-49 years old rather than over 50 years old, the rate of over-interpretation (i.e., atypia as DCIS) was higher and the under-interpretation (i.e., DCIS as atypia) rate was lower.

  • Biospecimens

    TissueBreast
  • Preservation Types

    Formalin
  • Diagnoses

    NeoplasticCarcinoma
    NeoplasticBenign
  • Platforms

    MorphologyH-and-E microscopy
  • Pre-analytical Factors

    ClassificationPre-Analytical FactorValue(s)
    PreaquisitionDiagnosis/ patient condition
    Atypia
    Benign without atypia
    DCIS
    Invasive carcinoma
    PreaquisitionPatient age
    40-49 years
    ≥50 years
    PreaquisitionPrognostic factor
    Varying breast density
    H-and-E microscopy SpecificData handling
    126 different Pathologists
    Pathologist in academic setting
    Pathologist in non-academic setting
    Pathologist in practice with fewer than 10 pathologists
    Pathologist who evaluates 10 or more breast cases a week
    Pathologist who evaluates fewer than 10 breast cases a week