|
|
||||||||
Computer Applications |
1 From the Dept of Radiology, Univ of British Columbia, Vancouver, Canada (L.J.W.B.); R2 Technology, 325 Distel Circle, Los Altos, CA 94022 (S.A.W., K.F.O., R.A.C.); Dept of Radiology, Univ of Massachusetts Medical Center, North Worcester (C.J.D.); Breast Imaging Center, Thomas Jefferson Univ Hosp, Philadelphia, Pa (S.A.F.); Dept of Radiology, Massachusetts General Hosp, Boston (D.B.K.); UCSF Medical Center, San Francisco, Calif (E.A.S.); Dept of Mammography, Central Hosp, Falun, Sweden (L.T.); and Dept of Radiology, Univ of Chicago, Ill (C.J.V.). From the 1998 RSNA scientific assembly. Received Jul 19, 1999; revision requested Aug 26; revision received Sep 21; accepted Oct 21. Address correspondence to R.A.C. (e-mail: rcastell@r2tech.com).
PURPOSE: To determine the false-negative rate in screening mammography, the capability of computer-aided detection (CAD) to identify these missed lesions, and whether or not CAD increases the radiologists' recall rate.
MATERIALS AND METHODS: All available screening mammograms that led to the detection of biopsy-proved cancer (n = 1,083) and the most recent corresponding prior mammograms (n = 427) were collected from 13 facilities. Panels of radiologists evaluated the retrospectively visible prior mammograms by means of blinded review. All mammograms were analyzed by a CAD system that marks features associated with cancer. The recall rates of 14 radiologists were prospectively measured before and after installation of the CAD system.
RESULTS: At retrospective review, 67% (286 of 427) of screening mammographydetected breast cancers were visible on the prior mammograms. At independent, blinded review by panels of radiologists, 27% (115 of 427) were interpreted as warranting recall on the basis of a statistical evaluation index; and the CAD system correctly marked 77% (89 of 115) of these cases. The original attending radiologists' sensitivity was 79% (427 of [427 + 115]). There was no statistically significant increase in the radiologists' recall rate when comparing the values before (8.3%) with those after (7.6%) installation of the CAD system.
CONCLUSION: The original attending radiologists had a false-negative rate of 21% (115 of [427 + 115]). CAD prompting could have potentially helped reduce this false-negative rate by 77% (89 of 115) without an increase in the recall rate.
Index terms: Breast neoplasms, 00.32 Breast neoplasms, diagnosis, 00.32 Cancer screening, 00.11, 00.1299 Computers, diagnostic aid
This article has been cited by other articles:
![]() |
M. F. Chiang, R. Gelman, S. L. Williams, J.-Y. Lee, D. S. Casper, M. E. Martinez-Perez, and J. T. Flynn Plus Disease in Retinopathy of Prematurity: Development of Composite Images by Quantification of Expert Opinion Invest. Ophthalmol. Vis. Sci., September 1, 2008; 49(9): 4064 - 4070. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Gur Imaging Technology and Practice Assessment Studies: Importance of the Baseline or Reference Performance Level Radiology, April 1, 2008; 247(1): 8 - 11. [Full Text] [PDF] |
||||
![]() |
M. Gromet Comparison of Computer-Aided Detection to Double Reading of Screening Mammograms: Review of 231,221 Mammograms Am. J. Roentgenol., April 1, 2008; 190(4): 854 - 859. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Taylor, R. Greenhalgh, R. Ilangovan, E. Tam, V. A. Sahni, D. Burling, J. Zhang, P. Bassett, P. J. Pickhardt, and S. Halligan CT Colonography and Computer-aided Detection: Effect of False-Positive Results on Reader Specificity and Reading Efficiency in a Low-Prevalence Screening Population Radiology, April 1, 2008; 247(1): 133 - 140. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Robinson, S. Halligan, S. A. Taylor, S. Mallett, and D. G. Altman CT Colonography: A Systematic Review of Standard of Reporting for Studies of Computer-aided Detection Radiology, February 1, 2008; 246(2): 426 - 433. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. J. Kim, W. K. Moon, N. Cho, J. H. Cha, S. M. Kim, and J.-G. Im Computer-aided Detection in Full-Field Digital Mammography: Sensitivity and Reproducibility in Serial Examinations Radiology, December 1, 2007; 246(1): 71 - 80. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. F. Brem Blinded Comparison of Computer-Aided Detection with Human Second Reading in Screening Mammography: The Importance of the Question and the Critical Numbers Game Am. J. Roentgenol., November 1, 2007; 189(5): 1142 - 1144. [Full Text] [PDF] |
||||
![]() |
R. L. Ellis, A. A. Meade, M. A. Mathiason, K. M. Willison, and W. Logan-Young Evaluation of Computer-aided Detection Systems in the Detection of Small Invasive Breast Carcinoma Radiology, October 1, 2007; 245(1): 88 - 94. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Elmore and R. J. Brenner The More Eyes, the Better to See? From Double to Quadruple Reading of Screening Mammograms J Natl Cancer Inst, August 1, 2007; 99(15): 1141 - 1143. [Full Text] [PDF] |
||||
![]() |
J. L. Jesneck, J. Y. Lo, and J. A. Baker Breast Mass Lesions: Computer-aided Diagnosis Models with Mammographic and Sonographic Descriptors Radiology, August 1, 2007; 244(2): 390 - 398. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. K. Yang, W. K. Moon, N. Cho, J. S. Park, J. H. Cha, S. M. Kim, S. J. Kim, and J.-G. Im Screening Mammography-detected Cancers: Sensitivity of a Computer-aided Detection System Applied to Full-Field Digital Mammograms Radiology, July 1, 2007; 244(1): 104 - 111. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Berlin Accuracy of Diagnostic Procedures: Has It Improved Over the Past Five Decades? Am. J. Roentgenol., May 1, 2007; 188(5): 1173 - 1178. [Full Text] [PDF] |
||||
![]() |
J. J. Fenton, S. H. Taplin, P. A. Carney, L. Abraham, E. A. Sickles, C. D'Orsi, E. A. Berns, G. Cutter, R. E. Hendrick, W. E. Barlow, et al. Influence of Computer-Aided Detection on Performance of Screening Mammography N. Engl. J. Med., April 5, 2007; 356(14): 1399 - 1409. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Skaane, A. Kshirsagar, S. Stapleton, K. Young, and R. A. Castellino Effect of Computer-Aided Detection on Independent Double Reading of Paired Screen-Film and Full-Field Digital Screening Mammograms Am. J. Roentgenol., February 1, 2007; 188(2): 377 - 384. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. A. J. Roelofs, N. Karssemeijer, N. Wedekind, C. Beck, S. van Woudenberg, P. R. Snoeren, J. H. C. L. Hendriks, M. Rosselli del Turco, N. Bjurstam, H. Junkermann, et al. Importance of Comparison of Current and Prior Mammograms in Breast Cancer Screening Radiology, January 1, 2007; 242(1): 70 - 77. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. J. Kim, W. K. Moon, N. Cho, J. H. Cha, S. M. Kim, and J.-G. Im Computer-aided Detection in Digital Mammography: Comparison of Craniocaudal, Mediolateral Oblique, and Mediolateral Views Radiology, December 1, 2006; 241(3): 695 - 701. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. H. Taplin, C. M. Rutter, and C. D. Lehman Testing the effect of computer-assisted detection on interpretive performance in screening mammography. Am. J. Roentgenol., December 1, 2006; 187(6): 1475 - 1482. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Ko, M. J. Nicholas, J. B. Mendel, and P. J. Slanetz Prospective assessment of computer-aided detection in interpretation of screening mammography. Am. J. Roentgenol., December 1, 2006; 187(6): 1483 - 1491. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. R. Pai, N. E. Gregory, A. E. Swinford, and M. Rebner Ductal Carcinoma in Situ: Computer-aided Detection in Screening Mammography Radiology, December 1, 2006; 241(3): 689 - 694. [Abstract] [Full Text] [PDF] |
||||
![]() |
C Mello-Thoms The problem of image interpretation in mammography: effects of lesion conspicuity on the visual search strategy of radiologists Br. J. Radiol., December 1, 2006; 79(Special_Issue_2): S111 - S116. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. D. O'Connor, R. M. Summers, J. Yao, P. J. Pickhardt, and J. R. Choi CT Colonography with Computer-aided Polyp Detection: Volume and Attenuation Thresholds to Reduce False-Positive Findings Owing to the Ileocecal Valve Radiology, November 1, 2006; 241(2): 426 - 432. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. J. Gilbert, S. M. Astley, M. A. McGee, M. G. C. Gillan, C. R. M. Boggis, P. M. Griffiths, and S. W. Duffy Single Reading with Computer-aided Detection and Double Reading of Screening Mammograms in the United Kingdom National Breast Screening Program Radiology, October 1, 2006; 241(1): 47 - 53. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. S. Burnside, D. L. Rubin, J. P. Fine, R. D. Shachter, G. A. Sisney, and W. K. Leung Bayesian Network to Predict Breast Cancer Risk of Mammographic Microcalcifications and Reduce Number of Benign Biopsy Results: Initial Experience Radiology, September 1, 2006; 240(3): 666 - 673. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. K. Lindfors, M. C. McGahan, C. J. Rosenquist, and G. S. Hurlock Computer-aided Detection of Breast Cancer: A Cost-effectiveness Study Radiology, June 1, 2006; 239(3): 710 - 717. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J. Morton, D. H. Whaley, K. R. Brandt, and K. K. Amrami Screening Mammograms: Interpretation with Computer-aided Detection--Prospective Evaluation Radiology, May 1, 2006; 239(2): 375 - 383. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. J. Brenner, M. J. Ulissey, and R. M. Wilt Computer-Aided Detection as Evidence in the Courtroom: Potential Implications of an Appellate Court's Ruling Am. J. Roentgenol., January 1, 2006; 186(1): 48 - 51. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Hofvind, P. Skaane, B. Vitak, H. Wang, S. Thoresen, L. Eriksen, H. Bjorndal, A. Braaten, and N. Bjurstam Influence of Review Design on Percentages of Missed Interval Breast Cancers: Retrospective Study of Interval Cancers in a Population-based Screening Program Radiology, November 1, 2005; 237(2): 437 - 443. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. A. L. Khoo, P. Taylor, and R. M. Given-Wilson Computer-aided Detection in the United Kingdom National Breast Screening Programme: Prospective Study Radiology, November 1, 2005; 237(2): 444 - 449. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. E. Cupples, J. E. Cunningham, and J. C. Reynolds Impact of Computer-Aided Detection in a Regional Screening Mammography Program Am. J. Roentgenol., October 1, 2005; 185(4): 944 - 950. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Peldschus, P. Herzog, S. A. Wood, J. I. Cheema, P. Costello, and U. J. Schoepf Computer-Aided Diagnosis as a Second Reader: Spectrum of Findings in CT Studies of the Chest Interpreted as Normal Chest, September 1, 2005; 128(3): 1517 - 1523. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. L. Birdwell, P. Bandodkar, and D. M. Ikeda Computer-aided Detection with Screening Mammography in a University Hospital Setting Radiology, August 1, 2005; 236(2): 451 - 457. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. D. M. Otten, N. Karssemeijer, J. H. C. L. Hendriks, J. H. Groenewoud, J. Fracheboud, A. L. M. Verbeek, H. J. de Koning, and R. Holland Effect of Recall Rate on Earlier Screen Detection of Breast Cancers Based on the Dutch Performance Indicators J Natl Cancer Inst, May 18, 2005; 97(10): 748 - 754. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Baker, E. L. Rosen, M. M. Crockett, and J. Y. Lo Accuracy of Segmentation of a Commercial Computer-aided Detection System for Mammography Radiology, May 1, 2005; 235(2): 385 - 390. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. V. Ghate, M. S. Soo, J. A. Baker, R. Walsh, E. I. Gimenez, and E. L. Rosen Comparison of Recall and Cancer Detection Rates for Immediate versus Batch Interpretation of Screening Mammograms Radiology, April 1, 2005; 235(1): 31 - 35. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. S. Soo, E. L. Rosen, J. Q. Xia, S. Ghate, and J. A. Baker Computer-Aided Detection of Amorphous Calcifications Am. J. Roentgenol., March 1, 2005; 184(3): 887 - 892. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. F. Brem, J. W. Hoffmeister, G. Zisman, M. P. DeSimio, and S. K. Rogers A Computer-Aided Detection System for the Evaluation of Breast Cancer by Mammographic Appearance and Lesion Size Am. J. Roentgenol., March 1, 2005; 184(3): 893 - 896. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. F. Brem, J. W. Hoffmeister, J. A. Rapelyea, G. Zisman, K. Mohtashemi, G. Jindal, M. P. DiSimio, and S. K. Rogers Impact of Breast Density on Computer-Aided Detection for Breast Cancer Am. J. Roentgenol., February 1, 2005; 184(2): 439 - 444. [Abstract] [Full Text] [PDF] |
||||
![]() |
K Doi Current status and future potential of computer-aided diagnosis in medical imaging Br. J. Radiol., January 1, 2005; 78(suppl_1): S3 - s19. [Abstract] [Full Text] [PDF] |
||||
![]() |
S M Astley Evaluation of computer-aided detection (CAD) prompting techniques for mammography Br. J. Radiol., January 1, 2005; 78(suppl_1): S20 - S25. [Abstract] [Full Text] [PDF] |
||||
![]() |
P Taylor and R M Given-Wilson Evaluation of computer-aided detection (CAD) devices Br. J. Radiol., January 1, 2005; 78(suppl_1): S26 - S30. [Abstract] [Full Text] [PDF] |
||||
![]() |
E Alberdi, A A Povyakalo, L Strigini, P Ayton, M Hartswood, R Procter, and R Slack Use of computer-aided detection (CAD) tools in screening mammography: a multidisciplinary investigation Br. J. Radiol., January 1, 2005; 78(suppl_1): S31 - S40. [Abstract] [Full Text] [PDF] |
||||
![]() |
J Roehrig The manufacturer's perspective Br. J. Radiol., January 1, 2005; 78(suppl_1): S41 - S45. [Abstract] [Full Text] [PDF] |
||||
![]() |
S M Astley Computer-based detection and prompting of mammographic abnormalities Br. J. Radiol., December 1, 2004; 77(suppl_2): S194 - S200. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Butler, R. J. Gabbay, D. A. Kass, D. E. Siedler, K. F. O'Shaughnessy, and R. A. Castellino Computer-Aided Detection in Diagnostic Mammography: Detection of Clinically Unsuspected Cancers Am. J. Roentgenol., November 1, 2004; 183(5): 1511 - 1515. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Gur, J. S. Stalder, L. A. Hardesty, B. Zheng, J. H. Sumkin, D. M. Chough, B. E. Shindel, and H. E. Rockette Computer-aided Detection Performance in Mammographic Examination of Masses: Assessment Radiology, November 1, 2004; 233(2): 418 - 423. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Baker, J. Y. Lo, D. M. Delong, and C. E. Floyd Computer-aided Detection in Screening Mammography: Variability in Cues Radiology, November 1, 2004; 233(2): 411 - 417. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Feig, E. A. Sickles, W. P. Evans, and M. N. Linver Re: Changes in Breast Cancer Detection and Mammography Recall Rates After the Introduction of a Computer-Aided Detection System J Natl Cancer Inst, August 18, 2004; 96(16): 1260 - 1261. [Full Text] [PDF] |
||||
![]() |
S. V. Destounis, P. DiNitto, W. Logan-Young, E. Bonaccio, M. L. Zuley, and K. M. Willison Can Computer-aided Detection with Double Reading of Screening Mammograms Help Decrease the False-Negative Rate? Initial Experience Radiology, August 1, 2004; 232(2): 578 - 584. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. M. Hall and R. F. Brem Improved Sensitivity of Mammography with Computer-Aided Detection Am. J. Roentgenol., June 1, 2004; 182(6): 1598 - 1599. [Full Text] [PDF] |
||||
![]() |
M. A. Guenin and R. F. Brem How Not to Assess Computer-Aided Detection for Mammography Am. J. Roentgenol., June 1, 2004; 182(6): 1599 - 1600. [Full Text] [PDF] |
||||
![]() |
E. A. Krupinski Computer-aided Detection in Clinical Environment: Benefits and Challenges for Radiologists Radiology, April 1, 2004; 231(1): 7 - 9. [Full Text] [PDF] |
||||
![]() |
M. A. Helvie, L. Hadjiiski, E. Makariou, H.-P. Chan, N. Petrick, B. Sahiner, S.-C. B. Lo, M. Freedman, D. Adler, J. Bailey, et al. Sensitivity of Noncommercial Computer-aided Detection System for Mammographic Breast Cancer Detection: Pilot Clinical Trial Radiology, April 1, 2004; 231(1): 208 - 214. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Zheng, J. K. Leader, G. Abrams, B. Shindel, V. Catullo, W. F. Good, and D. Gur Computer-Aided Detection Schemes: The Effect of Limiting the Number of Cued Regions in Each Case Am. J. Roentgenol., March 1, 2004; 182(3): 579 - 583. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Ikeda, R. L. Birdwell, K. F. O'Shaughnessy, E. A. Sickles, and R. J. Brenner Computer-aided Detection Output on 172 Subtle Findings on Normal Mammograms Previously Obtained in Women with Breast Cancer Detected at Follow-Up Screening Mammography Radiology, March 1, 2004; 230(3): 811 - 819. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Gur, J. H. Sumkin, H. E. Rockette, M. Ganott, C. Hakim, L. Hardesty, W. R. Poller, R. Shah, and L. Wallace Changes in Breast Cancer Detection and Mammography Recall Rates After the Introduction of a Computer-Aided Detection System J Natl Cancer Inst, February 4, 2004; 96(3): 185 - 190. [Abstract] [Full Text] [PDF] |
||||
![]() |
P M Taylor, J Champness, R M Given-Wilson, H W W Potts, and K Johnston An evaluation of the impact of computer-based prompts on screen readers' interpretation of mammograms Br. J. Radiol., January 1, 2004; 77(913): 21 - 27. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Baker, E. L. Rosen, J. Y. Lo, E. I. Gimenez, R. Walsh, and M. S. Soo Computer-Aided Detection (CAD) in Screening Mammography: Sensitivity of Commercial CAD Systems for Detecting Architectural Distortion Am. J. Roentgenol., October 1, 2003; 181(4): 1083 - 1088. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. F. Brem, J. Baum, M. Lechner, S. Kaplan, S. Souders, L. G. Naul, and J. Hoffmeister Improvement in Sensitivity of Screening Mammography with Computer-Aided Detection: A Multiinstitutional Trial Am. J. Roentgenol., September 1, 2003; 181(3): 687 - 693. [Abstract] [Full Text] [PDF] |
||||
![]() |
|