|
|
||||||||
Breast Imaging |
1 From the Dept of Internal Medicine, Univ of Washington School of Medicine, Harborview Medical Ctr, 325 Ninth Ave, Box 359780, Seattle, WA 98104-2499 (J.G.E., J.S.F.); Ctr for Health Studies, Group Health Cooperative, Seattle, Wash (J.G.E., S.H.T., W.E.B., L.A.A.); Applied Research Program, National Cancer Institute, Bethesda, Md (S.H.T.); Cancer Research and Biostatistics, Seattle, Wash (W.E.B.); Dept of Biostatistics, Univ of Alabama at Birmingham, Birmingham, Ala (G.R.C.); Dept of Radiology, Emory University, Atlanta, Ga (C.J.D.); Lynn Sage Comprehensive Breast Ctr, Dept of Radiology, Northwestern Univ Feinberg School of Medicine, Chicago, Ill (R.E.H.); and Office of Medical Education, Dartmouth Univ, Hanover, NH (P.A.C.). Supported by Public Health Service grant HS-10591 (J.G.E.) from the Agency for Healthcare Research and Quality and the National Cancer Institute and surveillance grants U01 CA63731 (S.H.T.), 1 U01 CA86082-01 (P.A.C.), 5 U01 CA63736-09 (G.R.C.), and 5 U01 CA86076 (W.E.B.) from NIH and the Department of Health and Human Services and the National Cancer Institute. Received Mar 17, 2004; revision requested May 27; revision received Jul 30; accepted Sep 2. Address correspondence to J.G.E. (e-mail: jelmore{at}u.washington.edu).
| ABSTRACT |
|---|
|
|
|---|
MATERIALS AND METHODS: All study activities were approved by the institutional review boards of the involved institutions, and patient and radiologist informed consent was obtained where necessary. This study was performed in three regions of the United States (Washington, Colorado, and New Hampshire). Radiologists who routinely interpret mammograms completed a mailed survey that included questions on demographic data, practice environment, and medical malpractice. Survey responses were linked to interpretive performance for all screening mammography examinations performed between January 1, 1996, and December 31, 2001. The odds of recall were modeled by using logistic regression analysis based on generalized estimating equations that adjust for study region.
RESULTS: Of 181 eligible radiologists, 139 (76.8%) returned the survey with full consent. The analysis included 124 radiologists who had interpreted a total of 557 143 screening mammograms. Approximately half (64 of 122 [52.4%]) of the radiologists reported a prior malpractice claim, with 18 (14.8%) reporting mammography-related claims. The majority (n = 51 [81.0%]) of the 63 radiologists who responded to a question regarding the degree of stress caused by a medical malpractice claim described the experience as very or extremely stressful. More than three of every four radiologists (ie, 94 [76.4%] of 123) expressed concern about the impact medical malpractice has on mammography practice, with over half (72 [58.5%] of 123) indicating that their concern moderately to greatly increased the number of their recommendations for breast biopsies. Radiologists' estimates of their future malpractice risk were substantially higher than the actual historical risk. Almost one of every three radiologists (43 of 122 [35.3%]) had considered withdrawing from mammogram interpretation because of malpractice concerns. No significant association was found between recall rates and radiologists' experiences or perceptions of medical malpractice.
CONCLUSION: U.S. radiologists are extremely concerned about medical malpractice and report that this concern affects their recall rates and biopsy recommendations. However, medical malpractice experience and concerns were not associated with recall or false-positive rates. Heightened concern of almost all radiologists may be a key reason that recall rates are higher in the United States than in other countries, but this hypothesis requires further study.
© RSNA, 2005
| INTRODUCTION |
|---|
|
|
|---|
The topics of both medical malpractice and breast cancer are frequently in the news. A review of just three U.S. states for a 6-month period yielded more than 2500 different media events on the topics of mammography, breast cancer, and malpractice from just 45 news sources (eg, newspapers ranked among the top five in terms of circulation, medical journal articles, radiology trade publications, national public radio, and national and local network news) (5). Media exposure, both popular and professional, is obviously extensive. Despite this high level of media coverage, very little research has been conducted on how radiologists perceive the malpractice environment or how their perceptions or experiences with medical malpractice may be affecting their interpretative performance and patient-recall rates.
Several studies have involved comparison of mammographic performance indexes in the United States with those in other countries, and these have identified medical malpractice as a possible cause of the higher recall rates observed in the United States (6,7). We believed that studying this phenomenon in detail, although it constitutes a challenging task, should be done. We hypothesized that greater perceptive concerns and previous medical malpractice experiences would be associated with higher recall rates. Thus, the purpose of our study was to assess the relationships between radiologists' perceptions of and experiences with medical malpractice and their patient-recall rates in actual community-based clinical practice.
| MATERIALS AND METHODS |
|---|
|
|
|---|
All study activities were approved by the institutional review boards of the University of Washington School of Medicine and the Group Health Cooperative (Washington), Dartmouth College (New Hampshire), and the Cooper Institute (Colorado). In the New Hampshire Mammography Network, patients sign informed consent statements, while the two other sites allow patients to exclude their data from research if they want, but their institutional review boards do not require informed consent for primarily clinical activity. All radiologists gave consent for the use of their survey data and to the linkage of their survey data to the performance data that had already been gathered for them by the Breast Cancer Surveillance Consortium.
Data Collection
A conceptual framework guided both survey instrument development and the interpretation of findings. We used a blended conceptual framework that integrated the Fishbein Theory of Reasoned Action (13), the Bandura Social Cognition Theory (14,15), and the Green Precede Model (1618). The Theory of Reasoned Action has been used in several studies of physician behavior (1921). The Bandura Social Cognition Theory, which has also been used to study physician behavior (2224), asserts that individuals' behaviors are influenced by a complex interaction between their attitudes and beliefs and their environment (14). Use of the Precede Model in studying physician behavior is also well established (2528).
We developed the questionnaire and then field tested it with highly experienced and nationally recognized radiology, mammography, and malpractice specialists. We then revised and retested the questionnaire for its face validity among community radiologists who were not in the study cohort. The final four-page survey took less than 10 minutes to complete and included questions on demographics (eg, age, sex), clinical practice (eg, experience with mammography, experience with procedures), and perception of and experience with medical malpractice. A copy of the survey is available upon request. The self-administered survey was designed to collect information on demographics and clinical practices, as well as on perceptions of and experiences with medical malpractice.
Eligible radiologists included those interpreting mammograms at one of the three mammography registries between January 1, 2001, and December 31, 2001. Surveys were mailed in February 2002 from each registry. Written informed consent forms were returned with signatures by regular mail for two sites; at the third site (Colorado), informed consent was embedded in the cover letter, which stated that filling out and returning the survey gave consent to release the data collected in the survey. To enhance our response rate, we re-sent the survey and followed up with a telephone call to nonresponders after 3 weeks; a total of three attempts were made to collect survey responses.
All survey data were encrypted and de-identified and sent to the statistical coordinating center in Seattle, Wash. Responses to the survey were linked to mammogram interpretations by each participating radiologist for all screening examinations performed between January 1, 1996, and December 31, 2001. Variables for each mammography examination included date, Breast Imaging Reporting and Data System (BI-RADS) (29) assessment and recommendation categories, patient clinical characteristics, and benign and malignant breast pathologic findings, which were obtained from state or Surveillance, Epidemiology, and End Results, or SEER, cancer registries and/or pathology laboratories.
Analytic Definitions
Standard definitions of accuracy (sensitivity, specificity) and recall rate developed by the Breast Cancer Surveillance Consortium by using BI-RADS categories (29) were used (30). Screening mammograms obtained in women aged 40 years and older were included in the analysis. A screening mammogram was considered positive if it was classified as BI-RADS category 0 (necessitating additional imaging evaluation), category 4 (depicting a suspicious abnormality), category 5 (revealing findings highly suggestive of malignancy), or category 3 with a recommendation for immediate work-up. If a woman underwent different BI-RADS assessments for each breast, the higher assessment level was used according to the following hierarchy (BI-RADS category 1 < 2 < 3 < 0 < 4 < 5). The recall rate was defined as the number of mammograms interpreted as positive divided by the total number of mammograms. A second, more stringent definition of recall rate was also used in which a positive mammogram was defined as one assigned a BI-RADS category of 4 or 5.
Statistical Analysis
Data for radiologists with more than 480 screening mammograms in the Breast Cancer Surveillance Consortium database were considered for the linked analysis (480 is the minimum average annual number of mammograms that radiologists are required to interpret in order to be accredited for breast imaging, according to U.S. Food and Drug Administration regulations [31]). Univariate analyses were used to examine the associations between individual radiologist recall rates and medical malpractice perceptions and experiences. Mean recall rates and 95% confidence intervals were computed for each physician.
Each radiologist's score was weighted by the number of mammograms interpreted by that radiologist so that the overall findings would accurately reflect radiology practice and each mammogram would have the same weight. An unweighted analysis of radiologists would bias the results toward radiologists with fewer mammograms and would therefore not adequately characterize the overall effect. Assume we have two radiologists; one reads 250 mammograms with a sensitivity of 60%, and the other reads 750 mammograms with a sensitivity of 80%. We could compute their overall sensitivity as [( · 60) + ( · 80)] · 100%, which would yield a value of 70%. However, the sensitivity of the first radiologist is probably less stable because he or she read fewer mammograms, while the sensitivity of the second radiologist is more stable because he or she read more mammograms. By taking their volume into account, we could compute their overall sensitivity as {[(250/1000) · 60] + [(750/1000) · 80]} · 100%, which would yield a value of 75%. If we do not take volume into account, we are assuming that both radiologists have equally representative measures of sensitivity, which may not be the case.
In addition, we performed an analysis at the mammogram level that accounted for the correlation of assessments within each radiologist. For each medical malpractice variable, the odds of recall were modeled by using logistic regression while adjusting for study site (Washington, Colorado, or New Hampshire). The logistic regression models were fit by using generalized estimating equations that assumed an independent working correlation matrix (the GENMOD procedure in the SAS software package [SAS Institute, Cary, NC]). For all analyses (performed by L.A.A. and W.E.B.), a two-sided P value of less than .05 was considered to indicate a statistically significant difference.
| RESULTS |
|---|
|
|
|---|
Screening Population
The radiologists interpreted mammography results at 81 facilities in the three states. A total of 557 143 screening mammograms obtained in 308 634 women were interpreted by participating radiologists between 1996 and 2001. The age of the women ranged from 40 to 102 years (mean age, 56 years), and 187 295 of the mammograms had been obtained in women who were between the ages of 40 and 49 years. Breast cancer was diagnosed in 2840 women within 1 year of the screening mammography examination.
Radiologist Characteristics
Physician demographic and clinical practice characteristics are shown in Table 1. The age of the radiologists ranged from 35 to 79 years. The age distributions between male and female radiologists were similar, although there was a smaller percentage of women in the older-than-55 age category. The majority of the radiologists were male (77.4%), worked full time (74.0%), were not affiliated with an academic medical center (83.9%), had more than 10 years of experience in interpreting mammograms (77.2%), and spent less than 40% of their time working in breast imaging (87.7%). The reported number of mammograms interpreted in the year before the survey was administered ranged from 480 to more than 5000.
|
|
|
|
|
Radiologists' Desire to Leave the Field of Mammography
Almost one of three radiologists (33 of 122 [27.0%]) reported considering withdrawing from interpreting mammograms at least on a monthly basis, and 16.4% (20 of 122) reported considering withdrawing on a weekly or daily basis because of concerns about medical malpractice (Table 2). Of the eight radiologists who considered withdrawing from mammography on a daily basis because of concerns about malpractice, all reported a prior medical malpractice claim, almost all of which were not mammography related. Among those wanting to leave mammography on a daily, weekly, or monthly basis, there was no difference by age category (3544 years, 4554 years, or 55 or more years). Radiologists more frequently considered withdrawing from mammography than from the practice of general radiology.
Radiologists' Perceptions of Future Malpractice Risk
The majority of radiologists (97 of 121 [80.2%]) estimated a probability of 10% or higher that they would be sued in the next 5 years if they were to interpret mammograms full time, with 47.9% (58 of 121) estimating the probability as 30% or higher. In actuality, among radiologists who had been practicing for at least 5 years, only 8.9% (11 of 124) reported that a mammography-related claim was filed against them between 1997 and 2001. The majority of radiologists with a previous mammography-related malpractice suit thought that their probability of being sued in the next 5 years was 50% or higher. The majority of radiologists (20 of 33 [61%]) who considered leaving mammography on a monthly, weekly, or daily basis thought that their probability of being sued in the next 5 years was 50% or higher (Fig 3).
|
|
| DISCUSSION |
|---|
|
|
|---|
In other areas of medicine, physicians believe that medical malpractice concerns influence their clinical practice, including causing them to refer more patients to other physicians and increasing the use of tests and procedures (3241). Interestingly, in our study, no direct association was noted between radiologists' reported concern about medical malpractice and their recall rates in actual practice. Two opposite hypotheses are possible: One potential explanation for this finding is that fear of malpractice does not actually influence practice and that physicians have overestimated the effect malpractice concerns have on their own clinical practice (42,43). Another possible explanation (42,44,45) is that the malpractice environment and concerns about malpractice may have affected the practice patterns of all physicians, regardless of their level of malpractice claim exposure. Even the radiologists who had not reported a claim or who responded that they were not practicing defensively might unconsciously be practicing defensively. We suspect this later explanation may be the case in mammography because the recall rate has been increasing over time in the United States (46) as malpractice concerns have risen.
In addition, U.S. radiologists appear to interpret a higher percentage of mammograms as abnormal than do radiologists from other countries where malpractice is less of a concern (6,47). Handwritten survey comments by radiologists who had had a prior malpractice claim described life as miserable during the year of discovery and depositions and conveyed a sense that we, in the present investigation, had identified the main problem in breast imaging today.
The majority of radiologists surveyed in our study estimated a very high probability of a future malpractice claim. Interestingly, their predictions of future malpractice risk were substantially higher than the actual historical risk noted. If the current rate of claims continues to rise consistently over time, it is possible that these radiologists' perceptions are correct. However, we suspect that these radiologists have highly overestimated the probability of being sued in the next 5 years. Physician perception of the risk of being sued has been heightened for many years (48). Interestingly, we see significant trends in that radiologists with heightened perceptions of future malpractice risk also more often think that malpractice influences their diagnostic recommendations and how often they consider withdrawing from the field of mammography. Education of the true risk of malpractice may allay their fears and possibly influence their mammography practice in a positive direction, reducing the false-positive rate.
The majority of women in the United States with abnormal screening mammograms do not have breast cancer but instead have false-positive examination results. It has been estimated that approximately 50% of women who undergo annual screening mammography over a decade will have at least one false-positive examination result (46). These false-positive examination results can lead to unnecessary diagnostic evaluations, with resultant high costs and possible morbidity (eg, infection after biopsy, scars), as well as provoke anxiety in women as they undergo follow-up evaluations (46). The trade-off between missing a cancer and calling too many women back for diagnostic evaluation is a challenging balance that may currently be influenced by malpractice concerns.
There were some potential limitations to this study. The surveyed radiologists were not a random sample of all U.S. radiologists but a representative sample of those interpreting mammograms in three distinct locations. It is therefore possible that these radiologists may not be completely representative of U.S. radiologists who practice mammography. This study also did not include states with the highest medical malpractice activity; indeed, we included two states with damage caps. In addition, data regarding malpractice were obtained by means of self-report, were for a short time period for some new radiologists, and were not verified; therefore, underreporting of malpractice experience was possible, and the number of radiologists reporting claims related to mammography was small.
Strengths of our study included a response rate of 76.8%, which is higher than national standards for physician surveys (49). No difference was noted between responders and nonresponders in terms of sex, number of years since medical school graduation, accuracy, and recall rates. This study in three geographic regions included community-based radiologists, not just academic radiologists, and involved a link between self-reported behavior and interpretive data from actual clinical practice.
One question this research raises is whether the heightened level of malpractice concern of practicing U.S. radiologists may lead to future workforce problems. This is of special concern because the predictions of future malpractice risk reported by radiologists may substantially overestimate the actual risk. Radiologists may refuse to interpret screening mammograms (as suggested by our data) or decide not to enter the field of mammography (as noted in a recent survey of radiology residents [50]). Demand for radiologists who can interpret mammograms will only increase in the future as more women seek screening and the population ages. Screening capacity could be affected by such a shortage, which may ultimately affect performance.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Abbreviations: BI-RADS = Breast Imaging Reporting and Data System
Authors stated no financial relationship to disclose
Author contributions: Guarantor of integrity of entire study, J.G.E.; study concepts and design, all authors; literature research, J.S.F., P.A.C., J.G.E.; data acquisition, J.S.F.; data analysis/interpretation, R.E.H., G.R.C., L.A.A., S.H.T., W.E.B., J.G.E.; statistical analysis, L.A.A., W.E.B.; manuscript preparation, J.S.F.; manuscript definition of intellectual content, editing, revision/review, and final version approval, all authors
| References |
|---|
|
|
|---|
900).
This article has been cited by other articles:
![]() |
S. L. Jackson, S. H. Taplin, E. A. Sickles, L. Abraham, W. E. Barlow, P. A. Carney, B. Geller, E. A. Berns, G. R. Cutter, and J. G. Elmore Variability of Interpretive Accuracy Among Diagnostic Mammography Facilities J Natl Cancer Inst, June 2, 2009; 101(11): 814 - 827. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. F. Dick III, T. H. Gallagher, R. J. Brenner, J. P. Yi, L. M. Reisch, L. Abraham, D. L. Miglioretti, P. A. Carney, G. R. Cutter, and J. G. Elmore Predictors of Radiologists' Perceived Risk of Malpractice Lawsuits in Breast Imaging Am. J. Roentgenol., February 1, 2009; 192(2): 327 - 333. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Berlin Malpractice and Breast Cancer: Perceptions Versus Reality Am. J. Roentgenol., February 1, 2009; 192(2): 334 - 336. [Full Text] [PDF] |
||||
![]() |
B. M. Geller, E. J. A. Bowles, H. Y. Sohng, R. J. Brenner, D. L. Miglioretti, P. A. Carney, and J. G. Elmore Radiologists' Performance and Their Enjoyment of Interpreting Screening Mammograms Am. J. Roentgenol., February 1, 2009; 192(2): 361 - 369. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Hofvind, P. M. Vacek, J. Skelly, D. L. Weaver, and B. M. Geller Comparing Screening Mammography for Early Breast Cancer Detection in Vermont and Norway J Natl Cancer Inst, August 6, 2008; 100(15): 1082 - 1091. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Taplin, L. Abraham, W. E. Barlow, J. J. Fenton, E. A. Berns, P. A. Carney, G. R. Cutter, E. A. Sickles, D. Carl, and J. G. Elmore Mammography Facility Characteristics Associated With Interpretive Accuracy of Screening Mammography J Natl Cancer Inst, June 18, 2008; 100(12): 876 - 887. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Sirovich, P. M. Gallagher, D. E. Wennberg, and E. S. Fisher Discretionary Decision Making By Primary Care Physicians And The Cost Of U.S. Health Care Health Aff., May 1, 2008; 27(3): 813 - 823. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Singh, S. Sethi, M. Raber, and L. A. Petersen Errors in Cancer Diagnosis: Current Understanding and Future Directions J. Clin. Oncol., November 1, 2007; 25(31): 5009 - 5018. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. J. Fenton, S. H. Taplin, P. A. Carney, L. Abraham, E. A. Sickles, C. D'Orsi, E. A. Berns, G. Cutter, R. E. Hendrick, W. E. Barlow, et al. Influence of Computer-Aided Detection on Performance of Screening Mammography N. Engl. J. Med., April 5, 2007; 356(14): 1399 - 1409. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Elmore and J. Choe Breast Cancer Screening for Women in Their 40s: Moving from Controversy about Data to Helping Individual Women Ann Intern Med, April 3, 2007; 146(7): 529 - 531. [Full Text] [PDF] |
||||
Read all eLetters
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| RADIOLOGY | RADIOGRAPHICS | RSNA JOURNALS ONLINE |