Radiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


DOI: 10.1148/radiol.2231011125
This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Baker, J. A.
Right arrow Articles by Soo, M. S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Baker, J. A.
Right arrow Articles by Soo, M. S.
(Radiology 2002;223:229-238.)
© RSNA, 2002


Breast Imaging

Breast US: Assessment of Technical Quality and Image Interpretation1

Jay A. Baker, MD and Mary Scott Soo, MD

1 From the Division of Breast Imaging, Duke University Medical Center, Erwin Rd, Box 3808, Durham, NC 27710. Received June 28, 2001; revision requested July 23; revision received October 2; accepted October 10. Address correspondence to J.A.B. (e-mail: baker013@mc.duke.edu).


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
PURPOSE: To determine whether ultrasonography (US) of the breast performed at a wide range of clinical practices conforms to the American College of Radiology (ACR) standards for quality and to assess the interpretations of breast sonograms.

MATERIALS AND METHODS: Static images from 152 breast US examinations performed at 86 institutions were evaluated for compliance with ACR guidelines for breast US hardware, technical factors, imaging protocol, and image annotation. Official interpretations submitted by the referring facilities were compared with static images submitted by the facility. Discrepancies were confirmed by two dedicated breast radiologists after repeat imaging, short-interval follow-up imaging, or biopsy.

RESULTS: A total of 60.5% of cases did not comply with at least one ACR guideline on breast US and included 9.2% of cases with inadequate equipment, 14.7% of cases with inappropriate focal zone placement, at least 14% of cases with static images in only one imaging plane, and 25% of cases with incomplete patient identifiers. Clinically relevant interpretation errors and interpretation discrepancies were confirmed in 23 (15.1%) of 152 cases.

CONCLUSION: The majority of breast US examinations did not comply with at least some of the standards for quality set forth by the ACR. Attention to these basic standards could substantially improve image quality.

© RSNA, 2002

Index terms: Breast, ACR reporting and data system • Breast, US, 00.1298, 00.92, 00.94 • Images, interpretation, 00.1298 • Quality assurance, 00.1298


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Reduction in breast cancer mortality in the past 2 decades has resulted from early detection of breast carcinoma by using screen-film mammography and reliance on high-quality imaging. However, problems related to radiation exposure (13), poor image quality (1,47), and variability in image interpretation that can affect patient outcome (810) have been documented in numerous studies. Tremendous effort has been made to ensure image quality in mammography, which resulted in accreditation programs such as the federally mandated Mammography Quality Standards Act (11).

Although interest in quality breast imaging has largely focused on screen-film mammography, ultrasonography (US) in the breast also plays a critical role in the diagnostic evaluation of screening-detected or palpable masses. US with a high-frequency transducer is essential for accurate noninvasive diagnosis of breast cysts and has shown promise in the differentiation of benign from malignant solid masses (12,13). In addition, US has been advocated and shown to be potentially useful in the examination of young or pregnant symptomatic patients (14), guidance of percutaneous needle interventions (15,16), and even in screening of some asymptomatic patients (17,18). Like screen-film mammography, however, breast US can be technically challenging and requires state-of-the-art equipment, with appropriate technical settings to create an optimal image. Furthermore, breast US is highly user dependent, as normal tissue can simulate a breast lesion while some breast cancers may be subtle. Finally, considerable variability has previously been demonstrated in the interpretation of breast sonograms (19,20).

Although no federal laws similar to the Mammography Quality Standards Act govern the practice of breast US, professional guidelines for performing high-quality breast US have been established by the American College of Radiology (ACR) standards (21). These guidelines specify equipment, technical factors, image annotation, and personnel "which should generally produce high-quality radiological care." However, no studies to our knowledge have evaluated the quality of breast US performed at modern breast imaging facilities. For this study, we reviewed breast sonograms obtained in diverse breast imaging facilities in patients who subsequently sought care at our tertiary care medical center. The purpose of this study was to evaluate the technical quality and imaging appearance of breast sonograms based on the ACR standards and to assess differences between initial interpretation of images and reinterpretation at this facility.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Institutional review board approval was obtained for this study; informed consent was not required for this review. The study population consisted of all women who presented for the purpose of comparison or reinterpretation (ie, second opinion) to our Breast Imaging Division between October 2000 and March 2001 with breast sonograms obtained at an outside institution. Sonograms were excluded if they were obtained prior to January 1, 1999; were obtained outside the United States; or were obtained primarily to guide percutaneous needle interventions. A total of 152 breast sonograms obtained between January 1999 and March 2001 in 143 patients were identified, and they compose the study. In nine patients who underwent two examinations, sonograms were obtained at least 6 months apart and at different anatomic sites. Patient age was noted, and the name and location (city, state) of the practice facility where each examination was performed were recorded.

One board-certified radiologist (J.A.B.) with fellowship training in breast imaging and 4 years of experience in breast US retrospectively reviewed each sonogram. First, the reviewer was blinded to screen-film mammograms, any further imaging performed at our institution, written interpretations provided with the studies, and final histopathologic or clinical outcomes of each case. Sonograms were evaluated to determine if they met the criteria of technical and image quality outlined in the ACR standards (21). Second, all available sonograms were compared with written interpretations of the sonograms from the referring institution, as well as mammograms and histopathologic information. Discrepancies between the original interpretation and the subsequent reinterpretation and/or biopsy outcome were noted. One of three fellowship-trained breast imagers (including M.S.S.) with 5, 8, or 9 years experience with breast US confirmed subjective evaluations of the image quality and interpretation discrepancies with the original outside reading. Final subjective decisions were made with consensus agreement among the observers.

Technical Evaluation of Image Quality
Static sonograms of the breast were evaluated to determine whether they satisfied the ACR guidelines for hardware, technical settings, and labeling, as listed in Figure 1.



View larger version (70K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 1. Guidelines adapted from the ACR standards for breast US.

 
The type of transducer (eg, linear, sector) was determined by the shape of the transducer-tissue interface (ie, linear or curved). The frequency of the transducer was determined with annotation on the static images.

The focal zone depth was compared with the depth of the imaged lesion or breast tissue. Appropriate focal zone depth was defined as being within 1 cm superficial to the anterior mass margin or within 1 cm deep to the posterior mass margin. Focal zones placed outside this range were recorded as either 1–2 cm too superficial or deep or more than 2 cm too superficial or deep.

Subjective assessments of the image gray scale and field of view were recorded and confirmed by a second experienced fellowship-trained breast imager. Image gray scale was subjectively evaluated and determined to be (a) appropriate, (b) inappropriate—high gain, or (c) inappropriate—low gain. Because the ACR standards describe only desired gray scale relative to cysts, and most sonograms in this study did not depict a cyst, appropriate gray scale was defined as images that displayed fat lobules as varying shades of gray. Sonograms on which fat lobules ranged from predominantly light gray to white were classified as inappropriate—high gain and would likely cause inappropriate echoes within simple cysts. Sonograms on which the parenchyma ranged from predominantly dark gray to black were classified as inappropriate—low gain, which could potentially mask legitimate low-level echoes in cysts or disguise solid, markedly hypoechoic masses as simple anechoic cysts.

In addition to the guidelines specified in the ACR standards, the field of view used to examine a lesion was also evaluated. Appropriate field of view was defined as one that included the entire mass along with sufficient superficial tissue to assess the depth of the mass from the skin and sufficient posterior tissue to assess posterior transmission of the ultrasound beam. Restricted field of view was defined as an entire examination that included all documented static images on which lesion depth, mass margins, or posterior sound transmission were not depicted. Sonograms of large masses that were simply larger than the footprint of the transducer were not included in the restricted category. Field of view was defined as excessive if more than 4 cm of tissue posterior to the mass or targeted tissue was included in the image, which resulted in an unnecessarily small image of the target area.

Each study was examined to determine whether images in two orthogonal planes were recorded. Images were examined for the presence of at least one caliper measurement of all clinically relevant abnormalities.

Image Documentation
Static images were reviewed for the labeling of anatomic location where the image was obtained. "Right" or "left" breast annotation was recorded and subsequently compared with that of available screen-film mammograms and written interpretations to determine if the right or left labeling was correct. Labeling of a specific anatomic position by using diagrammatic pictogram, breast quadrant, or clock annotation was noted. Any modifiers of the transducer position that indicated the distance from the nipple were also noted.

Each static image was examined for the notation of orientation (ie, transverse or longitudinal or radial or antiradial) of the US transducer relative to the patient, which was either written on the image in text format or noted on a diagrammatic pictogram. Note was made whether transducer orientation was annotated on all static images, more than half of static images, less than half of static images, or not indicated on any of the static images.

ACR standards indicate specific patient-identifying information that should be permanently documented on each US image. Each image was examined for permanent documentation of the patient’s first and last name, date of birth or other identifying number, date of study, name and location of the imaging facility, and identification of the sonographer or sonologist.

Image Interpretation
The official interpretation of the sonogram obtained from the outside interpreting institution or practice was available for review for 71 of the 152 sonograms. In each case, the static sonograms and any available mammograms from the referring institution were examined with the final interpretation from the referring facility. Additional sonograms were obtained at this facility when needed to clarify the findings from the original sonograms. Discrepancies between the official outside interpretation and the reinterpretation after repeat scanning at this facility were confirmed by a second dedicated breast imaging radiologist (including M.S.S.) and verified with biopsy and histopathologic evidence in 11 cases, additional US imaging with a state-of-the-art 13-MHz linear-array transducer (Elegra; Siemens Medical Systems, Issaquah, Wash) in six cases, or additional US imaging and at least 12 months of follow-up imaging in six cases. A discrepancy in interpretation was documented only if it had the potential to be clinically relevant and was classified in one of six categories: 1, characteristically benign mass interpreted as suspicious; 2, suspicious mass interpreted as typically benign; 3, normal fibroglandular tissue interpreted as a solid suspicious mass; 4, solid mass present but not perceived; 5, complex or solid masses interpreted as simple cyst; and 6, lesion at US did not correlate with mammographic finding.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
In 143 patients (age range, 30–87 years; mean age, 50.9 years ± 11.8 [SD]), 152 sonograms were obtained at 86 facilities in 63 cities from 18 states. Between one and seven cases (mean, 1.8 ± 1.5) were referred from each facility.

Technical Evaluation of Image Quality
All 152 US examinations were performed with linear transducers. The transducer frequency could be determined for 151 examinations and ranged from 5 to 13 MHz. In 137 (90.7%) examinations, a transducer frequency of at least 7.0 MHz, or a center frequency of at least 6.0 MHz for broadband transducers, was used. Ten (6.6%) examinations were performed with a transducer frequency of less than 7.0 MHz. Thirty-three (21.8%) studies were performed with either a 7.0- or 7.2-MHz transducer. A 7.5-MHz transducer was used in 30 (19.9%) examinations, while a transducer frequency of more than 7.5 MHz was used in 39 (25.8%) examinations. A broadband transducer with a center frequency of at least 6 MHz was used in 35 (23.2%) examinations and of less than 6 MHz, in four (2.6%) examinations. Therefore, in 14 (9.3%) of 151 examinations, a transducer frequency of less than 7.0 MHz (10 cases) or broadband center frequency of less than 6.0 MHz (four cases) was used.

The depth of the focal zone was indicated on 150 sonograms. The focal zone was placed appropriately within 1 cm of the depth of the targeted tissue on 128 (85.3%) sonograms. The focal zone was placed between 1 and 2 cm deep to the targeted tissue on 17 (11.3%) sonograms and more than 2 cm beyond the targeted tissue on five (3.3%). Therefore, the focal zone was inappropriately positioned on 22 (14.7%) sonograms on which its position could be determined (Figs 2, 3). The focal zone was not set superficial to the targeted tissue on any sonograms.



View larger version (95K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 2. Transverse sonogram of the breast obtained in a 42-year-old woman illustrates the inappropriate placement of the focal zone cursor (>). The focal zone is placed at the level of lung tissue, 1.5 cm posterior to the pectoralis muscle (p). Although the breast parenchyma is only 1.0-1.5-cm deep, the depth of field is set at 6 cm, which results in complete attenuation of the posterior 3 cm of the image due to air in the lungs. A 7.0-MHz transducer (arrow) was used for this examination.

 


View larger version (73K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 3a. (a) Transverse sonogram of the breast obtained in a 33-year-old woman demonstrates an 8-mm ill-defined hypoechoic mass (calipers). A 7.5-MHz linear transducer was used. Focal zone cursors (arrowheads) were placed 1 and 2 cm deep to the posterior margin of the mass. Depth of field is set at 5 cm. The mass was interpreted as solid and suspicious for malignancy (Breast Imaging Reporting and Data System, or BI-RADS, category 4). (b) Repeat antiradial sonogram demonstrates a homogeneous circumscribed hypoechoic mass (arrow) adjacent to the skin. This mass had been stable at mammography for 2 years and had characteristic features of a sebaceous cyst at physical examination.

 


View larger version (93K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 3b. (a) Transverse sonogram of the breast obtained in a 33-year-old woman demonstrates an 8-mm ill-defined hypoechoic mass (calipers). A 7.5-MHz linear transducer was used. Focal zone cursors (arrowheads) were placed 1 and 2 cm deep to the posterior margin of the mass. Depth of field is set at 5 cm. The mass was interpreted as solid and suspicious for malignancy (Breast Imaging Reporting and Data System, or BI-RADS, category 4). (b) Repeat antiradial sonogram demonstrates a homogeneous circumscribed hypoechoic mass (arrow) adjacent to the skin. This mass had been stable at mammography for 2 years and had characteristic features of a sebaceous cyst at physical examination.

 
Gray-scale gain, as assessed with consensus of the two fellowship-trained breast imagers, was subjectively characterized as inappropriate on seven (4.6%) of 152 sonograms, which included five cases deemed inappropriate—high gain (ie, too bright) (Fig 4) and two cases deemed inappropriate—low gain (ie, too dark). Field of view was judged appropriate on 137 (90.1%) sonograms. Of the remaining sonograms, 15 (9.9%) met the criteria that defined excessive field of view, while none met the criteria for a restricted field of view.



View larger version (132K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 4. Dual-mode sonogram of the breast obtained at an outside referring facility. Transverse (left) and longitudinal (right) projection images obtained in a 49-year-old woman show a 1.0-cm irregularly shaped hypoechoic mass (arrows), which was confirmed at excisional biopsy to represent an infiltrating ductal adenocarcinoma. The surrounding fibroglandular tissue and pectoralis muscle are uniformly markedly hyperechoic and cannot be distinguished, which indicates an inappropriately high setting of the gray-scale gain.

 
The specific orientation of the US transducer was not labeled on any of the images in 16 (10.5%) of the 152 US studies. In 12 (7.9%) additional examinations, transducer orientation was properly labeled on fewer than half of the static images. In 19 (14%) of 136 examinations in which transducer orientation was at least occasionally labeled, only one projection was recorded, and two orthogonal views were not included or were not accurately labeled. Of the 136 examinations, 114 (83.8%) used transverse or longitudinal projections while 22 (16.2%) used radial or antiradial projections.

A mass or other abnormality was identified on 119 of 152 sonograms. At least one static image with caliper measurement was documented in 116 (97.5%) examinations. Three (2.5%) abnormalities were not measured in any projection, while 28 (23.5%) were measured in only one imaging plane.

Image Documentation
On 150 (98.7%) of 152 sonograms, the left or the right breast imaged was correctly labeled. On 151 (99.3%) sonograms, information regarding the specific anatomic location where the static image was obtained, either in the form of clock position, quadrant position, or as depicted on a pictogram, was provided. Some indication of the distance of the lesion from the nipple was provided on 20 (13.1%) sonograms.

The patient’s first and last name were accurately labeled on 149 (98.0%) of 152 sonograms. On one sonogram, only the patient’s first name was listed, while patients’ last names were misspelled on two other sonograms. On 18 (11.8%) sonograms, a patient-identifying number such as date of birth or medical record number was not listed. The name of the imaging institution was included on 128 (84.2%) sonograms. On 38 (25%) sonograms, at least one of the three required patient identifiers—full name, identifying number, and name of the facility—was not accurately labeled. Although permanent documentation of the location of the imaging facility and the sonographer’s or sonologist’s name, initials, or identifying symbol are advised in the ACR standards, this information was absent from virtually all sonograms. This absence was not included in the final determination of the sonograms that met the guidelines of the ACR standards.

Overall ACR Criteria
In this study of 152 breast sonograms, compliance with all ACR guidelines in the performance of breast US examinations (except labeling of imaging facility location and sonographer or sonologist identifier) was documented in 39.5% of cases. Ninety-two (60.5%) cases did not fully meet all ACR standards with regard to US hardware used, technical factors selected, imaging projections, lesion measurement, image documentation, or patient identification. An additional 22 (14.4%) cases did not meet subjective standards for image quality owing to unsuitable gray-scale gain setting or inappropriate field of view.

Image Interpretation
In 23 (15.1%) of the 152 cases, substantial disagreements between the original interpretation and the subsequent interpretation at this institution were identified. Only disagreements in interpretation with the potential to affect patient outcome were included. Discrepancies were confirmed with biopsy and histologic evaluation in 11 cases, consensus of two dedicated breast imagers by using repeat mammographic and US studies in six cases, and repeat imaging with at least 12 months follow-up (range, 12–15 months) in six cases. Although the official interpretation was available for review in 71 of the 152 cases, virtually all of the remaining cases showed either no abnormality, obvious simple cysts for which the patient received no additional treatment, or a suspicious mass for which the patient presented for definitive biopsy.

Of the 23 sonograms with discrepancies in interpretation, five (21.7%) were identified on which a characteristically benign mass was interpreted as suspicious for malignancy, and biopsy was recommended. Three of these masses were reinterpreted at this institution as typical benign-appearing intramammary lymph nodes (Fig 5) with pathognomonic "horseshoe" or "target sign" appearance. Intramammary lymph node was not mentioned as a differential diagnosis in any of the official outside interpretations of these sonograms. Biopsy was recommended in a patient with silicone breast implants for a lesion with the characteristic appearance of extracapsular silicone (Fig 6). Core-needle biopsy performed at the request of the referring surgeon confirmed the diagnosis of foreign body giant cell reaction with abundant silicone. A final lesion in which imaging at the referring facility was performed in only the antiradial projection was interpreted as a suspicious solid mass. Repeat US at this institution demonstrated a dilated duct that appeared anechoic and elongated and extended to the nipple when imaged in the radial projection (Fig 7). Again, histologic examination after wire localization and surgical excision confirmed benign duct ectasia rather than a solid mass.



View larger version (116K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 5a. (a) Mediolateral oblique spot-compression magnification mammogram obtained at an outside facility in a 53-year-old woman with a saline breast implant shows an oval 7-mm mass (arrow) with a central lucency characteristic of an intramammary lymph node. Radiopaque marker indicates the site of a skin mole. (b) Transverse sonogram obtained at an outside facility demonstrates a 7-mm oval hypoechoic mass (arrow) with central hyperechogenicity also characteristic of a lymph node. The mass was interpreted at the referring facility as a solid complex mass suspicious for malignancy (BI-RADS category 4), and biopsy was recommended.

 


View larger version (84K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 5b. (a) Mediolateral oblique spot-compression magnification mammogram obtained at an outside facility in a 53-year-old woman with a saline breast implant shows an oval 7-mm mass (arrow) with a central lucency characteristic of an intramammary lymph node. Radiopaque marker indicates the site of a skin mole. (b) Transverse sonogram obtained at an outside facility demonstrates a 7-mm oval hypoechoic mass (arrow) with central hyperechogenicity also characteristic of a lymph node. The mass was interpreted at the referring facility as a solid complex mass suspicious for malignancy (BI-RADS category 4), and biopsy was recommended.

 


View larger version (91K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 6a. (a) Mediolateral spot-compression magnification mammogram obtained in a 50-year-old woman with silicone breast implants demonstrates a 10-mm high-density mass (arrow) in the superior right breast. (b) Radial sonogram of the mass shows the characteristic "snowstorm" or "echogenic shadowing" appearance (straight arrows) of extracapsular silicone adjacent to the silicone implant (curved arrow). The mass was reported as highly suspicious (BI-RADS category 5), and biopsy was recommended by an outside imaging facility with no mention of the possibility of extracapsular silicone. Needle biopsy performed at the request of the referring surgeon confirmed foreign body giant cell reaction with abundant silicone.

 


View larger version (119K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 6b. (a) Mediolateral spot-compression magnification mammogram obtained in a 50-year-old woman with silicone breast implants demonstrates a 10-mm high-density mass (arrow) in the superior right breast. (b) Radial sonogram of the mass shows the characteristic "snowstorm" or "echogenic shadowing" appearance (straight arrows) of extracapsular silicone adjacent to the silicone implant (curved arrow). The mass was reported as highly suspicious (BI-RADS category 5), and biopsy was recommended by an outside imaging facility with no mention of the possibility of extracapsular silicone. Needle biopsy performed at the request of the referring surgeon confirmed foreign body giant cell reaction with abundant silicone.

 


View larger version (129K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 7a. (a) Antiradial sonogram of the breast obtained at an outside referring facility in a 39-year-old woman with white nipple discharge was interpreted at that facility as demonstrating a circumscribed oval hypoechoic mass (calipers). Imaging was performed in the antiradial projection only. (b) Sonogram in the radial projection of the same breast repeated at this facility shows that the structure elongates (arrows) and extends radially toward the nipple (N). A blood vessel was seen wrapping around the structure (arrowhead), which was interpreted at this facility as a dilated lactiferous duct and was confirmed with wire localization and surgical excision at the request of the patient’s surgeon.

 


View larger version (103K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 7b. (a) Antiradial sonogram of the breast obtained at an outside referring facility in a 39-year-old woman with white nipple discharge was interpreted at that facility as demonstrating a circumscribed oval hypoechoic mass (calipers). Imaging was performed in the antiradial projection only. (b) Sonogram in the radial projection of the same breast repeated at this facility shows that the structure elongates (arrows) and extends radially toward the nipple (N). A blood vessel was seen wrapping around the structure (arrowhead), which was interpreted at this facility as a dilated lactiferous duct and was confirmed with wire localization and surgical excision at the request of the patient’s surgeon.

 
Conversely, two (8.7%) of the 23 lesions were interpreted at the referring facility as typically benign but actually demonstrated suspicious US features on static images obtained from those facilities. In both lesions, biopsy was performed at this institution, and invasive adenocarcinoma was confirmed in each case.

In nine (39.1%) of 23 cases, the referring facility reported a solid suspicious mass, which at evaluation of the static images was reinterpreted at this institution to likely represent normal fibroglandular tissue (Fig 8). When repeat high-frequency high-resolution US was performed at this institution, no mass could be identified. For eight of the nine cases, US examination at the referring institution was performed with transducer frequency of between 5 and 7.5 MHz. Field of view met the criteria for "excessive" in three of these nine cases, and in one case, imaging was performed in only one projection.



View larger version (121K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 8a. (a) Sagittal and (b) transverse sonograms of the right breast obtained for the evaluation of breast tenderness in a 42-year-old woman. The calipers denote a region of normal-appearing fibroglandular tissue that is identical to the surrounding tissue. The official interpretation from the referring facility was a "1.5-cm solid suspicious mass" for which biopsy was recommended. Normal breast tissue was identified at US-guided core-needle biopsy.

 


View larger version (128K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 8b. (a) Sagittal and (b) transverse sonograms of the right breast obtained for the evaluation of breast tenderness in a 42-year-old woman. The calipers denote a region of normal-appearing fibroglandular tissue that is identical to the surrounding tissue. The official interpretation from the referring facility was a "1.5-cm solid suspicious mass" for which biopsy was recommended. Normal breast tissue was identified at US-guided core-needle biopsy.

 
A solid mass was actually present but was not perceived at the referring facility in two (8.7%) of 23 cases with clinically relevant interpretation discrepancies. Repeat US clearly depicted a suspicious hypoechoic solid mass in both cases. Findings from biopsies performed for both cases revealed one case of infiltrating ductal adenocarcinoma and one case of benign fibroadenoma. In retrospect, ductal carcinoma was evident but not perceived on the static images obtained by the referring facility (Fig 9), while the fibroadenoma was simply overlooked and not imaged.



View larger version (161K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 9a. (a) Transverse sonogram of a palpable mass in a 44-year-old woman demonstrates two adjacent superficial cysts (calipers) and a large markedly hypoechoic irregularly shaped mass with posterior acoustic shadowing (arrows). Outside interpretation noted only cysts with final BI-RADS assessment of a 2—benign finding. (b) Repeat transverse sonogram obtained at a second outside facility shows a core biopsy needle (curved arrows) entering the large mass (straight arrows). Final histologic finding revealed invasive adenocarcinoma.

 


View larger version (128K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 9b. (a) Transverse sonogram of a palpable mass in a 44-year-old woman demonstrates two adjacent superficial cysts (calipers) and a large markedly hypoechoic irregularly shaped mass with posterior acoustic shadowing (arrows). Outside interpretation noted only cysts with final BI-RADS assessment of a 2—benign finding. (b) Repeat transverse sonogram obtained at a second outside facility shows a core biopsy needle (curved arrows) entering the large mass (straight arrows). Final histologic finding revealed invasive adenocarcinoma.

 
In three (13%) of 23 cases, structures initially interpreted as simple cysts were confirmed with biopsy or repeat imaging to represent noncystic lesions. Biopsy findings confirmed a benign fibroadenoma in one case (Fig 10) and an organized hematoma in another. In the third case, imaging was performed at the referring facility in only the transverse plane. After reimaging at this institution in radial and antiradial planes, the structure had an appearance pathognomonic of a lactiferous duct, which included tubular shape, anechoic echogenicity, and extension to the nipple.



View larger version (132K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 10. Antiradial sonogram obtained in a 42-year-old woman demonstrates a 9-mm circumscribed hypoechoic mass (calipers) with increased posterior transmission of the sound beam (arrows). The mass was initially interpreted as a simple cyst, and no further evaluation was recommended. The mass was subsequently reinterpreted as either a complex cyst or a solid mass, because internal echoes are evident on the static image. US-guided core-needle biopsy after unsuccessful cyst aspiration revealed fibroadenoma.

 
In the remaining two cases, the US lesion identified at the referring institution did not correlate properly with the mammographic abnormality that prompted the US examination. This discrepancy was confirmed in both cases with dramatically different measurements at mammography and initial US and at repeat US at our facility.

Each of the 23 cases with differing interpretations or histologically confirmed interpretation errors had the potential for substantial effect on the patient’s care. Unnecessary biopsies were recommended by the referring facility in 14 cases with either normal fibroglandular tissue (nine cases) or a typically benign mass (five cases), while two malignancies were interpreted as typically benign, and one malignancy was overlooked.


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Quality assurance has been a major issue in breast imaging for more than 25 years. In the 1970s, authors of several studies reported wide-ranging radiation doses, which resulted in both markedly underexposed and overexposed, possibly dangerous, mammograms (1,6). In the 1980s, improvements in dedicated screen-film mammographic equipment largely addressed issues regarding radiation (22), and concern shifted to the variability in image quality and interpretation accuracy (5,6). In response to reports from the medical community and the U.S. Food and Drug Administration and pressure from women’s advocacy lobby organizations, the U.S. Congress passed the Mammography Quality Standards Act in October 1992, with final regulations promulgated in 1998, which oversees all aspects of the practice of screening mammography (23). This oversight includes mandated quality control tests on equipment and processors; training levels required for interpreting radiologists, technologists, and medical physicists; and evaluation of image quality of phantom and clinical images. With the advent of Mammography Quality Standards Act and continued technical improvements in both mammographic equipment and dedicated screen-film combinations, the quality of mammography practiced in the United States has improved measurably (24,25).

However, the Mammography Quality Standards Act addresses only one modality of breast imaging: screen-film mammography. During the 1990s, breast US has steadily increased in importance in breast evaluation. Initially used only to help differentiate cysts from solid breast masses, breast US has acquired new roles due in part to substantial improvements in instrumentation. Higher frequency transducers and all-digital imaging systems have resulted in marked improvements in image resolution and contrast. On the basis of the fine detail of US images, authors of several studies (12,13) now advocate the use of US to help differentiate benign from malignant solid breast masses. US is widely used as a tool for guiding percutaneous interventions, which include cyst aspiration, core-needle biopsy, and wire localization. Some investigators (18) have demonstrated potential improvements in breast cancer detection by including US in the screening protocol in patients with mammographically dense parenchyma.

As increased use of mammography in the 1970s and 1980s prompted closer evaluation of the technical factors and image quality, increased importance and complexity of breast US warrant a similar examination of the practice quality. One measure of quality in breast US is the guidelines issued by the ACR in the form of ACR standards (21). The ACR standards address indications for performing breast US and appropriate qualifications and responsibilities of the personnel involved. ACR guidelines on US equipment, technical factors, imaging protocols, and required labeling of the static sonograms were evaluated in this study.

The ACR standards provide guidance on US equipment appropriate for performing high-quality breast examinations. The standards specify that for breast US, linear-array transducers should be used with at least 7-MHz frequency or with a center frequency of at least 6 MHz for broadband systems. Almost 10% of sonograms analyzed in this study failed to meet this minimum requirement. In some cases, transducer frequencies as low as 5 MHz were used. For those who use single-frequency transducers less than 7.0 MHz, we believe that low-frequency transducers substantially limit the fine image detail of the breast, which can result in errors of interpretation, and every effort should be made to upgrade such systems to the highest frequency transducer possible. In other cases in this study, a variable-frequency transducer was used and inadvertently set at the minimum available frequency rather than the maximum frequency available for the transducer, despite the location of the target in the near field. In cases in which the minimum frequency was used, the ACR standard was not met owing to either a lack of awareness of the need for maximum available frequency or inattentiveness to the technical details of the examination.

With the assumption that the required hardware is available, technical settings play a substantial role in accurate US imaging and interpretation. For example, the ACR standards stipulate that "The focal zone should be set at the depth of the lesion," because the focal zone provides the narrowest beam and the best possible resolution. Misplacement of the focal zone can be due to either a lack of understanding of its preferred placement or oversight of the technical factors of the study. Nevertheless, in almost 15% of cases in this study, the focal zone was placed more than 1 cm deep to either the posterior margin of the targeted lesion or, when no lesion was present, to the interface between retroglandular fat and pectoralis muscle. Appropriate placement of the focal zone may substantially improve image resolution at no additional cost.

The ACR standards provide additional guidance on technical factors that affect the breast sonogram. In accordance with the standards, "gain settings should be adjusted to allow simple cysts to be distinguished from solid masses ... [but] not so high that artifactual echoes are placed within simple cysts." Evaluation of gray-scale images is nevertheless subjective, which is a limitation of this study. Almost 5% of the outside breast sonograms in this study were judged to have gray-scale settings sufficiently hypoechoic or hyperechoic so that a lesion could be overlooked or misinterpreted. In these cases, normal fat lobules were inappropriately displayed as virtually anechoic or completely hyperechoic.

A protocol for high-quality breast US is outlined in the ACR standards and requires imaging and documentation of a lesion or the area of interest in at least two orthogonal planes. Imaging in orthogonal planes is particularly important in breast US, because breast lesions may be subtle and may be detected in only one projection and because normal breast anatomy, including fat lobules and lactiferous ducts, may mimic a lesion in only one plane. In fact, the ACR standards plainly stipulate that "one view is insufficient." In this study, imaging was performed in only one plane, or the image plane was not labeled in more than one of every six cases.

Although measurements of breast lesions in two orthogonal projections are not explicitly required, the ACR standards specify that "the maximal dimensions of a mass should be included." Almost all lesions in this study were measured in at least one imaging plane. However, in almost one-quarter of cases, the largest dimension in the second orthogonal plane was not documented. Routine measure of abnormalities in both planes increases the likelihood that the largest dimension will be recorded and increases the likelihood that imaging will be performed routinely in orthogonal projections. By routinely following a breast US protocol that includes imaging and measurements in two orthogonal views, a substantial number of breast sonograms could be improved or better documented at no additional cost to the patient and essentially at no additional cost in hardware or time to the imaging facility.

The most common deviation from the ACR standards in this study was a failure to adequately annotate the static images obtained from breast US. Although anatomic location was correctly documented in almost all examinations, appropriate identification of the patient and imaging facility on the sonograms was often inadequate. The ACR standards specify that the patient’s first and last name, identification number and/or date of birth, and facility name should be permanently recorded on the images. In 25% of cases in this study, one or more of these identifying labels were not listed. Each is important to prevent confusion regarding which patient underwent imaging and where the procedure was performed. An identifying number is particularly important in the event that two patients share similar names. Again, at no cost to the patient or imaging facility, inclusion of this information on every image can reduce the likelihood of error.

Although the primary goal of this study was to evaluate the technical quality of breast US as currently performed, official image interpretations were also reviewed. Substantial disagreements between the original outside interpretation and the subsequent reinterpretation at this facility were documented in at least 15.1% of cases. These cases included initially overlooked breast carcinoma, misdiagnosed typically benign masses, and normal breast parenchyma misclassified as suspicious masses.

Although the specific cases of interpretation discrepancy are disturbing, the 15.1% error rate is considered an estimate in this investigation for three reasons. First, cases in this study include only those patients who were referred or sought a second opinion at this institution. Therefore, the study population is more likely to include complicated cases or cases in which the patient was not confident of the reported result. Second, official interpretations from the facility at which the sonogram was obtained were available in only 71 of the 152 cases. Therefore, although clinically important discrepancies were found in 23 (32.4%) cases, many of the remaining sonograms showed obvious simple cysts, conspicuous suspicious masses, or no abnormality. To provide the most conservative estimate of the interpretation error rate, these sonograms were presumed to have been correctly interpreted, because the cases appeared straightforward and the patients received appropriate referral for clinical evaluation, routine screening, or biopsy. The resulting discrepancy rate is therefore estimated at 15.1% (23 of 152 cases). Third, only 11 of the 23 interpretation discrepancies were confirmed with biopsy. In the remaining cases, either immediate repeat imaging was performed for cases deemed pathognomonic or repeat imaging was performed with at least 1-year follow-up. Given these limitations, the calculated discrepancy rate of 15.1% is considered the minimum rate for the 152 sonograms included in this study. However, the complexity of these cases may not be representative of the complexity observed in routine clinical practice. A formal study of interpretation accuracy in breast US should be undertaken.

Nevertheless, interpretation discrepancies identified in this study raise concern regarding the quality of breast US interpretation performed in current clinical practice. Many of the cases suggest a lack of awareness of the expected appearance of benign structures, such as normal fat lobules, intramammary lymph nodes, and extracapsular silicone. Interpretation differences such as mistaking a dilated lactiferous duct for a solid mass suggest a lack of familiarity with optimal scanning technique, such as imaging in orthogonal planes, particularly in radial and antiradial projections where a lactiferous duct is most often evident. Less common, breast cancers were misinterpreted as benign findings or were not identified despite static images demonstrating the cancer. Some of the interpretation differences identified in this study may have been due to the referring radiologists’ evaluation of only static images rather than an actual observation or performance of the breast US. This effect has been studied previously in abdominal US (26) but to our knowledge has not been evaluated in breast imaging.

Overall, 60.5% of cases failed to meet at least some quality criteria of the ACR standards, and at least 15.1% of the cases had potentially important discrepancies in image interpretation. These findings suggest the need for renewed focus on the technical details of performing breast US. Interpretation discrepancies in this study—including two missed breast cancers—may signify the need for practitioners of breast US to update their interpretation skills. Clinically relevant discrepancies between the interpretation at the original imaging facility and reinterpretation at this facility also suggest the need to reduce interobserver or interinstitution variability. The voluntary ACR Breast Ultrasound Accreditation Program (www.acr.org/departments/stand_accred/accreditation/us_breast_bio_over .html) addresses some of these issues by specifying equipment requirements, personnel qualifications, quality control procedures, quality assurance activities, and evaluation of image quality. In an era of increased mandatory regulation in the field of breast imaging, radiologists engaged in breast US should carefully evaluate their present practices and consider the advantages of voluntary accreditation as a step toward addressing deficiencies.


    FOOTNOTES
 
Abbreviation: ACR = American College of Radiology

Author contributions: Guarantor of integrity of entire study, J.A.B.; study concepts and design, J.A.B., M.S.S.; literature research, J.A.B.; clinical studies, J.A.B.; data acquisition, J.A.B.; data analysis/interpretation, J.A.B., M.S.S.; manuscript preparation, J.A.B., M.S.S.; manuscript definition of intellectual content, J.A.B.; manuscript editing, revision/review, and final version approval, J.A.B., M.S.S.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 

  1. Bicehouse H. Survey of mammographic exposure levels and technique used in Eastern Pennsylvania In: Seventh Annual National Cancer Conference on Radiation Control. Hyannis, Mass: DHEW Publication 76-8026, 1975.
  2. Jans R, Butler P, McCrohan JJ, Thompson W. The status of film/screen mammography: results of the BENT study. Radiology 1979; 132:197-200.[Abstract]
  3. Upton A, Beebe G, Brown J, et al. Report of NCI ad hoc working group on the risks associated with mammography in mass screening for detection of breast cancer. J Natl Cancer Inst 1977; 59:579-593.
  4. Reuter F. Preliminary report—NEXT 85: national conference on radiation control. Presented at the 18th Annual Conference on Radiation Control Program Directors. Charleston, WVa 1986.
  5. Conway B, McCrohan J, Reuter F, Suleiman O. Mammography in the eighties. Radiology 1990; 177:335-339.[Abstract/Free Full Text]
  6. Galkin B, Feig S, Muir H. The technical quality of mammography in centers participating in a regional breast cancer awareness program. RadioGraphics 1988; 8:133-145.[Abstract]
  7. Hendrick R, Chrvala C, Plott C, Cutter G, Jessop N. Improvement in mammography quality control: 1987–1995. Radiology 1998; 297:663-668.
  8. Vineis P, Sinistrero G, Temporelli A, et al. Inter-observer variability in the interpretation of mammograms. Tumori 1988; 74:275-279.[Medline]
  9. Elmore JG, Wells CK, Lee CH, Howard DH, Feinstein AR. Variability in radiologists’ interpretations of mammograms. N Engl J Med 1994; 331:1493-1499.[Abstract/Free Full Text]
  10. Howard DH, Elmore JG, Lee CH, Wells CK, Feinstein AR. Observer variability in mammography. Trans Assoc Am Physicians 1993; 106:96-100.[Medline]
  11. Mammography Quality Standards Reauthorization Act of 1998. Pub L No. 105–248 1998.
  12. Stavros AT, Thickman D, Rapp CL, Dennis MA, Parker S, Sisney G. Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. Radiology 1995; 196:123-134.[Abstract/Free Full Text]
  13. Skaane P, Engedal K. Analysis of sonographic features in the differentiation of fibroadenoma and invasive ductal carcinoma. AJR Am J Roentgenol 1998; 170:109-114.[Abstract/Free Full Text]
  14. Jackson V, Reynolds H, Hawes D. Sonography of the breast. Semin Ultrasound CT MR 1996; 17:460-475.[CrossRef][Medline]
  15. Liberman L. Clinical management issues in percutaneous core breast biopsy. Radiol Clin North Am 2000; 38:791-807.[CrossRef][Medline]
  16. Parker S, Stavros A, Dennis M. Needle biopsy techniques. Radiol Clin North Am 1995; 33:1171-1186.[Medline]
  17. Buchberger W, Niehoff A, Obrist P, DeKoekkoek-Doll P, Dunser M. Clinically and mammographically occult breast lesions: detection and classification with high-resolution sonography. Semin Ultrasound CT MR 2000; 21:325-336.[CrossRef][Medline]
  18. Kolb T, Lichy J, Newhouse J. Occult cancer in women with dense breasts: detection with screening US—diagnostic yield and tumor characteristics. Radiology 1998; 207:191-199.[Abstract/Free Full Text]
  19. Skaane P, Engedal K, Skjennald A. Interobserver variation in the interpretation of breast imaging: comparison of mammography, ultrasonography, and both combined in the interpretation of palpable noncalcified breast masses. Acta Radiol 1997; 38:497-502.[Medline]
  20. Baker J, Kornguth P, Soo M, Walsh R, Mengoni P. Sonography of solid breast lesions: observer variability of lesion description and assessment. AJR Am J Roentgenol 1999; 172:1621-1625.[Abstract/Free Full Text]
  21. American College of Radiology. ACR standards 2000–2001 Reston, Va: American College of Radiology, 2000.
  22. Haus A, Culinan J. Screen film processing systems for medical radiography: a historical review. RadioGraphics 1989; 9:1203-1223.[Abstract]
  23. Mammography Quality Standards Act of 1992. Pub L No. 102–539 1992.
  24. Suleiman O, Spelic D, McCrohan J, Symonds G, Houn F. Mammography in the 1990s: the United States and Canada. Radiology 1999; 210:345-351.[Abstract/Free Full Text]
  25. Pisano E, Schell M, Rollins J, et al. Has the Mammography Quality Standards Act affected the mammography quality in North Carolina?. AJR Am J Roentgenol 2000; 174:1089-1091.[Abstract/Free Full Text]
  26. Chan V, Hanbidge A, Wilson S, Pron G, Moore L. Case for active physician involvement in US practice. Radiology 1996; 199:555-560.[Abstract/Free Full Text]



This article has been cited by other articles:


Home page
Am. J. Roentgenol.Home page
E.-K. Kim, K. H. Ko, K. K. Oh, J. Y. Kwak, J. K. You, M. J. Kim, and B.-W. Park
Clinical Application of the BI-RADS Final Assessment to Breast Sonography in Conjunction with Mammography
Am. J. Roentgenol., May 1, 2008; 190(5): 1209 - 1215.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
M. J. Kim, E.-K. Kim, J. Y. Kwak, B.-W. Park, S.-I. Kim, J. Sohn, and K. K. Oh
Role of Sonography in the Detection of Contralateral Metachronous Breast Cancer in an Asian Population
Am. J. Roentgenol., February 1, 2008; 190(2): 476 - 480.
[Abstract] [Full Text] [PDF]


Home page
J Ultrasound MedHome page
B. Mesurolle, T. Helou, M. El-Khoury, M. Edwardes, E. J. Sutton, and E. Kao
Tissue Harmonic Imaging, Frequency Compound Imaging, and Conventional Imaging: Use and Benefit in Breast Sonography
J. Ultrasound Med., August 1, 2007; 26(8): 1041 - 1051.
[Abstract] [Full Text] [PDF]


Home page
radtechHome page
T. G. ODLE
Breast Ultrasound
Radiol. Technol., January 1, 2007; 78(3): 222M - 242M.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
W. A. Berg, J. D. Blume, J. B. Cormack, and E. B. Mendelson
Operator Dependence of Physician-performed Whole-Breast US: Lesion Detection and Characterization.
Radiology, November 1, 2006; 241(2): 355 - 365.
[Abstract] [Full Text] [PDF]


Home page
J Ultrasound MedHome page
M. Costantini, P. Belli, R. Lombardi, G. Franceschini, A. Mule, and L. Bonomo
Characterization of solid breast masses: use of the sonographic breast imaging reporting and data system lexicon.
J. Ultrasound Med., May 1, 2006; 25(5): 649 - 659.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Baker, J. A.
Right arrow Articles by Soo, M. S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Baker, J. A.
Right arrow Articles by Soo, M. S.