|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Thoracic Imaging |
1 From the Departments of Radiology, Physics, and Biomedical Engineering, Duke University Medical Center, DUMC 3302, Durham, NC 27710 (E.S.); and Departments of Radiology (E.S., M.J.F., W.R.E.) and Biostatistics and Research Epidemiology (E.P.), Henry Ford Health System, Detroit, Mich. Received May 15, 2002; revision requested July 12; revision received August 7; accepted September 26. Supported in part by a small project grant from the Henry Ford Health Sciences Center, Detroit, Mich, and by the NIH, R21 CA91806. Address correspondence to E.S. (e-mail: samei@duke.edu).
| ABSTRACT |
|---|
|
|
|---|
MATERIALS AND METHODS: Six 8 x 8-cm lung regions were extracted from digital chest radiographs obtained in healthy subjects. Simulated nodules emulating the radiographic characteristics of subtle tissue-equivalent lesions 3.26.4 mm in diameter (equivalent to 0.10.4 mm in contrast-diameter product [CD]) were added to the images. On multiple renditions of each image, nodules were inserted at slightly different locations within 6 mm of the center; this process allowed different local background patterns to overlie the nodules. An observer detection study involving 15 experienced radiologists was performed. The authors performed analysis of variance and pairwise t test analyses to determine variations in nodule detectability related to nodule location and size on each image.
RESULTS: Results indicated a strong correlation between nodule size and observer detection score and significant variation in nodule detectability as a function of location. Changes in nodule position caused observer score variations that were equivalent to the variation caused by an up to 185% change in nodule CD (78% average over all six images), an up to 68% change in diameter (32% average), and an up to 28% change in area under the receiver operating characteristic curve (Az) (14% average).
CONCLUSION: Local anatomic variations surrounding and overlying a subtle lung nodule on a chest radiograph that are created by the projection of anatomic features in the thorax, such as ribs and pulmonary vessels, can greatly influence the detection of nodules, altering the Az by as much as 28%.
© RSNA, 2003
Index terms: Diagnostic radiology, observer performance Lung, nodule, 60.1215, 60.281 Lung neoplasms, diagnosis, 60.1215, 60.31 Radiography, digital, 60.1215 Thorax, radiography, 60.1215
| INTRODUCTION |
|---|
|
|
|---|
American Cancer Society statistics indicate that the 5-year survival rate for patients with lung cancer can be improved from an average of 14% to up to 49% if the disease is diagnosed early, when it is still in a localized stage (3). However, only 15% of lung cancers are discovered in the early stage (5). Failure to detect these lesions may result in costly delays in appropriate treatment, not only for patients with primary cancer but also for those with metastatic cancer in the lungs in whom the stage or evidence of malignancy is being determined or followed up.
The detection of subtle abnormalities on medical images is limited by noise. The noise on chest radiographs can be categorized into two major types: radiographic noise (ie, mottle) (6,7) and anatomic noise (8). In chest radiography, anatomic noise has by far the greatest influence on the detection of pulmonary nodules (911). In a previous study (12), the detectability of tissue-equivalent nodules on background images with only radiographic mottle and on background images with radiographic mottle and anatomic noise was measured by means of observer performance experiments. To achieve equivalent detection, the nodules in anatomic noise backgrounds had to have contrast-diameter products at least one order of magnitude larger than those for the nodules in radiographic noise backgrounds. This finding suggests that anatomic noise influences the detection of subtle lung nodules more substantially than does radiographic noise and that if the detection of subtle lung nodules depicted on chest radiographs is to be improved, then a better understanding of the mechanism of this influence is warranted.
The purpose of this study was to assess the influence of anatomic noise on the detectability of subtle lung nodules depicted on chest radiographs. The study was focused on the influence of local anatomic noisethat is, variations immediately surrounding or overlying suspected lesionsas opposed to general anatomic variations within the image (13). Another aim of this study was to substantiate the magnitude of the influence of local anatomic noise on the detection of subtle lung nodules in typical anatomic backgrounds on chest radiographs in terms of variations in nodule size and in area under the receiver operating characteristic curve (Az).
| MATERIALS AND METHODS |
|---|
|
|
|---|
All radiographs in the database were acquired as 2k images (matrix size, 1,760 x 2,140) with an upright computed radiography chest unit (FCR-9501-HQ; Fuji Medical Systems, Tokyo, Japan) by using 35 x 43-cm2 standard-resolution imaging plates (ST-Va; Fuji Medical Systems) and a moving 12:1 antiscatter grid (Gilardoni, Milan, Italy) (15). All image acquisitions were performed with a 115-kVp x-ray beam emitted from a high-frequency x-ray generator (1050 HF; Acoma, Wheeling, Ill); the exposures were phototimed by using an automatic exposure control that was calibrated to operate the computed radiography system as a 200-speed-equivalent system (22.7 mR entrance exposure for a typical 22-cm-thick patient). The computed radiography sensitivity values of the radiographs used in the study ranged from 196 to 348 (mean, 271).
From the selected chest images, six 8 x 8-cm regions (400 x 400 array) were extracted from random positions within the lung areas on the radiographsone region per image. The selected regions were used in the nodule simulations and subsequent observer performance experiments, which are detailed in the following text.
Nodule Simulation
Simulated nodules emulating the radiographic characteristics of tissue-equivalent lesions were computationally superimposed into the central area on the six lung images. Superpositioning was performed by subtracting the nodule contrast profiles from the log-signal data on the images. Contrast was defined in terms of relative change in exposure-dependent linear detector signal (
E/E). The subtraction was performed by means of transforming the desired contrast into the log-signal units associated with the latitude of the acquired computed radiographic image. The simulated nodules were circular and had subject-contrast profiles based on a mathematical function deduced from a database of real lung nodules (16), as follows:
|
Five different sizes of simulated nodules were used in the study. These nodules had peak contrast-diameter products that resulted in a range of average detectability valuesAz values of approximately 0.60 to approximately 0.95as determined in a previous study (12). All nodules had contrast-diameter ratios that would correspond to the ratios expected from spherical uniform tissue-equivalent lesions within the lung (16). The characteristics of the simulated nodules that were used in the study are listed in Table 1.
|
|
|
|
|
|
|
|
For each image, the average pixel value from a 128 x 128 central block was obtained prior to insertion of the nodules and used as the mean value for the higher contrast Gaussian component. This process ensured that the average contrast and the average optical density at the center of all images, where the nodules were inserted, were constant. We "padded" the images with 2.6-cm horizontal and 4.1-cm vertical margins of 1.8 constant optical density to create visual glare characteristics during the reading sessions that were similar to the visual glare characteristics that are present at actual clinical image interpretations. The 186 images were then randomized by using a random-number generator and printed on 31 sheets of film (six images on one sheet) by using a laser printer (model XLP; Eastman-Kodak, Rochester, NY). The printer was calibrated, and its linearity was verified to be between film optical densities of 0.1 and 3.0 before the images were printed.
Observer Performance Experiments
Fifteen experienced radiologists participated in the study. Each observer read the images independently in three separate sessions. The sessions were scheduled at least 1 day apart. At the beginning of each reading session, the observer protocol was explained. The observers were told that there was an 80% chance that a 36-mm-diameter nodule was located within
inch of the center of each image. The observer was instructed to discern whether a nodule was present on each image and to grade his or her level of confidence in this interpretation by using a five-point scale: -2 meant most likely not present; -1, probably not present; 0, equivocal; +1, probably present; and +2, most likely present. A priori knowledge of the approximate location of the nodules was expected to result in higher detection rates than those observed in actual clinical practice. However, this methodology was implemented because the goal of this study was to examine the rate of nodule detection when the approximate location was known.
Before each reading session, the observer viewed two graded example films, each containing six images of a lung background with six superimposed simulated nodules of increasing contrast-diameter product values along with their expected confidence gradings. The viewing of example films was followed by the reading of two practice films. The observer was subsequently provided with the expected answers so that he or she could assess the visibility level of the nodules and adjust his or her confidence grading. All of the readings were performed on the same view box with optimal environmental surroundings, including low ambient lighting. The observers read the images in different orders to average out any possible memory effect. No time constraints were imposed on the observers. The average reading time for each session (1011 films, 6066 images) was about 15 minutes, for a total of about 45 minutes of reading per observer.
Data Analysis
We analyzed the observer scores to determine the detectability of the nodules on each image, as averaged among all observers as a function of the nodule contrast-diameter product (or corresponding nodule size) and the nodule location. For each image, the variation in nodule detectability due to nodule size was characterized by a least-squares linear regression fit to the mean observer scores versus the nodule contrast-diameter product. To investigate how the detectability of a nodule may vary from one location to another, paired t test comparisons of the mean scores from any two locations were performed; thus, a total of ten pairwise comparisons per image and per nodule size were performed. The Holm sequential procedure was used to adjust and evaluate the P values that indicated the rejection of the null hypothesis (ie, a definite difference in nodule detectability between any two of the locations being compared) (18). The overall influence of location on nodule detectability among all five locations within an image was also assessed by using analysis of variance of the mean observer scores, with the P values adjusted and evaluated again by using the Holm sequential procedure (18).
To understand the magnitude of the interference of local background tissue in the detection task, we attempted to compare the variation in mean observer score due to nodule location with the variation in mean score due to change in nodule size. The minimally detectable significant difference in mean observer score due to nodule location was equated by using contrast-diameter productdependent changes in mean observer scores (characterized in terms of the slope of the linear regression fit). This task was performed by using analysis of variance for repeated measures for each combination of image and nodule size (ie, 30 combinations).
With knowledge of the relationship between the contrast-diameter product and the diameter of the tissue-equivalent nodules used in the study, the variation in nodule detectability as a function of nodule location was also expressed in terms of change in nodule diameter. In addition, we derived an empirical relationship from data reported in a previous study (12) to relate the contrast-diameter product of a subtle lung nodule as follows: Az = 0.615log(CD) + 1.231 and R2 = 0.994, where CD is the contrast-diameter product and the Az is between 0.7 and 0.9. The data in the previous study (12) were obtained from very similar experiments in which the exact location was known. With use of this relationship, the magnitude of the nodule location effect was further expressed in terms of Az.
| RESULTS |
|---|
|
|
|---|
|
|
|
The results of the paired t test for the significance of differences in mean observer score for any two locations per image and per nodule size (ie, contrast-diameter product) are summarized in Figure 5. The results confirm the qualitative indications illustrated in Figure 4, as just summarized: Any two locations for which the observer scores were notably different in Figure 4 are noted to be significantly different in terms of P values in Figure 5.
|
|
|
| DISCUSSION |
|---|
|
|
|---|
At the global level, the detectability of a nodule is determined by the degree of the nodules distinctiveness from false-positive findings created by the overall noise characteristics of the background tissue. At this level, nodule detection is independent of nodule location. With a global treatment of anatomic noise, one does not take into account the spatial characteristics of the background structure or the possible local correlation between the background and the signal. In the past, many investigators (1923) have used the global approach to model the detection of lesions on medical images, and this method has proved to be valid for some detection tasksfrom dental radiography to CT. In chest radiography, the global treatment of anatomic variations has also resulted in outcomes that correlated closely with observer results (12). However, there have also been indications that slight changes in the location of a nodule can affect nodule detection dramatically (17); these findings suggest that local interference has an important role in the detection of lung nodules on chest radiographs.
Some investigators have tried to assess the degrading influence of local background lung structure on lesion detection. Most noteworthy are the investigations of Revesz et al (11), Revesz and Kundel (24,25), and Kundel et al (26) of the effect of anatomic noise (described as structured noise in the studies) on the detection of lung nodules. Their formulation of the concept of conspicuity in the detection process takes into account the spatial characteristics of the immediate background structure and the possible local correlation between the background noise and the signal. However, the results of some later studies (2729) indicate that this approach may be inadequate for complete quantification of the influence of background structures.
This study aimed to quantify the influence of local anatomic variations on the detection of subtle lung nodules on chest radiographs; findings indicate that small changes in a nodules location can vary the detection of the nodule by an Az of up to 28% (14% average for all images used in this study). This variation is equivalent to that caused by changing the contrast-diameter product of a nodule at a fixed location by a factor of 185% (78% average for all images). With the assumption that nodules are spherical and tissue equivalent, this change would correspond to a 68% change in nodule diameter (32% average for all images).
Several promising methods to reduce the influence of anatomic noise have been developed. The rib pattern is a prominent component of anatomic noise on chest radiographs because about two-thirds of the lung region on posteroanterior chest radiographs is covered by bone (30). Dual-energy digital chest radiography enables one to eliminate bone structures from a chest radiograph by using the difference in spectral absorption characteristics of bone and soft tissue (3133). To our knowledge, the image quality characteristics of this imaging method, particularly the noise characteristics, have not been fully evaluated. Nevertheless, improved detection of lung nodules with use of this technique has been reported (3436). In addition, a relatively new technology, dual-energy imaging, is under clinical evaluation.
The notable influence of local anatomic noise on lesion detection suggests that an imaging technique that involved the use of multiple projections of the chest would have the potential to improve the detection of lung nodules. The findings of this study imply that the potential improvement in nodule detection afforded by a multiprojection technique would be more than that expected from the increased chance of detecting a lesion due to an increase in the number of images read. Stereo chest radiography (28,37) and digital tomosynthesis (3840) are two such techniques. Stereo chest radiography, once a popular imaging technique (41), has long been replaced by two-view posteroanterior or lateral chest radiography owing to economic considerations, additional anatomic features depicted in the lateral view, complications associated with the stereoscopic perception of translucent objects (42,43), and an unproven notion that if a lesion can be seen on a single radiograph, then the acquisition of a second radiograph may not be justified (44). Recent developments in biplane chest imaging suggest that stereo chest radiography should perhaps be revisited as a method for improved detection of lung nodules (45). The second technique, digital tomosynthesis, is currently under investigation and awaits further technical development, commercial implementation, and clinical evaluation.
CT represents an effective method of substantially reducing the influence of anatomic noise on lung nodule detection because it eliminates overlays of anatomic structures associated with projection imaging. Clinical trial results have demonstrated the usefulness of low-dose CT in screening for lung cancer (1). However, at present, the broad use of CT as a direct screening method for subtle lung nodules is controversial owing to economic (eg, cost and technology availability) and patient care (patient dose and overdiagnosis) considerations. If CT is to be used for early cancer detection, then the need for thin-section scans (ie, approximately 1-mm sections) will further increase the cost and dose associated with this imaging examination.
| FOOTNOTES |
|---|
Author contributions: Guarantor of integrity of entire study, E.S.; study concepts, E.S., M.J.F.; study design, all authors; literature research, E.S.; experimental studies, E.S., M.J.F., W.R.E.; data acquisition, E.S., W.R.E.; data analysis/interpretation, all authors; statistical analysis, E.S., E.P.; manuscript preparation, E.S.; manuscript definition of intellectual content and editing, all authors; manuscript revision/review, E.S.; manuscript final version approval, all authors.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
H HAYASHI, K ASHIZAWA, M UETANI, S FUTAGAWA, A FUKUSHIMA, K MINAMI, S HONDA, and K HAYASHI Detectability of peripheral lung cancer on chest radiographs: effect of the size, location and extent of ground-glass opacity Br. J. Radiol., April 1, 2009; 82(976): 272 - 278. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Girvin and J. P. Ko Pulmonary Nodules: Detection, Assessment, and CAD Am. J. Roentgenol., October 1, 2008; 191(4): 1057 - 1069. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J. Tapiovaara Review of relationships between physical measurements and user evaluation of image quality Radiat Prot Dosimetry, March 1, 2008; 129(1-3): 244 - 248. [Abstract] [Full Text] [PDF] |
||||
![]() |
N Buls, W Shabana, P Verbeek, P Pevenage, and J De Mey Influence of display quality on radiologists' performance in the detection of lung nodules on radiographs Br. J. Radiol., September 1, 2007; 80(957): 738 - 743. [Abstract] [Full Text] [PDF] |
||||
![]() |
D S Brettle, E Berry, and M A Smith The effect of experience on detectability in local area anatomical noise Br. J. Radiol., March 1, 2007; 80(951): 186 - 193. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. P. McAdams, E. Samei, J. Dobbins III, G. D. Tourassi, and C. E. Ravin Recent Advances in Chest Radiography Radiology, December 1, 2006; 241(3): 663 - 683. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. J. M. Kroft, W. J. H. Veldkamp, B. J. A. Mertens, J. P. A. van Delft, and J. Geleijns Detection of simulated nodules on clinical radiographs: dose reduction at digital posteroanterior chest radiography. Radiology, November 1, 2006; 241(2): 392 - 398. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. W. Venema, M. van Straten, G. J. den Heeten, T. M. Bernhardt, H. Lenzen, and W. Heindel Digital Radiography of the Chest: Reassessment of the High-Voltage Technique? * Dr Bernhardt and colleagues respond: Radiology, April 1, 2005; 235(1): 336 - 338. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| RADIOLOGY | RADIOGRAPHICS | RSNA JOURNALS ONLINE |