|
|
||||||||
Experimental Studies |
1 From the Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S Kingshighway Blvd, St Louis, MO 63110 (J.M.G., T.T., R.T., K.Y., C.F.H., K.T.B.); and Department of Radiology, Seoul National University College of Medicine, and the Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea (J.M.G.). Received April 23, 2004; revision requested July 2; revision received July 19; accepted August 18. Address correspondence to K.T.B. (e-mail: baet@mir.wustl.edu).
| ABSTRACT |
|---|
|
|
|---|
MATERIALS AND METHODS: Synthetic lung nodules of four different diameters (3.2, 4.8, 6.4, and 12.7 mm) were scanned with multidetector row CT. Images were reconstructed at various section thicknesses (0.75, 1.0, 2.0, 3.0, and 5.0 mm), fields of view (30, 20, and 10 cm), and reconstruction intervals (0.5, 1.0, and 2.0 mm). The nodules were segmented from the simulated background lung region by using four segmentation thresholds (300, 400, 500, and 600 HU), and their volumes were estimated and compared with a reference standard (measurements according to fluid displacement) by computing the absolute percentage error (APE). APE was regressed against nodule size, and multivariate analysis of variance (MANOVA) was performed with APE as the dependent variable and with four within-subject factors (field of view, reconstruction interval, threshold, and section thickness).
RESULTS: The MANOVA demonstrated statistically significant effects for threshold (P = .02), section thickness (P < .01), and interaction of threshold and section thickness (P = .04). The regression of mean APE values on nodule size indicates that APE progressively increases with decreasing synthetic nodule size (R2 = 0.99, P < .01).
CONCLUSION: For accurate measurement of lung nodule volume, it is critical to select a section thickness and/or segmentation threshold appropriate for the size of a nodule.
© RSNA, 2005
| INTRODUCTION |
|---|
|
|
|---|
One of the widely accepted characteristics of nodule malignancy is growth. The evaluation of nodule growth, however, is not without challenge. A commonly used method based on the linear measurement of nodule diameters is often inconsistent and unreliablefor detecting volumetric changes (9,10). Because nodules that are considered malignant would be further evaluated or treated more aggressively, it is important to obtain accurate and reliable measurements of nodule volume changes and thus increase diagnostic confidence. Consequently, with increasing applications of thin-section CT and lung cancer screening, the assessment of nodule growth has been an active area of research (1116). Computer-aided volumetric assessment of small pulmonary nodules for estimating growth is gaining wider acceptance (11,12,15).
The acquisition of appropriate three-dimensional imaging data is a prerequisite for accurate and reliable nodule volume measurement. There are many scanning and reconstruction parameters that affect the quantification of nodule volume (17,18). In general, improvement of spatial resolution by means of reduction of section thickness, field of view (FOV), and reconstruction interval should decrease errors in nodule volume measurement. The relative importance of these reconstruction parameters on the measurement of nodule volume, however, is not equal and likely depends on the size of nodules. Furthermore, with three-dimensional measurement methods, the nodules are segmented from the background lung parenchyma on CT images prior to volume measurement. The segmentation is usually based on gray-level thresholding, and the choice of threshold values influences the measured volumes of the segmented nodules. Although authors of several studies have investigated the effects of nodule size (13,14,19), thresholds (13,19), and section thickness (14) on the volumetric measurement of lung nodules, the combined effects of these parameters have not been reported. Thus, the purpose of our study was to evaluate the effects of various multidetector row CT reconstruction parameters and nodule segmentation thresholds on the accuracy of volumetric measurement of synthetic lung nodules.
| MATERIALS AND METHODS |
|---|
|
|
|---|
A chest CT phantom (Computerized Image Reference Systems, Norfolk, Va) was used to simulate a 5-cm-thick transverse section of the thorax (Fig 1). The lung region of the chest CT phantom was filled with a sculpted slab of polystyrene plastic matrix material (mean attenuation value, 990 HU). The synthetic nodules were embedded in this matrix material.
|
Nodule Volume Measurement on CT Images
All CT image sets were transferred to a personal computer with a 2.8-GHz Pentium IV processor (Intel, Santa Clara, Calif) and 1 GB of RAM. The images were displayed and processed by using a commercially available software program (Rapidia; Infinitt, Seoul, Korea). The program allowed the user to segment and measure the volume of the nodules at a user-defined attenuation threshold. After a nodule was identified and clicked on the screen by using a computer mouse, it was segmented in a fully automated fashion on the gray-level thresholds. All of the nodule volume measurements were performed by one radiologist (J.M.G., 13 years of experience with chest CT). We used four thresholds: 300, 400, 500, and 600 HU. These values were selected arbitrarily around the mean attenuation (430 HU) of the synthetic nodule (130 HU) and lung (990 HU) attenuations.
A total of 720 nodule volume measurements (five section thicknesses x three FOVs x three reconstruction intervals x four thresholds x four nodules) were evaluated.
Data and Statistical Analyses
For each CT image-based nodule volume measurement, the absolute percentage error (APE) was calculated as 100 x |Vm Vrs|/Vrs, where Vm and Vrs are the CT measured and reference-standard nodule volumes, respectively.
Mean APE values were calculated for the four sizes of synthetic nodules. Regression analysis was used to assess the association between the mean APE value and nodule size. A multivariate analysis of variance was performed with four within-subject factors (FOV, reconstruction interval, threshold, and section thickness). Interaction terms were included in the analysis. The Mauchley test was used to evaluate the sphericity assumption. To help assess interactions, the percentage error was plotted against nodule diameter, FOV, reconstruction interval, threshold, and section thickness. Statistical analyses were performed with Statistica software (version 6.0; StatSoft, Tulsa, Okla) and JMP statistical software (version 5.1; SAS, Cary, NC). P < .05 indicated a statistically significant difference.
| RESULTS |
|---|
|
|
|---|
We were unable to segment and measure the volume in 13 of 720 nodule combinations, because these nodules were faintly delineated because of partial volume effects. All of the missing values occurred with nodule diameters of 3.2 mm. Five values occurred at FOVs of 30 cm, four occurred at FOVs of 20 cm, and four occurred at FOVs of 10 cm. Seven missing values occurred at reconstruction intervals of 2.0 mm, three occurred at reconstruction intervals of 1.0 mm, and three occurred at reconstruction intervals of 0.5 mm. Ten of the missing values occurred at thresholds of 300 HU and three occurred at thresholds of 400 HU. Twelve missing values occurred at a section thickness of 5.0 mm and one occurred at a section thickness of 3.0 mm. Because we could not segment these nodules, our best estimate of their volumes was zero. The APEs for these measurements were, therefore, 100.
The multivariate analysis of variance demonstrated statistically significant effects for threshold (P = .02), section thickness (P < .01), and the interaction of threshold and section thickness (P = .04). Findings of Mauchley tests of sphericity were nonsignificant for these effects (P
.06); therefore, the reported P values are for the univariate F test. FOV, reconstruction interval, and other interactions (second, third, and fourth degree) were not statistically significant (P > .05).
Plots of mean APEs versus nodule sizes for five different section thicknesses are presented in Figure 2. Similar plots for four different thresholds are presented in Figure 3. The plots indicate consistently increasing APE with decreasing nodule size except for the threshold value of 600 HU for the 3.2-mm nodule size. To understand this exception, APEs for a 3.2-mm nodule and at threshold of 600 HU were tabulated (Tables 1, 2).
|
|
|
|
On scatter plots of percentage errors against nodule diameter, FOV, reconstruction interval, threshold, and section thickness, nodule volume tends to be overestimated with a threshold of 600 HU and underestimated with thresholds of 300 and 400 HU. As the size of a nodule decreased, the range of error increased in both directions (Fig 4).
|
| DISCUSSION |
|---|
|
|
|---|
An image-based nodule volume measurement method, however, has many intrinsic and practical limitations and is subject to measurement errors. For correct interpretation of nodule growth, it is critical to understand how various parameters affect nodule volume measurements and become sources of measurement error. Ko et al (13) evaluated the effect of imaging variables on the volumetric measurement of lung nodules by using a realistic phantom and suggested that a partial volume method, a high-frequency reconstruction algorithm, and CT performed with a diagnostic dose (120 mAs) would improve the precision of the volume measurements of lung nodules. Winer-Muram et al (14) measured and analyzed the volumes of simulated nodules in phantoms and in patients with stage I lung cancer and reported that the lung nodule volumes in phantoms were overestimated; this overestimation was directly proportional to the image section thickness and inversely proportional to the nodule size.
In the current study, we analyzed the effect of four key parameters (threshold, section thickness, FOV, and reconstruction interval) on nodule volume measurements by using synthetic lung nodules. Our results demonstrated the relative significance of these parameters with regard to how they affect measurement error. We believe this information contributes to the optimization of imaging protocols for accurate and repeatable nodule volume measurements with serial CT studies.
It is well known that varying the window center alters the measured volume even for relatively large lesions or nodules (9,19,22). Our study findings also revealed that the segmentation threshold is a significant determinant of measurement errors. The most common approach for measuring the volume of lung nodules is based on gray-level thresholding, which allows a user to segment lung nodules from the background parenchyma and measure the volume of the segmented voxels (12,13,15,16). The selection of an appropriate threshold for lung nodule segmentation is crucial. Optimal threshold levels may be determined from valleys on the histogram of lung nodule and parenchyma attenuations or from levels that provide a statistical maximal separation between the regions to be distinguished (16). Previous study findings have demonstrated that a structure is most accurately represented when the display window center is set midway between the CT attenuation of the structure of interest and the background (22). In our study, thresholds of 500 and 400 HU, which are closer to the mean of the attenuations of the nodule (130 HU) and the background (990 HU), resulted in smaller errors than thresholds of 600 and 300 HU (Fig 3). In practice, the application of a single fixed threshold is the simplest and most consistent approach for segmenting nodules. The midway attenuation between the nodules and parenchyma may not be fixed, however, because the attenuation values of nodules vary depending on their type. Furthermore, segmentation for nonsolid and part-solid nodules frequently requires a much lower threshold than that required for solid nodules. Even in the same nodule, small peripheral lung neoplasms may have a replacement growth pattern. As found in a study by Kakinuma et al (23), the ground-glass opacities of lung cancer nodules not only increase in size or attenuation but may also decrease rapidly or slowly with the appearance of solid components. This variable growth pattern could not be recognized with the use of a single fixed threshold.
The results of our study also demonstrated that section thickness is an important parameter in nodule volume measurement. With multidetector row CT, thin-section volumetric imaging in the whole lung becomes routine, particularly for lung cancer screening studies (24,25). A drawback of this practice is that a thin-section CT scan of the whole thorax generates a large dataset (typically 250350 images of 1.0-mm section thickness), which requires considerable time to interpret and analyze (26).
With the CT image matrix size fixed at 512 x 512, the voxel dimension is proportional to the FOV. Some studies used a FOV of 9.6 cm (11,12) in measuring nodule volumes, while another study used a 30-cm FOV (13). The effect of FOV on volume measurement has not, however, been studied. In the current study, FOV did not have a significant effect on the APE. This result is not surprising, in part, because the size of in-plane resolution differences (0.200.59 mm) due to the choices in FOV in our study was much lower than that of longitudinal resolution differences (0.755.0 mm) due to the choices in section thickness.
In three-dimensional imaging, the reconstruction interval is one of the parameters that affects the longitudinal resolution. With smaller reconstruction intervals, the number of overlapping transverse images increases and the longitudinal resolution improves. Brink et al (27) suggested that singledetector row helical CT images should be reconstructed with at least 60% overlap relative to the effective section thickness to obtain maximal longitudinal resolution. It is possible that a further increase in the overlap percentage may not provide a measurable gain in the longitudinal resolution. Although reconstruction interval was not expressed as a percentage of section thickness in our study, reconstruction interval itself was not a significant parameter in determining volume measurement error.
For a 3.2-mm nodule imaged on 5.0- or 3.0-mm-thick sections, the attenuation of all the pixels within the nodule was below 300 HU in 10 cases and 400 HU in three cases because of the partial volume effect. Therefore, the volumes of these nodules were measurable at low thresholds (500 or 600 HU) but not at high thresholds (300 or 400 HU). We could not measure the volume of nodules in 2% of the cases. For these cases, we considered our measurement error to be 100%. We believe that this was a reasonable procedure for dealing with these cases.
In plots of error measurement against nodule size for thresholds and section thicknesses, the error progressively increased with decreasing nodule size except for the 600 HU threshold for the 3.2-mm nodule size. This phenomenon may have been caused by an interaction between parameters. Our statistical analysis demonstrated significant interaction between section thickness and threshold. Tables 1 and 2 were used to interpret this exception. In general, the error increases as the section thickness increases, and the nodule volume tends to be overestimated as the threshold decreases (Figs 2, 4). For a 3.2-mm nodule at a threshold of 600 HU, however, the error decreases as the section thickness increases (Tables 1, 2). The attenuation of the surface voxels of a nodule decreases as the section thickness increases because of partial volume effect, but at the same time the volume of the voxel also increases as the section thickness increases. The volume measurement error, therefore, depends on both the threshold and the section thickness; with some combinations, both parameters act in the same direction, and with other combinations, the parameters act in opposition direction. Compared with large nodules, small nodules are sensitive to these effects because the proportion of surface voxels is larger in small nodules. For a 3.2-mm nodule, thick section thickness acted in the direction of underestimation, which counteracted the effect of overestimation by a threshold of 600 HU.
Our analysis also demonstrated a statistically significant decreasing relationship between measurement error and nodule size: Smaller nodules tended to have higher measurement errors. As nodules become smaller, the partial volume effect and measurement error increase (12,14,15). This effect is reduced with the use of smaller voxel or isotropic voxel size.
There were several limitations of our study. We used motion-free spherical homogeneous nodule phantoms, which do not accurately represent clinical reality. All of the synthetic nodules had the same attenuation value, and nodules with attenuation equivalent to ground-glass opacity of lesions were not included. The software package we used was not specifically designed for measuring lung nodule volume, and the measurement of nodule volumes was based on a thresholding method. We, however, believe that this simplified phantom study design has allowed us to achieve the aim of our study, that is, the evaluation of the effect of reconstruction and technical parameters on nodule volume measurement error.
In summary, the results of our study demonstrated that nodule size, section thickness, and threshold were significant parameters in determining volume measurement errors. The FOV and reconstruction interval did not significantly affect volume measurement error. For an accurate volumetric measurement of a lung nodule, it is critical to select a section thickness and/or segmentation threshold appropriate for the size of the nodule.
Practical application: Accurate measurement of nodule volume is crucial in the current scheme of imaging-based assessment of malignancy in small nodules. Because the acquisition and reconstruction parameters for CT imaging can significantly affect the accuracy of nodule volume measurement, it is important to select appropriate parameters to achieve a desired accuracy. The results of the present study suggest that we should be more attentive to the selection of section thickness and segmentation threshold than to selection of FOV and reconstruction interval for an accurate measurement of nodule volume.
| FOOTNOTES |
|---|
Authors stated no financial relationship to disclose.
Author contributions: Guarantors of integrity of entire study, J.M.G., K.T.B.; study concepts, J.M.G., K.Y., K.T.B.; study design, J.M.G., T.T., R.T., C.F.H., K.T.B.; literature research, J.M.G., K.T.B.; experimental studies, J.M.G., T.T., R.T., K.Y.; data acquisition, J.M.G., T.T., R.T.; data analysis/interpretation, all authors; statistical analysis, J.M.G., C.F.H., K.T.B.; manuscript preparation, J.M.G., T.T., K.Y.; manuscript definition of intellectual content, J.M.G., R.T., C.F.H., K.T.B.; manuscript editing, J.M.G., K.T.B.; manuscript revision/review and final version approval, all authors
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
Y. Wang, R. J. van Klaveren, H. J. van der Zaag-Loonen, G. H. de Bock, H. A. Gietema, D. M. Xu, A. L. M. Leusveld, H. J. de Koning, E. T. Scholten, J. Verschakelen, et al. Effect of Nodule Characteristics on Variability of Semiautomated Volume Measurements in Pulmonary Nodules Detected in a Lung Cancer Screening Program Radiology, August 1, 2008; 248(2): 625 - 631. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. A. Bankier, C. R. O'Donnell, and P. M. Boiselle Quality Initiatives * Respiratory Instructions for CT Examinations of the Lungs: A Hands-on Guide RadioGraphics, July 1, 2008; 28(4): 919 - 931. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Ravenel, W. M. Leue, P. J. Nietert, J. V. Miller, K. K. Taylor, and G. A. Silvestri Pulmonary Nodule Volume: Effects of Reconstruction Parameters on Automated Measurements--A Phantom Study Radiology, May 1, 2008; 247(2): 400 - 408. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Honda, T. Johkoh, H. Sumikawa, A. Inoue, N. Tomiyama, N. Mihara, Y. Fujita, M. Tsubamoto, M. Yanagawa, T. Daimon, et al. Pulmonary Nodules: 3D Volumetric Measurement with Multidetector CT Effect of Intravenous Contrast Medium Radiology, December 1, 2007; 245(3): 881 - 887. [Abstract] [Full Text] [PDF] |
||||
![]() |
H Bolte, C Riede, S Muller-Hulsbeck, S Freitag-Wolf, G Kohl, T Drews, M Heller, and J Bieder Precision of computer-aided volumetry of artificial small solid pulmonary nodules in ex vivo porcine lungs Br. J. Radiol., June 1, 2007; 80(954): 414 - 421. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Petrou, L. E. Quint, B. Nan, and L. H. Baker Pulmonary Nodule Volumetric Measurement Variability as a Function of CT Slice Thickness and Nodule Morphology Am. J. Roentgenol., February 1, 2007; 188(2): 306 - 312. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. C. Yeshwant, R. M. Summers, J. Yao, D. S. Brickman, J. R. Choi, and P. J. Pickhardt Polyps: Linear and Volumetric Measurement at CT Colonography Radiology, December 1, 2006; 241(3): 802 - 811. [Abstract] [Full Text] [PDF] |
||||
![]() |
J.-S. Kim, J.-H. Kim, G. Cho, and K. T. Bae Automated Detection of Pulmonary Nodules on CT Images: Effect of Section Thickness and Reconstruction Interval--Initial Results Radiology, July 1, 2005; 236(1): 295 - 299. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| RADIOLOGY | RADIOGRAPHICS | RSNA JOURNALS ONLINE |