Radiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Karadi, C.
Right arrow Articles by Napel, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Karadi, C.
Right arrow Articles by Napel, S.
Related Collections
Right arrowRelated Article
(Radiology. 1999;212:195-201.)
© RSNA, 1999


Computer Applications

Display Modes for CT Colonography1

Part I. Synthesis and Insertion of Polyps into Patient CT Data

Chandu Karadi, PhD, Christopher F. Beaulieu, MD, PhD, R. Brooke Jeffrey, Jr, MD, David S. Paik, MS and Sandy Napel, PhD

1 From the Departments of Medicine (C.K., D.S.P.) and Radiology (C.F.B., R.B.J., S.N.), Stanford University School of Medicine, Lucas MRS Center P-268, Stanford, CA 94305-5488. Received July 20, 1998; revision requested September 24; revision received November 18; accepted January 11, 1999. Supported in part by National Institutes of Health grants 1R01 CA72023, 1P41 RR09784-01, and LM 07033, the Packard Foundation (Los Altos, Calif), the Lucas Foundation (Menlo Park, Calif), and the Phil N. Allen Trust (Menlo Park, Calif). C.F.B. is a 1997 RSNA Scholar. C.K. is a 1998 GENDEX/RSNA Medical Student/Scholar Assistant. Address reprint requests to S.N. (e-mail: snapel@stanford.edu).


    Abstract
 TOP
 Abstract
 Introduction
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 References
 
PURPOSE: To develop and validate a method for the insertion of digitally synthesized polyps into computed tomographic (CT) images of the human colon for use as ground truth for evaluation of virtual colonoscopy.

MATERIALS AND METHODS: Spiral CT simulator software was used to generate 10 synthetic polyps in various configurations. Additional software was developed to insert these polyps into volume CT scans. Ten polyps in eight patients were selected for comparison. Three radiologists evaluated whether two-dimensional (2D) CT images and three-dimensional (3D) volume-rendered CT images showed synthetic or real polyps.

RESULTS: Edge-response profiles and noise of simulated polyps matched those of native polyps. Frequency distributions of reviewers' responses were not significantly different for synthetic versus real polyps in either 3D or 2D images. Responses were clustered around the response of "unsure" if lesions were real or synthetic. Receiver operating characteristic curves had areas of 0.54 (95% CI = 0.39, 0.68) for 3D and 0.39 (95% CI = 0.25, 0.53) for 2D images, which were not significantly different from random guessing (P = .70 and .28 for 3D and 2D images, respectively).

CONCLUSION: Synthetic polyps were indistinguishable from real polyps. This method can be used to generate ground truth experimental data for comparison of CT colonographic display and detection methods.

Index terms: Computed tomography (CT), image display and recording, 75.12115, 75.12117 • Computed tomography (CT), three-dimensional, 75.12117 • Computers, simulation • Colon, CT, 75.12111, 75.12115, 75.12117 • Colon, neoplasms, 75.3119


    Introduction
 TOP
 Abstract
 Introduction
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 References
 
Computed tomographic (CT) colonography, also known as virtual colonoscopy, is a promising technique for detection of colonic polyps. Initial results (1) have indicated that the majority of clinically important lesions can be detected; however, there is a wide variety of data review methods ("display modes"), and the most accurate and efficient means of interpreting the acquired CT data has yet to be determined.

Thus far, most investigators (25) have used a combination of two-dimensional (2D) and three-dimensional (3D) display modes. When 2D and 3D modes are used together in an unblinded fashion, it is difficult or impossible to establish accurately the relative diagnostic contribution of each mode. The authors of one initial study (2) suggested that 3D display added incremental value over 2D display alone, by increasing the sensitivity for lesion detection. However, more recent data (6,7) suggest that 2D display of "source" axial CT images alone may be sufficiently sensitive for lesion detection.

Several 3D display methods have been used (812), and more are under development. These approaches differ from one another not only in terms of the way the images are presented but also in their relative computational complexity and efficiency of viewing. Thus, an important remaining issue in the development of CT colonography for application to screening populations is to determine an efficient yet accurate means of reviewing the acquired image data for the detection of colonic polyps.

To optimize these display tools, a large number of data sets with known true polyps are needed. Typically, one compares CT colonographic images with fiberoptic colonoscopic images, the current reference standard, in the same patients. There are a number of difficulties with this approach. In screening populations, few patients have lesions in the clinically relevant size range of larger than 1 cm in diameter (1). In addition, fiberoptic colonoscopy is less than perfect, in part because the instrument fails to reach the cecum 5%–10% of the time (13). The colon also "telescopes" during the procedure, which makes precise reconciliation of CT findings with fiberoptic colonoscopic findings difficult. Last, because only a small number of lesions are available, radiologists may be able to recall specific lesions seen with different display modes according to shape or local surroundings and, hence, bias results.

A reference standard better than that available with fiberoptic colonoscopy and a large collection of polyps are needed for rigorous evaluation and optimization of CT colonography. The purpose of our study was to develop and validate a method for the generation and insertion of digitally synthesized polyps into CT images of the human colon for use as ground truth in evaluations of virtual colonoscopy. In this article, we describe and evaluate our method, which allows generation of realistic polyps of various sizes and shapes that can be placed anywhere inside a patient's CT-imaged colon. This high degree of control over polyp characteristics allows the generation of multiple phantom CT data sets, which can then be used for systematic evaluation of the trade-offs among the many display techniques currently under investigation for CT colonography. Such an approach can help determine which display method, if any, will prove to be a feasible clinical tool.


    MATERIALS AND METHODS
 TOP
 Abstract
 Introduction
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 References
 
Our study involved three phases: (a) collection of CT image data in patients undergoing CT colonography, (b) synthesis and insertion of polyps into one of the patient data sets, and (c) a validation study to compare the synthetic polyps with real lesions.

CT Colonographic Acquisition
For this study, we selected CT colonographic data sets obtained in eight patients (five men, three women; mean age, 56 years; age range, 30–75 years); the data sets were part of a separate ongoing clinical trial (4), approved by our institutional review board, to compare CT colonography and fiberoptic colonoscopy. In all participants, previous sigmoidoscopic results were positive, and the participants had been referred for fiberoptic colonoscopy.

Prior to CT, patients underwent standard precolonoscopy cleansing with a solution of polyethylene glycol and electrolytes (GoLYTELY; Braintree Laboratories, Braintree, Mass). After informed consent had been obtained, CT was performed (CT HiSpeed Advantage scanner; GE Medical Systems, Milwaukee, Wis) at 120 kVp, 200 mA, 3-mm collimation, and 6 mm/sec table speed (pitch, 2.0). The patient was in the supine position, and air insufflation of the colon was performed. Patients were instructed to hold their breath as long as comfortably possible, with quiet breathing, if necessary, during the later part of the study, which covered the pelvic region. CT scanning extended from the dome of the diaphragm to the pubic symphysis, with a total acquisition time of 60 seconds.

Scans were reconstructed at 1-mm intervals with a display field of view of 36–40 cm by using the manufacturer's standard soft-tissue reconstruction algorithm. All images were reconstructed with a 512 x 512 matrix, which resulted in an in-plane pixel size of 0.625–0.703 mm. Reconstructed image data sets were transferred to the Stanford University Department of Radiology 3D Medical Imaging Laboratory.

A positive CT finding for at least one polyp was obtained in each of the eight patients included in this study, and the CT finding was directly correlated with a positive finding at fiberoptic colonoscopy. We selected imaging data from one of the eight patients (a 60-year-old man), hereafter referred to as the "base" data set, for synthetic polyp insertion. For comparison, we chose 10 regions that contained a single true polyp from the data sets obtained in the other seven patients. These 10 polyps were sessile, with various shapes and sizes between 8 and 13 mm.

Creation of Phantom Data
All software was implemented on workstations (O2; Silicon Graphics, Mountain View, Calif) equipped with an R10000 processor and 256 Mbyte of main memory. All volume rendering was performed by using VOXELVIEW software (version 2.5.4; Vital Images, Minneapolis, Minn).

Polyp synthesis.—To create the synthetic polyps, we used a software spiral CT simulator. This simulator allows one to define the shape of an object with geometric primitives and generates projection data and CT reconstructions by using configurable scanner geometry, acquisition parameters, and reconstruction parameters. We configured the simulator parameters to match those of the CT scanner used to acquire the patient data (Table). Because polyps are small, however, we needed to simulate only those projections that covered a small field of view (22.5 mm) and to reconstruct the images with a 32 x 32 matrix. The resultant in-plane pixel size (0.703 x 0.703 mm) matched that of the base data set we chose for synthetic polyp insertion. In addition, the simulator allowed specification of the variance of a Poisson noise source to be added to the detector measurements, thereby correlating the noise in the reconstructed images in a manner similar to that in reconstructions obtained with actual CT scanners. We adjusted the Poisson noise variance empirically, so that the SDs in regions of interest in the polyps were in the same range as similar measurements made in soft tissue in the base data (approximately 15–25 HU).


View this table:
[in this window]
[in a new window]
 
CT Simulator Parameters
 
To synthesize a polyp, the user defines the CT attenuation value and shape of the polyp. Polyp attenuation was assigned to that of soft tissue. Measurements of attenuation in native polyps ranged from -100 to +70 HU, depending on the size of the lesion and the amount of partial volume averaging with adjacent air. For simulation, a starting attenuation of 0 HU was used. This value was modified by 25–50 HU, as necessary, to match the final attenuation profile with that of real lesions or the air–colonic wall interface.

The shape of each polyp was defined by using a combination of geometric primitives, such as ellipsoids, cylinders, and cones. By using combinations of such primitives, lesions of nearly any shape could be constructed, the simplest being a single sphere. Lesions with a cylindric base and a hemispheric cap were constructed by simulating scans of an object represented by the union of a cylinder and a sphere. Nodular, grossly hemispheric lesions were constructed by simulating scans of an object represented by the union of one large sphere (approximately 10 mm in diameter) and multiple smaller spheres (2–3 mm in diameter) arranged around the surface of the large sphere. We simulated the CT scans of each user-defined polyp and reconstructed 30 cross sections (to cover 30 mm) through each lesion.

Each voxel in the reconstructed volume contained a 16-bit integer value that corresponded to the CT intensity (in Hounsfield units) of the scanned polyp. The polyp was inserted into the patient's colon data by using the algorithm described in the next paragraph.

Polyp insertion.—We developed a software package that allows the user to insert a synthetic polyp into a volume CT study. The key features of the insertion algorithm are that it allows (a) smooth insertion of the synthetic polyp into patient data and (b) maintenance of the partial volume effects and noise in the synthetic polyp and original patient data. The insertion algorithm operates on a voxel-by-voxel basis by using either direct voxel replacement or nonlinear addition with no spatial averaging.

To understand the insertion algorithm, consider a fixed location in the original patient data with a voxel CT intensity IP. At the corresponding location in the synthetic polyp data set, there will be a voxel CT intensity IS. The insertion algorithm combines IP and IS into a final voxel intensity IF. There are two cases to consider, depending on whether the patient voxel definitely lies inside soft tissue. When IP > 0.95 x IA, where IA is the average CT intensity of the tissue surrounding the air-filled lumen, we can be fairly certain that the voxel lies within tissue; in this case, we set IF = IP. When IP <= 0.95 x IA, we assume that the voxel is fully or partially in the air-filled lumen; in this case we set IF = IS + IP - IS x IP/IA.

This method, known as compositing, is commonly used in computer graphics for smoothly blending two images together (14). Note that when IS and IP are small, IF is approximately equal to the sum of IS and IP. When IS and/or IP is nearly equal to IA, IF is saturated at the expected value IA. This saturation, though, leads to a substantial reduction in the noise in those voxels for which both IS and IP are large. We therefore compensated for this effect by adding spatially correlated noise weighted by the factor [2 - (1 - IP/IA)2 - (1 - IS/IA)2]1/2. Note that when IS and IP are small, the weight is small, and little noise is added. The compensation increases, however, as IS and IP approach IA. The correlated noise source was created by simulating a large spherical object with the CT simulator.

Quantification of polyp edge profiles and comparison with features of the base CT data were performed by using software (NIH IMAGE; National Institutes of Health. Available at: http://rsb.info.nih.gov/nih-image/. Accessed January 10, 1998.) and various models of Macintosh desktop computers (Apple Computers, Cupertino, Calif). Profiles of image intensity versus pixel number were generated in both the in-plane and the through-plane directions. Through-plane intensity profiles were generated from sagittal or coronal reformatted images created with VOXELVIEW. Note that the intensity profile obtained at the traversal from air to soft tissue, such as that encountered at the normal colonic wall, should be analogous to the profile obtained at the traversal from air to a polyp with soft-tissue attenuation. Intensity profiles with which synthetic lesions were compared with features of the native colon were inspected visually, and iterative adjustments were made in the simulation parameters to minimize observed differences between the profiles.

To determine how the polyp synthesis and insertion techniques work in a simple case, consider a 10-mm spherical polyp that was generated as described earlier. Figure 1 shows representative in-plane and longitudinal profiles for the air-tissue interfaces in both a patient colon and a synthetic polyp. This particular polyp required 30 seconds of computation time to be generated. (More complex shapes may take up to 2 minutes.) One can clearly see that the profiles of the air-tissue and air-polyp interfaces agreed well in both the in-plane and the longitudinal directions, with the 10%–90% transition occurring over 2.1 pixels (1.5 mm) in-plane, and 3.7 pixels (3.7 mm) longitudinally. These results show that partial volume effects can be accurately simulated with our system, and the same degree of edge blurring in synthetic lesions as in native tissue-air interfaces in the base colon data can be provided. This modeling is necessary to eliminate spurious visual cues such as overly sharp edges when viewing simulated lesions in polyp detection trials.



View larger version (14K):
[in this window]
[in a new window]
 
Figure 1a. Graphs show (a) in-plane and (b) longitudinal profiles of CT intensity of a synthetic polyp ({diamondsuit}) and the edge of patient's colon ({square}) as a function of pixel location (X in a, Z in b). As one moves from the lumen (air attenuation, -1,000 HU) to the polyp or colonic wall (soft-tissue attenuation, approximately 50 HU), the slope of the line describing the change in attenuation is determined by either in-plane or through-plane partial volume averaging. By matching the input parameters of the CT simulator with those of the base data, closely matched profiles can be obtained.

 


View larger version (17K):
[in this window]
[in a new window]
 
Figure 1b. Graphs show (a) in-plane and (b) longitudinal profiles of CT intensity of a synthetic polyp ({diamondsuit}) and the edge of patient's colon ({square}) as a function of pixel location (X in a, Z in b). As one moves from the lumen (air attenuation, -1,000 HU) to the polyp or colonic wall (soft-tissue attenuation, approximately 50 HU), the slope of the line describing the change in attenuation is determined by either in-plane or through-plane partial volume averaging. By matching the input parameters of the CT simulator with those of the base data, closely matched profiles can be obtained.

 
Once the polyp is simulated, it can be inserted into the colon by using the previously described algorithm. Figure 2 illustrates the process of creation and insertion of synthetic polyps with three volume-rendered images: a synthetic polyp consisting of four intersecting ellipsoids (Fig 2a), the region of the colon chosen for polyp insertion (Fig 2b), and the same region after polyp insertion (Fig 2c). Figure 3 demonstrates the result of this process with axial and coronal CT images. The top panel shows a series of axial CT sections at 1-mm increments through a 10-mm polyp. From left to right, one sees the appearance of the haustral fold as it smoothly blends into the polyp. The bottom panel in Figure 3 shows a series of coronal sections through the same polyp. From left to right (in 0.7-mm increments), the polyp appearance changes from fully detached in the air space to smoothly embedded in the tissue.



View larger version (28K):
[in this window]
[in a new window]
 
Figure 2. Three volume-rendered images illustrate creation of phantom data. (a) A synthetic free-standing polyp is inserted, or composited (+), into (b) polyp-free patient colon data, which results (=) in (c) a new colon data set with a polyp (arrow). These images are 2D renderings of the component parts a and b and the result c.

 


View larger version (48K):
[in this window]
[in a new window]
 
Figure 3. Top: Axial CT sections separated by 1-mm increments through a 10-mm synthetic spherical polyp (arrow). Bottom: Coronal CT sections separated by 0.7-mm increments through the same 10-mm synthetic polyp (arrow).

 
Figure 4 shows a 3D volume-rendered view of four 10-mm-diameter polyps. The specific polyp we have been discussing is shown on the left side, next to a haustral fold. There are three other 10-mm polyps on the lower right side to show that polyps may be inserted in a variety of locations.



View larger version (137K):
[in this window]
[in a new window]
 
Figure 4. A 3D volume-rendered view of four 10-mm polyps (arrows), including the polyp (large arrow) shown in Figure 3, placed in patient colon data.

 
Validation Study
To validate our method of polyp creation and insertion, we performed a study to determine if radiologists experienced with CT colonography and trained in 3D visualization methods and standard 2D axial CT could distinguish real polyps from synthetic polyps. Ten synthetic polyps were generated and inserted into polyp-free sections of the base colon data by using the previously described algorithms. The polyps were sessile and were 8–13 mm in diameter.

We generated 3D virtual endoscopic volume-rendered images of the synthetic polyps and the real polyps by using VOXELVIEW. The color, opacity, and lighting settings for all polyps were similar to those reported by McFarland et al (12). We saved 2D color images of the renderings, each annotated with a black caret that clearly identified each polyp.

In addition to the 3D volume-rendered images, standard gray-scale 2D axial CT images of each polyp were obtained. The level and window settings were -200 and 800 HU, respectively. In addition, each image was magnified by a factor of three to render it more visible. Each gray-scale image was then annotated with a black caret to identify the polyp.

The 40 images (20 volume-rendered and 20 axial CT images) were then incorporated onto a single World Wide Web page. All images were stored in Joint Photographic Experts Group, or JPEG, format, with the quality factor set to the highest level (ie, with minimal compression). We arranged the 3D and 2D images of the 40 polyps on the page in random order.

Three radiologists (including R.B.J.) were asked to independently score each image by using the following World Wide Web–based interface. Next to each image was a series of five "radio buttons." Button 1 was for rating a lesion as definitely synthetic; button 2, for rating a lesion as possibly synthetic; button 3, for a rating of unsure if synthetic or real; button 4, for rating a lesion as possibly real; and button 5, for rating a lesion as definitely real. Only one button could be toggled for each image. The readers were not told the number of real and synthetic polyps. They were told only that there was a mixture of real and synthetic polyps and that there was no correlation between the 2D axial sections and the 3D volume-rendered images. Each reader was asked to spend approximately 20 seconds studying each image, but no time limit was imposed.

Results for each reader were analyzed as frequency distributions that represented the number of responses in each of the five categories. The frequency histograms for individual readers were not significantly different from each other, so we pooled the results to maximize the statistical power of the observations and as a convenient means of data summary.

Two analyses were performed with the results to test for differences between real and synthetic polyps. First, the frequency distributions for real and synthetic polyps were compared against each another for each of the 3D and 2D display modes. The Wilcoxon rank sum test was used, which is appropriate for ordinal data without the need to assume an underlying normal distribution, with a P value of .05 or less indicative of a significant difference (15).

Second, receiver operating characteristic (ROC) curve analysis was performed by using the program ROCKIT (version 0.9B [beta]; Metz CE, Chicago, Ill). In this analysis, the input data were pairs of values that represented each category along the spectrum from "definitely synthetic" to "definitely real" and its corresponding response frequency for the pooled readers' results. By varying the definition of a true-positive response across the categories, pairs of ROC operating points that represented true-positive observations (sensitivity) versus false-positive observations (1 - specificity) were generated. Mathematically fitted ROC curves were compared against an ROC curve that represented random guesses about which polyps were real and which were synthetic. (This "random guess" curve is a diagonal line, and the area under the curve, or Az value, is 0.5). The Az values, 95% CIs, SDs of Az values, and P values for ROC curve comparison were generated by the ROCKIT program.


    RESULTS
 TOP
 Abstract
 Introduction
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 References
 
Figure 5 shows paired 3D volume-rendered and axial CT views of four representative polyps (two real and two synthetic) used in the study. Figure 6a shows the distribution of reviewers' scores for the 3D volume-rendered images, and Figure 6b shows the distribution of scores for the 2D axial CT sections. In both cases, the distributions were summed for the three reviewers. Note that if the reviewers could readily distinguish between definitely synthetic (score = 1) and definitely real (score = 5) polyps, one would expect the scores to cluster around the values of 1 and 5.



View larger version (67K):
[in this window]
[in a new window]
 
Figure 5. Paired 3D volume-rendered images (top) and 2D axial CT sections (bottom). (a, c) Real polyp (arrow). (b, d) Synthetic polyp (arrow).

 


View larger version (11K):
[in this window]
[in a new window]
 
Figure 6a. Histograms show distribution of scores, summed over all reviewers, for real (white bars) and synthetic (black bars) polyps on (a) 3D volume-rendered images and (b) 2D axial CT sections. Scores could range from 1, for a "definitely synthetic" polyp, to 5, for a "definitely real" polyp. If readers could definitively distinguish synthetic from real lesions, responses should cluster around scores of 1 and 5, respectively. Instead, responses for both real and synthetic lesions were clustered around a score of 3, for "unsure" whether the polyp was real or synthetic.

 


View larger version (12K):
[in this window]
[in a new window]
 
Figure 6b. Histograms show distribution of scores, summed over all reviewers, for real (white bars) and synthetic (black bars) polyps on (a) 3D volume-rendered images and (b) 2D axial CT sections. Scores could range from 1, for a "definitely synthetic" polyp, to 5, for a "definitely real" polyp. If readers could definitively distinguish synthetic from real lesions, responses should cluster around scores of 1 and 5, respectively. Instead, responses for both real and synthetic lesions were clustered around a score of 3, for "unsure" whether the polyp was real or synthetic.

 
For the 3D volume-rendered images (Fig 6a), the histograms representing real and synthetic lesions overlapped substantially, with most scores clustered around a score of 3 (unsure), which suggests that the reviewers could not readily differentiate between real and synthetic lesions. For real lesions, the median and modal scores were both 4, whereas for the synthetic lesions, the median and modal scores were both 3. The Wilcoxon rank sum test for significant differences between the histograms yielded a P value of .56.

For the 2D axial CT display (Fig 6b), there also was considerable overlap between the frequency distributions. For real lesions, the median and modal scores were 3 and 2, respectively, whereas for the synthetic polyps, the median and modal scores were both 3. The test for statistically significant differences between real and synthetic polyps yielded a P value of .11, which again was indicative of no difference. Note that although no significant differences between the two distributions were detected, there was a tendency with 2D axial CT sections for readers to interpret real lesions as synthetic.

By using ROC curve analysis, we evaluated whether the readers performed significantly better than would be expected from random guessing. Figure 7 shows ROC curves that depict the true-positive fraction (sensitivity) as a function of the false-positive fraction (1 - specificity). An observed ROC curve that is positioned above and to the left of the diagonal line that represents random guessing would be suggestive of the ability to distinguish real from synthetic lesions. For 3D displays, the ROC curve closely paralleled that of random guessing, with an Az value of 0.54 (SD = 0.08; 95% CI = 0.39, 0.68). The test for significant differences between this curve and random guessing yielded a P value of .70, or no significant difference. For 2D axial CT, the ROC curve tended to be positioned below the level expected for random guessing, with an Az value of 0.39 (SD = 0.07; 95% CI = 0.25, 0.53). The test for significant differences between this curve and random guessing yielded a P value of .28, or no significant difference.



View larger version (14K):
[in this window]
[in a new window]
 
Figure 7. ROC curves for the three radiologist observers (pooled results). The observers attempted to distinguish real from synthetic lesions on 3D volume-rendered images (•) and 2D axial CT sections ({circ}). If the readers had been able to distinguish real from synthetic lesions, the ROC curves for 3D and/or 2D images would be positioned above and to the left of the curve that represents random guessing (dashed line). Instead, the observed ROC curves were not significantly different from random guessing. FPF = false-positive fraction, TPF = true-positive fraction.

 

    DISCUSSION
 TOP
 Abstract
 Introduction
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 References
 
Creation of well-defined phantom colon data sets is a useful first step in the systematic evaluation and optimization of different 3D display tools for virtual colonoscopy. Generation of realistic phantom data sets is challenging for a number of reasons.

To create synthetic polyps that appear to be composed of real tissue, the synthetic polyps must have the correct partial volume effects. Mismatched partial volume effects can lead to artifacts on both 2D axial sections and 3D volume-rendered images; these artifacts can cause the synthetic polyps to appear conspicuously "computer generated" rather than resemble real tissue. Thus, we chose to create polyps with a CT simulator to match the partial volume effects in synthetic polyps with those in real tissue.

A second important factor is that the noise in the synthetic polyp must match the noise in the tissue. The CT simulator permits addition of noise to the simulated projections, thereby resulting in synthetic polyps that have noise fluctuations with SD and spatial correlation parameters similar to those seen in tissue.

Another important factor is that the polyps must have a realistic shape. Naturally occurring sessile polyps come in a variety of types, such as marble, mountain, clam shell, and carpet (16). To our knowledge, the frequency of occurrence of specific polyp types in any given patient population has not been reported. Nevertheless, our technique provides the flexibility to generate almost any type of shape by using a combination of ellipsoids, cones, and cylinders.

To validate that the polyps we generated had a realistic appearance, we performed a study to determine if radiologists could distinguish synthetic from real polyps. Because the artifacts seen on 3D images may not be the same as those seen on 2D images, we performed separate evaluations for 3D volume-rendered images and 2D axial sections (Fig 6). Whether we analyzed the results to detect for significant differences between the histograms of radiologists' scores for real and synthetic lesions or the ROC curves to compare observer performance with the hypothetical case of random guessing, we did not detect statistically significant differences between real and synthetic lesions. In fact, there was a tendency (nonsignificant) for readers to interpret real lesions as synthetic on 2D axial CT sections (Fig 6b), a factor that resulted in the ROC curve for the 2D display to be positioned somewhat below the curve for random guessing (Fig 7).

Precisely what visual features of lesions were underlying these trends is unknown; however, a bias toward interpretation of real lesions as synthetic is the opposite of would be expected if the readers could truly identify synthetic lesions. This provides some reassurance that our methods for creation and insertion of synthetic lesions are sound. On the basis of results from the validation study, we conclude that the synthetic lesions mimic real lesions closely enough to be used as a model system for tests of display modes in virtual colonoscopy.

Other groups have developed different methods to construct colonic polyp phantoms. One technique involves the use of a pig colon (17), in which polyps are formed by "puckering" the mucosa with suture material. A limitation of this method is that the haustral folds in a pig colon are different from those in a human colon, and human colonic polyps are often located on or behind a fold. Also, a limited number of polyps may be formed in a single specimen, and the precision and range of shapes available are limited. The use of ex vivo specimens also makes it difficult to mimic the overall complexity involved in a study of the entire human colon.

Another phantom-generation method involves direct copying of voxels from images of patient tissue and insertion of those voxels near the imaged colonic surface (2). However, this method cannot be used to achieve partial volume effects at the edge of the simulated polyp that are the same as those in the nearby colonic wall, and the spatial discontinuity in attenuation at the edge of the "pasted" polyp may render it more visible than a real polyp, thereby biasing the results for display and/or detection methods.

Our approach is most closely related to that reported by Seltzer et al (18), who analytically calculated the partial volume effects for spherical lung nodules and volume averaged the analytic models on a voxel grid matched to patient CT scans of the lungs. In the lung, extension of these methods to other than spherical shapes is not necessary, and the problem of insertion of synthetic nodules at the edge of a structure with comparable attenuation was not addressed. Finally, we note that an important feature of our technique is that any number of user-defined polyps can be placed into patient data at random locations; when used in evaluation of display and detection methods, review of these data sets closely mimics the overall complexity and tedium of review of actual patient studies.

One limitation of our method was that the creation of different polyp shapes is more an art than an exact science. Each polyp was designed by hand, one at a time, with random asymmetries. Because polyps should not be identical, this process had to be repeated for each new polyp. A more systematic approach would be to prepare a library of basic polyp shapes from which the user could choose. The user could then further specify the size and orientation of the polyp. The program would generate a list of ellipsoids, cones, and cylinders that would constitute the polyp. In addition, the program could make small random modifications to the shape so that each polyp is unique.

Another potential limitation of our study was our use of one base data set obtained in a single patient, rather than several data sets from different patients, for insertion of synthetic polyps. However, because the geometry of even a single colon varies considerably over its length and because we inserted lesions at numerous locations in the colon, the only variability one would expect among patient data sets would result from differences in scanning parameters and image noise levels. Note that in the early stages of this work and later in subsequent studies, we did use imaging studies obtained in several patients as base data. Our experience suggests that as long as individual variations in pixel dimensions and image noise are considered, the simulation and insertion process appears to be valid.

A final limitation of our study was that although we could not demonstrate a significant difference between observations of real and synthetic lesions, this result does not explicitly prove that simulated lesions are identical to real lesions. This lack of a difference was largely a result of the relatively small number of real lesions with which the synthetic lesions could be compared. It is no coincidence that this paucity of real lesions provided much of the motivation for the development of synthetic lesions in the first place. In the context of the current work, we can conclude that the synthetic lesions did not contain notably "artificial" features that allowed their differentiation from real lesions. From this, one can make the assumption, albeit untested, that the conspicuity of synthetic lesions should be similar to that of real lesions. Given these limitations, we believe that our results are sufficiently sound to begin application of the phantom system to initial trials in which the display modes are compared (19).

In summary, our polyp synthesis and insertion method allows the generation of a variety of realistic colonic polyps that could not be distinguished from real lesions by experienced observers and, therefore, can facilitate the comparison of display techniques. The fine control over polyp shape, size, and location will facilitate the development and optimization of the many display tools currently under investigation for CT colonography.


    Acknowledgments
 
The authors are grateful to Carl R. Crawford, MD, (Analogic, Peabody, Mass) for providing the core of the CT simulator software; Roger Y. Shifrin, MD, and Elizabeth G. McFarland, MD, for review of the CT data; and Laura Logan, RT, for assistance in the 3D Medical Imaging Laboratory. The authors also thank Silicon Graphics (Mountain View, Calif).


    Footnotes
 
See also the article by Beaulieu et al (pp 203–212 ) in this issue.

Abbreviations: ROC = receiver operating characteristic 2D = two-dimensional 3D = three-dimensional

Author contributions: Guarantors of integrity of entire study, C.F.B., S.N.; study concepts and design, C.F.B., C.K.; definition of intellectual content, C.F.B., C.K., S.N.; literature research, C.F.B., C.K.; experimental studies, C.F.B., R.B.J., C.K.; data acquisition, D.S.P., C.K.; data analysis, C.K., C.F.B.; statistical analysis, C.F.B., C.K.; manuscript preparation, C.K., C.F.B., S.N.; manuscript editing, R.B.J., D.S.P.; manuscript review, all authors.


    References
 TOP
 Abstract
 Introduction
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 References
 

  1. Hara AK, Johnson CD, Reed JE, et al. Detection of colorectal polyps with CT colography: initial assessment of sensitivity and specificity. Radiology 1997; 205:59-65.[Abstract/Free Full Text]
  2. Hara AK, Johnson CD, Reed JE, Ehman RL, Ilstrup DM. Colorectal polyp detection with CT colography: two versus three-dimensional techniques. Radiology 1996; 200:49-54.[Abstract/Free Full Text]
  3. Hopper KD, Naus MS, Khandelwal M, Wise SW, Iyriboz TA, Weaver JS. CT colonoscopy used as a routine screening procedure (abstr). Radiology 1997; 205(P):721.[Abstract/Free Full Text]
  4. Beaulieu CF, Jeffrey RB, Paik DS, Slosberg EA, Young HA, Napel S. Three-dimensional computed tomography colonography (3DCTC): initial clinical experience with 3 mm collimation and perspective volume rendering (abstr). Radiology 1997; 205(P):196.
  5. Fenlon HM, Ferrucci JT. Virtual colonoscopy: what will the issues be?. AJR 1997; 169:453-458.[Free Full Text]
  6. Hara AK, Johnson CD, Reed JE. CT colography (CTC) for clinical use: a new method to reduce evaluation time (abstr). Radiology 1997; 205(P):718.
  7. Dachman AH, Kuniyoshi JK, Boyle CM, et al. Interactive CT colonography with three-dimensional problem solving for detection of colonic polyps. AJR 1998; 171:989-995.[Abstract/Free Full Text]
  8. Lorensen WE, Jolesz FA, Kikinis R. The exploration of cross-sectional data with a virtual endoscope. In: Satava RM, Morgan K, Sieburg HB, et al., eds. Interactive technology and the new paradigm for health care: Medicine Meets Virtual Reality III proceedings. Amsterdam, the Netherlands: IOS, 1995; 221-230.
  9. Rubin GD, Beaulieu CF, Argiro V, et al. Perspective volume rendering of CT and MR images: applications for endoscopic imaging. Radiology 1996; 199:321-330.[Abstract/Free Full Text]
  10. Paik DS, Beaulieu CF, Jeffrey RB, Rubin GD, Napel S. Automated flight path planning for virtual endoscopy. Med Phys 1998; 25:629-639.[Medline]
  11. Vining DJ, Shifrin RY, Grishaw EK, Liu K, Gelfand DW. Virtual colonoscopy (abstr). Radiology 1994; 193(P):446.
  12. McFarland EG, Brink JA, Loh J, et al. Visualization of colorectal polyps with spiral CT colography: evaluation of processing parameters with perspective volume rendering. Radiology 1997; 205:701-707.[Abstract/Free Full Text]
  13. Waye JD, Bashkoff E. Total colonoscopy: is it always possible?. Gastrointest Endosc 1991; 37:152-154.[Medline]
  14. Foley JD, vanDam A, Feiner SK, Hughes JF. Computer graphics, principles and practice 2nd ed. New York, NY: Addison-Wesley, 1992.
  15. Rosner B. Nonparametric methods In: Fundamentals of biostatistics. Boston, Mass: Duxbury, 1986; 288-293.
  16. O'Brien M, Winawer SJ, Waye JD. Colorectal polyps. In: Winawer SJ, Kurtz RC, eds. Gastrointestinal cancer. New York, NY: Gower Medical, 1992; 3.1-3.41.
  17. Dachman AH, Lieberman J, Osnis RB, et al. Small simulated polyps in pig colon: sensitivity of CT virtual colography. Radiology 1997; 203:427-430.[Abstract/Free Full Text]
  18. Seltzer SE, Judy PF, Adams DF, et al. Spiral CT of the chest: comparison of cine and film-based viewing. Radiology 1995; 197:73-78.[Abstract/Free Full Text]
  19. Beaulieu CF, Jeffrey RB, Jr, Karadi C, Paik DS, Napel S. Display modes for CT colonography. II. Blinded comparison of axial CT and virtual endoscopic and panoramic endoscopic volume-rendered studies. Radiology 1999; 212:203-212.[Abstract/Free Full Text]

Related Article

Display Modes for CT Colonography: Part II. Blinded Comparison of Axial CT and Virtual Endoscopic and Panoramic Endoscopic Volume-rendered Studies
Christopher F. Beaulieu, R. Brooke Jeffrey, Jr, Chandu Karadi, David S. Paik, and Sandy Napel
Radiology 1999 212: 203-212. [Abstract] [Full Text] [PDF]



This article has been cited by other articles:


Home page
Am. J. Roentgenol.Home page
T. G. Mang, C. Schaefer-Prokop, A. Maier, E. Schober, G. Lechner, and M. Prokop
Detectability of Small and Flat Polyps in MDCT Colonography Using 2D and 3D Imaging Tools: Results from a Phantom Study
Am. J. Roentgenol., December 1, 2005; 185(6): 1582 - 1589.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
A. Ozgun, E. Rollven, L. Blomqvist, S. Bremmer, R. Odh, and A. Fransson
Polyp Detection with MDCT: A Phantom-Based Evaluation of the Impact of Dose and Spatial Resolution
Am. J. Roentgenol., April 1, 2005; 184(4): 1181 - 1188.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
J. Yee, N. N. Kumar, R. K. Hung, G. A. Akerkar, P. R. G. Kumar, and S. D. Wall
Comparison of Supine and Prone Scanning Separately and in Combination at CT Colonography
Radiology, March 1, 2003; 226(3): 653 - 661.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
R. M. Summers, C. F. Beaulieu, L. M. Pusanik, J. D. Malley, R. B. Jeffrey Jr, D. I. Glazer, and S. Napel
Automated Polyp Detector for CT Colonography: Feasibility Study
Radiology, July 1, 2000; 216(1): 284 - 290.
[Abstract] [Full Text]


Home page
RadiologyHome page
C. F. Beaulieu, R. B. Jeffrey Jr, C. Karadi, D. S. Paik, and S. Napel
Display Modes for CT Colonography: Part II. Blinded Comparison of Axial CT and Virtual Endoscopic and Panoramic Endoscopic Volume-rendered Studies
Radiology, July 1, 1999; 212(1): 203 - 212.
[Abstract] [Full Text]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Karadi, C.
Right arrow Articles by Napel, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Karadi, C.
Right arrow Articles by Napel, S.
Related Collections
Right arrowRelated Article


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
RADIOLOGY RADIOGRAPHICS RSNA JOURNALS ONLINE