|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Technical Developments |
1 From the Department of Radiology, Stanford University School of Medicine, 300 Pasteur Dr, S-072B, Stanford, CA 94305-5105. From the 2000 RSNA scientific assembly. Received February 14, 2001; revision requested March 27; revision received August 23; accepted October 8. Supported by National Institutes of Health grant 5RO1HLO58915-03. Address correspondence to G.D.R. (e-mail: grubin@stanford.edu).
| ABSTRACT |
|---|
|
|
|---|
Supplemental material: radiology.rsnajnls.org/cgi/content/full/2231010441/DC1.
Index terms: Angiography, technology Arteries, CT, 17.12115, 17.12116, 9*.129162, 9*.12917 Computed tomography (CT), helical, 9*.12916 Images, processing Veins, CT, 17.12115, 17.12116, 9*.12916, 9*.12917
| INTRODUCTION |
|---|
|
|
|---|
Manually derived curved planar reformations require 1530 minutes per patient to be produced by an experienced operator, depending on the vessels processed (8,10). This is because curved planar reformations show one vessel per image; thus, a new path has to be drawn for each vessel (10). Different views of the same vessel require adjustments to the path to ensure that it is in the center of the vessel in all planes being imaged. In addition, manually created curved planar reformations are exceedingly operator dependent (3,4,8,10,11). Small deviations from the true centerline, particularly in narrow arteries, can generate spurious stenoses or cause important lesions to be missed. Therefore, automation of this repetitive activity is desirable and has the potential to increase efficiency. The goal of this study was to evaluate a system we developed for generating curved planar reformations automatically from the volumetric image data produced with transverse scanning.
| Materials and Methods |
|---|
|
|
|---|
We used a previously developed algorithm (12) to automatically produce the centerlines for curved planar reformations. It makes use of a simple and fast single-threshold segmentation algorithm to mark the boundaries of the aorta and its branches. User input is required only to select the seed voxel in the aorta for the segmentation and subsequently to select the start and end points of the vessels of interest by positioning a crosshair cursor in the transverse, coronal, or sagittal planes. Alternatively, points can be selected by clicking on the beginning or end of a vessel as shown on a three-dimensional surface display of the segmentation.
A raycasting scheme is used to automatically position the crosshair cursor at the point selected on the surface display. For branching vessels, multiple end points can be specified. User-selected points that fall outside the segmentation are rejected, and the user is prompted to reenter them. Once the segmentation and end-point identification are completed, an initial path on the surface of the segmentation is computed from the start to the end points. The segmentation is then morphologically thinned while the path is iteratively corrected toward the medial centerline. On completion of this process, the centerline is smoothed, and its interpoint distance is set to the minimum voxel dimension to make its accuracy at least equal to the data resolution. The user-specified start and end points are corrected toward the calculated medial axis by means of the thinning and smoothing process.
Subsequently, curved planar reformations are calculated in real time by using a linear interpolation algorithm. The user can interactively rotate the curved planar reformations through 360° (in 1° intervals) about the median axis by using an angle manipulation cursor or can view the rotation as a cine sequence (Fig 1). This allows review of the whole cross-sectional profile of the vessel along its length. To facilitate efficient correlation to confirm or refute abnormalities suspected on the curved planar reformations, our implementation allows the user to click on points of interest on the curved planar reformations to view the transverse and other orthogonal planes centered at that point and on automatically generated oblique reformatted planes (multiplanar reformations) perpendicular and parallel to the direction of the path at that point. In contrast to the orthogonal views, the perpendicular oblique reformation shows the true perpendicular cross section of the vessel at that point, while the parallel reformation shows the plane parallel with the vessel at that point (Fig 2).
|
|
|
Validation
The dependence of automatically generated centerlines on user-selected start and end points was characterized by creating multiple centerlines through a small (superior mesenteric) and large (aortoiliac) artery in each patient, with use of the locus of all possible start and end points at the origin and terminus of each vessel. The usefulness of this system was tested with a limited clinical validation by using curved planar reformations of six arteries each (renal, celiac, superior mesenteric, aortoiliac, inferior mesenteric, and left subclavian) from CT angiographic examinations in three consecutive patients with aortic aneurysms. These patients underwent their examinations as part of their clinical workup.
CT angiographic images were transferred to a computer workstation. Curved planar reformations were then created by using both standard manual methods and our automated method. Manually created curved planar reformations were created by an expert technologist with experience in creating curved planar reformations in more than 1,000 patients by using manufacturer software (Advantage Windows, version 3.1; GE Medical Systems, Milwaukee, Wis).
As in standard practice, the technologist drew an approximate path through the center of the vessel by using the transverse, sagittal, and coronal views to specify the center of the vessel every few millimeters. Standard curved planar reformations were produced from these paths. Two reformations were created 90° apart through each vessel, and each included two of the following three possibilities: curved coronal, curved sagittal, or curved transverse, depending on vessel orientation. Automatically created curved planar reformations were produced through the same vessels. Thus, a total of 36 manually created and 36 automatically created curved planar reformations of the 18 arteries were produced, and the time required to produce the images with each method was recorded. All images were then exported from both applications, and histogram matching was used to set and standardize window and level settings to those routinely used in clinical practice.
The 72 images were printed with a clinical-quality dye sublimation printer, with identifying patient markings removed, as illustrated in Figure 4. Automatically and manually created images through all vessels were subsequently separated and arranged in random order. The images were then presented to four radiologists (G.D.R., C.F.B., E.S.B., R.B.J.) and one imaging scientist (S.N.).
|
Subjective image quality for each image was also assessed on a 10-point scale, and reviewers were asked to comment on the reasons for their assessments. A score of 10 indicated the reviewer had no concerns about the quality of the image. To quantitatively assess the occurrence of artifacts on the images, two reviewers subsequently performed a side-by-side blinded comparison between automatically and manually created images and reported the number of artifacts seen on each image. This allowed the reviewers to detect differences in the depiction of the vessels between paired images. Apparent stenosis, discontinuities, or other image features that were not present on the paired images could be counted as artifacts. Reviewer scores were compared by using paired t tests to reject the null hypothesis that there was no difference between scores. Because a failure to reject this null hypothesis does not indicate that the scores are the same, we additionally applied a test of equivalence to determine if we could reject the null hypothesis that the scores are different.
To perform the test of equivalence, we calculated the equivalency statistic E as
where
1 and
2 are the two means being compared, V1 and V2 are their respective variances, and
is the maximum difference that is clinically unimportant. We set
to 15% of the mean score. To achieve 80% power, a value of -1.96 for E was required to reject the null hypothesis for all tests of equivalence. Additionally, we quantified interobserver variability by means of weighted
analysis. Differences with a P value of .05 were considered statistically significant.
| Results |
|---|
|
|
|---|
Processing Time
Manual creation of curved planar reformations required a mean 14.8 minutes ± 2.2 (range) for each patient, while the automated method required 4.2 minutes ± 0.6 (2.1 minutes ± 0.4 and 2.1 minutes ± 0.2 for user interaction and computer processing, respectively). Thus, the user input time required for creation of curved planar reformations was reduced by 86%. Tortuous vessels and variant anatomy tended to increase manual processing times and necessitated more correction of the path. The renal arteries took the most time to manually process in this study. On the other hand, as indicated by the smaller SD for both the user interaction and computer processing times for the automated method, vessel anatomy did not adversely affect the time required to automatically generate curved planar reformations.
Discrimination of Manually Created from Automatically Created Curved Planar Reformations
The mean area under the pooled receiver operating characteristic curve was 0.45 (95% CI: 0.39, 0.51). Individual reviewers had areas of 0.42 (95% CI: 0.29, 0.56), 0.46 (95% CI: 0.34, 0.59), 0.49 (95% CI: 0.36, 0.62), 0.38 (95% CI: 0.23, 0.54), and 0.57 (95% CI: 0.38, 0.74). All areas were not significantly different from an area of 0.5, and the shapes of the curves approximated a straight line. The calculated equivalency statistic was -2.00 (P < .001) at 80% power, which allowed us to reject the null hypothesis and support the assertion that human observers cannot distinguish between manually and automatically generated curved planar reformations. The
values for interobserver agreement were between 0.01 and 0.09. In addition, no consistent trend was noted in reviewers comments. In their summaries, two reviewers wrote that they were unable to detect any discriminating features on the images. An unusual vessel choice in one curved planar reformation (internal iliac artery) led one reviewer to correctly identify this as an automatically generated curved planar reformation. A shorter curved planar reformation was used by one reviewer as indicative of automatically created images but by another as indicative of manually created images.
Image Quality
The mean image quality was 8.18 (95% CI: 8.03, 8.33) for automatically created images and 7.97 (95% CI: 7.82, 8.13) for manually created images. The equivalency statistic was -2.56 (P < .01) at 80% power, which indicates that image quality was not different between the two groups. The
values for interobserver agreement were between 0.4 and 0.6, and 83% of scores differed from each other by two points or less. In their feedback, two reviewers identified one automatically generated curved planar reformation of the renal arteries as being of low quality because depiction of the large superoinferior separation of the renal arteries on the image necessitated a discontinuity in the aorta. However, there was no concern expressed about the depiction of the arteries. Consistency in vessel caliber, depiction of smaller branches, and longer paths were criteria that three of the five reviewers noted. Mean scores from the reviewers who used these criteria for scoring image quality were 8.6 for automatically created and 8.4 for manually created images.
Artifacts
Figure 5 exemplifies the types of artifacts that were seen with higher frequency on manually created images. The two reviewers who scored image artifacts identified a mean 21.5 artifacts in the 38 manually created images compared with a mean 3.5 artifacts in the 38 automatically created images. Of those images with artifacts, reviewers on average identified only one artifact per image. Therefore, an average of 18.5 manually created images (48.7%) had one or more artifacts compared with a mean of 3.5 automatically created images (9.2%) with artifacts, a difference of 39.5%. The difference was statistically significant (P < .001). Reviewers agreed about the number of artifacts seen on 69 of the 76 images, with a
value for interobserver agreement of 0.81.
|
| Discussion |
|---|
|
|
|---|
Faster Processing
Curved planar reformations can be created substantially faster with an automated method. With multiprocessor systems, automatic processing can occur in the background while the manual interaction for consecutive studies is completed in the foreground. The time required for computer processing is also bound to decrease as faster hardware and parallel processing techniques are incorporated.
Discrimination of Manually Created from Automatically Created Curved Planar Reformations
The test of equivalence indicated with high power that reviewers could not distinguish between images. The 95% CIs for all areas under the receiver operating characteristic curve included 0.5, and the
value indicated very low interobserver agreement. These findings support this conclusion. We can conclude that expert reviewers cannot differentiate between curved planar reformations generated manually versus those generated automatically.
Image Quality
The test of equivalence indicated that there was no significant difference between quality scores, but interobserver agreement was only fair. The lower interobserver agreement may be due to the subjective nature of the assessment conducted. Nevertheless, even though scores did not agree exactly, most of the scores did not vary by more than two points. We can conclude that overall image quality was not compromised by the use of the automatic method.
Greater Freedom from Artifacts
Findings in our small experiment indicate that automatically created images may have significantly (P < .001) fewer artifacts. There was good agreement between our reviewers. Many authors (3,4,8,10,11) have commented on the occurrence of operator-dependent artifacts in manually created curved planar reformations. The presence of these artifacts is unavoidable in normal clinical practice, not only because of human error but also because of the limitations of manual pointing devices. In addition, only tens of points are used to define a manually created curved planar reformation. Linear interpolation is used to define the centerline between manually selected points, which leads to the possibility of artifact if the interpolated line nears or cuts the vessel wall.
In automatically generated curved planar reformations, 400700 points are used to define the centerlines, which may decrease the occurrence of operator-dependent artifacts. In addition, it is important to realize that the quality of the centerline is only one factor that determines image quality and artifacts. Our method does not reduce the effect of patient factors, such as movement artifact, and does not address problems caused by inadequate scanning parameters, misregistration, or incomplete vessel opacification. However, these factors would lead to artifacts and poor image quality that are independent of manual versus automatic creation of curved planar reformations. An in-depth investigation regarding artifacts in curved planar reformations has not been carried out, to our knowledge, and is probably warranted in the future.
Interactive Viewing with 360° Rotation
Reference to the original data for transverse images still remains the standard of reference (2,3). Our software allows interactive correlation with other views and 360° rotation of the curved planar reformations. At least two curved planar reformations of each vessel are recommended to detect eccentric plaque that might be missed on just one view (7). Sagittal and coronal curved reformations ignore much of the volumetric data set, as do maximum intensity projections and shaded surface displays. This occurs because only a small subset of the voxels contributes to the image in these methods. While both these alternative modalities show only a small part of the actual data even with 360° cine loops, 360° curved planar reformations show the actual voxel values of the full circumference of the vessel along its length.
As review of CT angiographic data on a computer monitor is increasingly considered to be superior to hard copy review (13,14), this method can be added to the set of tools available to radiologists at their workstations in a manner analogous to the current practice of prerendering cine loops of maximum intensity projection images. This allows the clinician to review the entire wall of the vessel rather than just the coronal and sagittal reformations.
We have developed a technique that automatically generates curved planar reformations that cannot be differentiated from manually generated ones. Our method leads to a reduced postprocessing time and may decrease artifacts. A simple user interface allows the creation of accurate paths through even tortuous vessels, without the need for expert user input. Interactive features allow quick correlation and confirmation with other views. The ability to rotate the image through 360° facilitates a better understanding of anatomic relationships and the lesion under study. This technique adds value to CT angiography and has the potential to promote its widespread acceptance and use. Although the technique was demonstrated with CT angiographic data, it should be equally applicable to MR angiographic data, but this was not tested.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Author contributions: Guarantor of integrity of entire study, G.D.R.; study concepts and design, G.D.R., S.N., R.R.; literature research, R.R.; clinical studies, G.D.R., C.F.B., S.N., E.S.B., R.B.J.; data acquisition, G.D.R., C.F.B., S.N., E.S.B., R.B.J.; data analysis/interpretation, G.D.R., R.R.; statistical analysis, G.D.R., R.R.; manuscript preparation and definition of intellectual content, G.D.R., R.R.; manuscript editing, revision/review, and final version approval, G.D.R., S.N., R.R.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
D. R. Hadizadeh, J. Gieseke, S. H. Lohmaier, K. Wilhelm, J. Boschewitz, F. Verrel, H. H. Schild, and W. A. Willinek Peripheral MR Angiography with Blood Pool Contrast Agent: Prospective Intraindividual Comparative Study of High-Spatial-Resolution Steady-State MR Angiography versus Standard-Resolution First-Pass MR Angiography and DSA Radiology, November 1, 2008; 249(2): 701 - 711. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Raman, B. Raman, S. Napel, and G. D. Rubin Semiautomated Quantification of the Mass and Distribution of Vascular Calcification with Multidetector CT: Method and Evaluation Radiology, April 1, 2008; 247(1): 241 - 250. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. E. Roos, D. Fleischmann, A. Koechl, T. Rakshe, M. Straka, A. Napoli, A. Kanitsar, M. Sramek, and E. Groeller Multipath Curved Planar Reformation of the Peripheral Arterial Tree in CT Angiography Radiology, July 1, 2007; 244(1): 281 - 290. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. C. Dalrymple, S. R. Prasad, M. W. Freckleton, and K. N. Chintapalli Informatics in Radiology (infoRAD): Introduction to the Language of Three-dimensional Imaging with Multidetector CT RadioGraphics, September 1, 2005; 25(5): 1409 - 1428. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. S. Desser, F. G. Sommer, and R. B. Jeffrey Jr. Value of Curved Planar Reformations in MDCT of Abdominal Pathology Am. J. Roentgenol., June 1, 2004; 182(6): 1477 - 1484. [Full Text] [PDF] |
||||
![]() |
R. Raman, S. Napel, and G. D. Rubin Curved-Slab Maximum Intensity Projection: Method and Evaluation Radiology, October 1, 2003; 229(1): 255 - 260. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH |
| RADIOLOGY | RADIOGRAPHICS | RSNA JOURNALS ONLINE |