Radiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


DOI: 10.1148/radiol.2211001038
This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Goldin, J. G.
Right arrow Articles by Aberle, D. R.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Goldin, J. G.
Right arrow Articles by Aberle, D. R.
(Radiology. 2001;221:213-221.)
© RSNA, 2001


Cardiac Imaging

Spiral versus Electron-Beam CT for Coronary Artery Calcium Scoring1

Jonathan G. Goldin, MD, PhD, Hyo-Chun Yoon, MD, PhD, Lloyd E. Greaser, III, MPH, Stefan B. Heinze, MD, Michael M. McNitt-Gray, PhD, Matthew S. Brown, PhD, James W. Sayre, PhD, Aletha M. Emerick, BS and Denise R. Aberle, MD

1 From the Departments of Radiological Sciences (J.G.G., S.B.H., M.S.B., A.M.E., D.R.A.), Radiology Physics (M.M.M.G.), and Biomathematics (J.W.S.), UCLA School of Medicine, 10833 Le Conte Ave, CHS B2-200, Los Angeles, CA 90095-1721; Department of Radiology, University of Utah School of Medicine, Salt Lake City (H.C.Y.); and Chicago Medical School, Ill (L.E.G.). Received June 5, 2000; revision requested July 26; final revision received March 30, 2001; accepted April 3. Address correspondence to J.G.G. (e-mail: jgoldin@mednet.ucla.edu).


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
PURPOSE: To determine differences in coronary artery calcium detection, quantification, and reproducibility, as measured at electron-beam computed tomography (CT) and subsecond spiral CT with retrospective electrocardiogram gating in an asymptomatic adult population.

MATERIALS AND METHODS: Seventy subjects asymptomatic for coronary heart disease underwent both electron-beam CT and subsecond spiral CT. In all subjects, two images each were obtained with both scanners. Two experienced readers using three different algorithms scored each of the four scans: one score for the electron-beam CT images and two scores for the spiral CT images.

RESULTS: With a 130-HU threshold for the quantification of calcium, there were no significant differences in interscan and interobserver variation in calcium scores between the electron-beam CT and spiral CT images. There was greater interobserver (P < .001) and interscan (P < .03) variation in scores when a 90-HU threshold was used for spiral CT images. With a 130-HU threshold, when calcium scores were used for clinical risk stratification, there was a significant difference between the results obtained with electron-beam CT and those obtained with spiral CT (P < .05).

CONCLUSION: Spiral CT has not yet proved to be a feasible alternative to electron-beam CT for coronary artery calcium quantification. There are systematic differences between calcium scores obtained with single-detector array subsecond spiral CT and those obtained with electron-beam CT.

Index terms: Calcium • Computed tomography (CT), electron beam, 54.12111, 54.12119 • Coronary vessels, CT, 54.12111, 54.12115, 54.12119 • Coronary vessels, stenosis or obstruction, 54.76, 54.812


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Electron-beam computed tomography (CT) is a well-established method to quantify coronary artery calcium (1,2). Electron-beam CT can enable short acquisition times of 100 msec and prospective electrocardiogram (ECG)-triggered image acquisition during diastole when heart motion is minimal. However, the limited availability and relatively greater cost of electron-beam CT scanners have motivated the adaptation of spiral CT technology to acquire cardiac images with retrospective cardiac gating, or tagging, and specialized image reconstruction algorithms (3,4). A commercial version of such technology (Smartscore; GE Medical Systems, Milwaukee, Wis) for use with spiral CT scanners has recently become available.

Our present understanding of coronary artery calcium detection, its quantification, and its clinical implications are based almost exclusively on the coronary calcium scoring methods used with electron-beam CT data sets. Two studies (5,6) comparing spiral or conventional CT with electron-beam CT were recently published. Becker et al (5) found that there was a closer correlation between prospectively gated transverse CT and electron-beam CT measurements of coronary calcium than between nongated subsecond spiral CT and electron-beam CT measurements. Carr et al (6) noted a high degree of correlation between coronary artery calcium quantifications performed with a developmental version of retrospectively gated subsecond spiral CT and those performed with electron-beam CT in a group of 36 patients.

The purpose of this study was to determine differences in coronary artery calcium detection, quantification, and reproducibility, as measured by using electron-beam CT and subsecond spiral CT with retrospective ECG gating and a commercially available software package (Smartscore) in an asymptomatic adult population.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
The study was approved by the University of California, Los Angeles School of Medicine institutional review board, and all subjects gave informed consent. For approximately 8 months, 70 consecutive subjects (43 men with a mean age of 47 years [median age, 46 years; age range, 28–68 years] and 27 women with a mean age of 50 years [median age, 52 years; age range, 27–66 years]), most of whom were self referred, who were asymptomatic for coronary artery disease and willing to participate in this study, underwent imaging during a single visit. CT was performed by using an electron-beam CT unit (C-150XP; Imatron, South San Francisco, Calif) and a subsecond spiral CT scanner (CT/i; GE Medical Systems) equipped with a software package (Smartscore). Each subject underwent two cardiac sequences with each scanner. The subjects were assigned to undergo evaluations in an alternating fashion with one or the other of the two scanners.

Electron-Beam CT Protocol
The standard electron-beam CT protocol was followed; the parameters used were 3-mm beam collimation, 3-mm table incrementation, 130 kVp, 630 mA, and ECG-triggered single-section mode (100-msec acquisition) with acquisitions triggered at 80% of the R-R interval. Thirty to 40 contiguous transverse CT images were obtained in a single breath hold to ensure coverage of the entire heart. Image reconstruction was performed with a 512 x 512-pixel matrix by using the sharp reconstruction algorithm. The reconstruction circle size was adjusted to enable visualization of the entire heart on all transverse images. A display field of view of 26 cm was generally sufficient and yielded a pixel size of approximately 0.5 mm, although occasionally, some subjects required a 30-cm display field of view. Immediately following the first sequence, a second sequence was performed by using identical imaging parameters with no change in subject positioning.

Spiral CT Protocol
The spiral scans (CT/i scanner) through the heart were obtained in one breath hold by using the following parameters: 800-msec revolution, 120 kVp, 200–250 mA, and 3-mm collimation. The pitch was set by using the formula pitch = 1.0 x (BPM/75), where BPM (beats per minute) is the subject’s heart rate during suspended maximal inspiration. An ECG trace was obtained during each sequence and referenced to the image data by using the software package (Smartscore). Imaging was performed to include the entire heart. Immediately following the first sequence, a second sequence was performed by using identical parameters with no change in subject positioning. Retrospective image reconstruction was performed by using the vendor-supplied (GE Medical Systems) segmented reconstruction algorithm with a standard reconstruction filter and a 512 x 512 matrix.

To improve temporal resolution, each image was reconstructed by using a 500-msec segment of the raw scan acquisition data. Images were reconstructed with 0.3-mm spacing, which yielded 10 images per 3-mm table travel, and a 25-cm display field of view. The in-plane pixel size was 0.49 mm. The retrospective reconstructions and ECG tracing were transferred to a workstation (AW 3.1; GE Medical Systems) for analysis with the software program (Smartscore). On the basis of the ECG tracing, the software program automatically selected a reduced set of diastolic images from each cardiac cycle. Each reader (S.B.H., J.G.G.) then optimized this set of images by picking the diastolic image from each cardiac cycle with the least amount of motion artifact.

Radiation Dosimetry
With the electron-beam CT scanner, the radiation dose is asymmetric, because it does not complete a full 360° sweep around the patient. The estimated peak radiation dose per scan is 13 mGy (1.3 rad) at the posterior portion of the patient’s thorax; this yields a total dose of 26 mGy (2.6 rad) for two scans. The organ and effective doses for symmetric scanners were estimated by using a software program developed by the National Radiation Laboratory, Christchurch, New Zealand (CTDOSE), which is based on the results of Monte Carlo calculations performed by the National Radiological Protection Board (7). Although this software was not designed for an asymmetric scanner, we calculated an approximate weighted dose for electron-beam CT and determined the time (ie, number of milliampere seconds) that would yield a similar approximate weighted dose for a symmetric scanner that was specified in the software. By using these assumptions and approximations, we determined that the peak organ dose occurs in the lungs (10.0 mGy [1.0 rad]) and esophagus (5.5 mGy [0.55 rad]). The effective dose, or weighted organ dose as specified by guidelines published in International Commission on Radiological Protection publication 60 (8), is estimated to be 3.0 mGy (0.3 rad).

By using the previously described protocol for the spiral CT scanner (CT/i), we estimated the total peak radiation dose to be 27 mGy (2.7 rad) at the skin of the thorax for both scans. According to the National Radiation Laboratory software program (CTDOSE) data, the peak organ doses occur in the breast (18 mGy [1.8 rad]) and lungs (17 mGy [1.7 rad]). The effective dose is estimated to be 4.8 mGy (.48 rad).

Scoring Algorithms
Two readers (S.B.H., J.G.G.) experienced with coronary artery calcium quantification independently scored the four scans obtained with the electron-beam CT and spiral CT scanners by using the electron-beam display console and software (OS version 12.4; Imatron) and the spiral CT workstation and software (Smartscore). Because scoring was performed on separate workstations by using proprietary software, the readers were not blinded to the type of scanner used to acquire the images. Each reader scored both scans obtained in each subject during a single sitting. However, because the two workstations were not close to each other, all four scans could not be scored at one time.

For the scans obtained at electron-beam CT, all high-attenuating foci with two or more contiguous pixels with an attenuation of 130 HU or greater were manually traced by each reader. For the scans obtained at spiral CT, all high-attenuating foci with two or more contiguous pixels with a threshold attenuation of 90 HU rather than 130 HU were manually traced by the same two readers.

The electron-beam CT scans were scored for coronary artery calcium by using the Agatston algorithm (9). With this algorithm, two or more contiguous pixels with an attenuation of 130 HU or greater in the expected location of an epicardial artery are considered a calcified lesion. Lesions are assigned a value between 1 and 4 that is determined by the peak pixel attenuation of the lesion. Lesions with a peak attenuation of 130–200 HU are assigned a value of 1; lesions with a peak attenuation of 201–300 HU, a value of 2; lesions with a peak attenuation of 301–400 HU, a value of 3; and lesions with a peak attenuation value greater than 400 HU, a value of 4. The integer value of each lesion is multiplied by the area of that lesion to yield a lesion-specific calcium score. The sum of all lesion scores yields the total calcium score.

Two scores were generated for each spiral CT data set by using calcium thresholds of 130 and 90 HU. The first score, that for spiral CT with a 130-HU threshold, was computed by summing the lesions with an attenuation of 130 HU or greater that were multiplied by a weighting factor on the basis of the maximum attenuation of the lesion. The weighting factor was the same as that used in the Agatston method (9). The second score, that for spiral CT with a 90-HU threshold, was calculated by using the same formula but with a threshold of 90 HU, as originally suggested by Broderick et al (10). With this method, a weighting value of 1 is assigned to lesions with an attenuation of 90–199 HU, but for lesions with an attenuation of greater than 200 HU, the weighting factor is the same as that used in the Agatston method.

Statistical Analyses
All statistical analyses were performed by using a statistical software package (SPSS version 9.0; SPSS, Chicago, Ill). A general linear model repeated-measures analysis was performed by using the three scoring methods (ie, electron-beam CT, 130-HU spiral CT, and 90-HU spiral CT), the two CT scan types (ie, electron-beam and spiral) as the within-subjects factors, and the two readers as the random-effects factors. The sphericity assumption was evaluated with the Mauchly W test.

Interobserver agreement was evaluated with the Cohen {kappa} statistic and was measured in three ways: by using the absolute difference in calcium scores, the percentage difference in calcium scores, and the coefficient of variation, which in this study was the ratio of the SD of the two readers’ scores to the mean of their scores. Interscan variation between the two sequences performed with each scanner also was measured by using the absolute difference in calcium scores, the percentage difference in calcium scores, and the coefficient of variation, which in this study was the ratio of the SD of each reader’s two scores to the mean of that reader’s scores. To determine whether the magnitude of the score had an effect on interscan variation, the absolute difference in calcium scores was plotted against the mean calcium score for each of the methods (11). A log10 transformation (score +1) was performed to reduce skewness.

Intermodality variation was assessed by comparing the electron-beam CT score with the 130-HU spiral CT and 90-HU spiral CT scores, as determined by the two readers. Each subject was assigned a clinical cardiovascular risk on the basis of each calcium score by using the clinical management guideline model proposed by Rumberger et al (12). In this model, asymptomatic patients are stratified into one of five categories that are based on their calcium score: very low (calcium score 0), low (calcium score 1–10), moderate (calcium score 11–100), moderately high (calcium score 101–400), and high risk (calcium score >400). In this study, those subjects with low or moderate cardiovascular risk whose calcium score was greater than that seen in 75% of the subjects with matched age and sex were placed in a category one risk higher. Separate risk categories were assigned to each subject for each scanner by using the calcium score of each scan. The levels of predicted cardiovascular risk were then compared between the two imaging modalities.

For statistical analyses, continuous variables were evaluated with the t test. Ordinal variables were evaluated with the Wilcoxon signed rank test. Nominal variables were evaluated with {chi}2 tests. A statistically significant difference was assumed when the P value was less than .05.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
In each of the 70 subjects, two scans each were obtained with the electron-beam CT and spiral CT scanners. Figure 1 demonstrates the appearance of coronary calcium on two spiral CT images and on two electron-beam CT images. The number of images scored and the mean, median, and range of calcium scores for each scoring algorithm, scan acquisition, and reader are summarized in Table 1. Repeated-measures analysis revealed that only the scoring method was a significant factor in the observed differences in scores (P < .001). The sphericity assumption was not violated by using the Mauchly W test (P < .001). Post hoc analysis revealed that the scoring method was also a significant factor in each pairwise comparison—that is, between electron-beam CT and spiral CT with a 130-HU threshold (P < .001), between electron-beam CT and spiral CT with a 90-HU threshold (P = .001), and between spiral CT with a 130-HU threshold and spiral CT with a 90-HU threshold (P < .001).



View larger version (111K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 1. Two electron-beam CT (EBCT) scans (top) and two spiral CT scans (bottom) obtained in one subject show calcium in the distribution of the left anterior descending artery. The images that best corresponded to each other with respect to regional landmarks were selected. The high-attenuating areas (shaded areas) represent the region within the vessel with an attenuation greater than 130 HU.

 

View this table:
[in this window]
[in a new window]

 
TABLE 1. Mean, Median, and Range of Calcium Scores at Electron-Beam CT and Spiral CT of the Heart

 
Interobserver Variability
The average percentage difference, average absolute difference, and coefficient of variation in scores for the two readers are presented in Table 2. There was no significant difference in interobserver variation between calcium scores obtained by using electron-beam CT and those obtained by using spiral CT with a 130-HU threshold, regardless of whether we evaluated the percentage differences or the absolute differences in scores. The interobserver coefficient of variation for electron-beam CT calcium scores was lower than that for 130-HU–threshold spiral CT scores: For scan 1, the coefficient of variation was 11.7% for electron-beam CT versus 27.7% for spiral CT with a 130-HU threshold; for scan 2, this value was 4.5% for electron-beam CT versus 41.5% for spiral CT with a 130-HU threshold.


View this table:
[in this window]
[in a new window]

 
TABLE 2. Interobserver Variation in Calcium Scores among the Three Scoring Algorithms

 
There was a significant decrease in score variation when the electron-beam CT and 90-HU spiral CT algorithms were compared for both percentage differences and absolute differences in interobserver calcium variation. This was true for both scans (P < .001). The interobserver coefficient of variation for electron-beam CT calcium scores was also lower than that for 90-HU spiral CT scores: For scan 1, the coefficient of variation was 11.7% for electron-beam CT versus 27.3% for 90-HU spiral CT; for scan 2, the variation value was 4.5% for electron-beam CT versus 46.8% for 90-HU spiral CT.

When spiral CT scores were compared, the absolute differences in reader scores, as well as the percentage differences in scores, were significantly lower with use of the 130-HU algorithm than with use of the 90-HU algorithm. As shown in Table 2, the interobserver coefficients of variation with both scoring algorithms were similar for both scans.

Interscan Variation
The differences in calcium scores between the two scans for each scoring algorithm are shown in Figure 2. The slopes of the regression lines describing the interscan variation for each of the three scoring algorithms were not significantly different for either reader; this suggests that the variation in scores between scans was similar across the three algorithms.



View larger version (40K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 2a. Graphs depict interscan variation in coronary artery calcium scores. (a) The scores obtained by reader 1 for scan 1 versus scan 2 with each of the three scoring algorithms are compared. The scores have been log10 transformed to reduce skewness. The regression line slopes for reader 1, as designated by the linear regression trend lines, are as follows: for 90-HU spiral CT (GECTi-90), x = 0.98 (95% CI: 0.90, 1.06); for 130-HU spiral CT (GECTi-130), x = 0.98 (95% CI: 0.92, 1.05); and for electron-beam CT (EBCT), x = 0.96 (95% CI: 0.92, 1.01). (b) The scores obtained by reader 2 for scan 1 versus scan 2 with each of the three scoring algorithms are compared. The scores have been log10 transformed to reduce skewness. The regression line slopes for reader 2, as designated by the linear regression trend lines, are as follows: for 90-HU spiral CT (GECTi-90), x = 0.98 (95% CI: 0.93, 1.02); for 130-HU spiral CT (GECTi-130), x = 0.99 (95% CI: 0.97, 1.02); and for electron-beam CT (EBCT), x = 0.97 (95% CI: 0.93, 1.00). There is no significant difference in the regression lines among the scoring algorithms for either reader.

 


View larger version (34K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 2b. Graphs depict interscan variation in coronary artery calcium scores. (a) The scores obtained by reader 1 for scan 1 versus scan 2 with each of the three scoring algorithms are compared. The scores have been log10 transformed to reduce skewness. The regression line slopes for reader 1, as designated by the linear regression trend lines, are as follows: for 90-HU spiral CT (GECTi-90), x = 0.98 (95% CI: 0.90, 1.06); for 130-HU spiral CT (GECTi-130), x = 0.98 (95% CI: 0.92, 1.05); and for electron-beam CT (EBCT), x = 0.96 (95% CI: 0.92, 1.01). (b) The scores obtained by reader 2 for scan 1 versus scan 2 with each of the three scoring algorithms are compared. The scores have been log10 transformed to reduce skewness. The regression line slopes for reader 2, as designated by the linear regression trend lines, are as follows: for 90-HU spiral CT (GECTi-90), x = 0.98 (95% CI: 0.93, 1.02); for 130-HU spiral CT (GECTi-130), x = 0.99 (95% CI: 0.97, 1.02); and for electron-beam CT (EBCT), x = 0.97 (95% CI: 0.93, 1.00). There is no significant difference in the regression lines among the scoring algorithms for either reader.

 
The interscan variation in scores measured by using the percentage differences in scores, absolute differences in scores, and interscan coefficients of variation with each of the three scoring algorithms are presented in Table 3. When we compared the interscan variability in scores obtained with the electron-beam CT and 130-HU spiral CT algorithms by each reader, no significant differences were found. Differences in interscan variation in scores between electron-beam CT and 90-HU spiral CT algorithms were significant for reader 1 only (P = .005 for percentage difference in score; P = .008 for absolute difference in score). For both readers, there were significant differences in interscan variation between the two spiral CT scoring algorithms. As shown in Table 3, the interscan coefficients of variation in scores were similar among all three scoring algorithms for both readers.


View this table:
[in this window]
[in a new window]

 
TABLE 3. Interscan Variation in Calcium Scores among the Three Scoring Algorithms

 
Finally, we compared the number of subjects who had a calcium score of 0 on one scan but not on the other, as interpreted by each of the two readers. For reader 1, there were seven subjects who had an electron-beam CT score of 0 on one scan but not on the other. Of these seven subjects, six had a calcium score of 0 on one scan and of 1 on the other. One subject had scores of 0 and 25. According to reader 2, three subjects had a score of 0 on one scan but not on the other. Of these three subjects, two had a calcium score of 0 on one scan and of 1 on the other. One subject had scores of 0 and 12.

When the 130-HU spiral CT calcium scores obtained by reader 1 were compared, four subjects had a score of 0 on one scan but not on the other. The range of values for interscan differences in scores was 5–52, with an average difference in score of 18. Reader 2 identified no subject with a calcium score of 0 on one scan but not on the other.

Reader 1 identified 11 subjects with a 90-HU spiral CT calcium score of 0 on one scan but not on the other. The range of values for interscan differences in scores was 1–23, with an average difference in score of 6. Reader 2 identified six subjects with a 90-HU spiral CT calcium score of 0 on one scan but not on the other. The range of values for interscan differences in scores was 1–20, and the average interscan difference was 5.

Intermodality Comparisons
Reader 1, by using scan 1 calcium scores, identified 33, 27, and 45 subjects with calcium (calcium score >1) detected by using electron-beam CT, 130-HU spiral CT, and 90-HU spiral CT scoring algorithms, respectively. The mean calcium score measured at electron-beam CT was significantly greater than that measured at 130-HU spiral CT by an average difference in score of 13 ± 46 (P = .02). The 90-HU spiral CT score was not significantly greater than the electron-beam CT score: The average difference in score was 16 ± 67 (P = .05).

Reader 2, by using scan 1 calcium scores, identified 32, 26, and 31 subjects with calcium detected by using electron-beam CT, 130-HU spiral CT, and 90-HU spiral CT scoring algorithms, respectively. The mean calcium score measured at electron-beam CT was significantly greater than that measured at 130-HU spiral CT by an average difference in score of 16 ± 43 (P = .002). The 90-HU spiral CT score was not significantly greater than the electron-beam CT score: The average difference in score was 11 ± 53 (P = .10).

Reader 1, by using scan 2 scores, identified 32, 29, and 44 subjects with calcium detected by using electron-beam CT, 130-HU spiral CT, and 90-HU spiral CT scoring algorithms, respectively. The mean calcium score measured at electron-beam CT was not significantly greater than that measured at 130-HU spiral CT: The average difference in score was 8 ± 45 (P = .15). However, the 90-HU spiral CT score was significantly greater than the electron-beam CT score, with an average difference of 25 ± 81 (P = .01).

Reader 2, by using scan 2 calcium scores, identified 29, 26, and 29 subjects with calcium detected by using electron-beam CT, 130-HU spiral CT, and 90-HU spiral CT scoring algorithms, respectively. The mean calcium score measured at electron-beam CT was significantly greater than that measured at 130-HU spiral CT by an average difference in score of 12 ± 38 (P = .01). The 90-HU spiral CT score also was significantly greater than the electron-beam CT score, with an average difference in score of 15 ± 58 (P = .04).

We compared the number of subjects who had a calcium score of 0 with one scoring algorithm but a nonzero score with another algorithm. Reader 1 identified six and five subjects with calcium on the first and second electron-beam CT scans, respectively, but no calcium on the basis of their respective 130-HU spiral CT scores. Conversely, reader 1 identified one and two subjects with nonzero 130-HU spiral CT scores on the first and second scans, respectively, but no identifiable calcium on the respective electron-beam CT images.

Reader 2 identified seven and five subjects with calcium on the first and second electron-beam CT scans, respectively, but no calcium on the basis of their respective 130-HU spiral CT scores. Reader 2 identified one and two subjects with nonzero 130-HU spiral CT scores on the first and second scans, respectively, but no identifiable calcium on the respective electron-beam CT images.

Comparing electron-beam CT and 90-HU spiral CT calcium scores, reader 1 identified two subjects and one subject with calcium on the first and second electron-beam CT scans, respectively, but no calcium on the basis of the respective 90-HU spiral CT scores. Conversely, reader 1 identified 14 and 13 subjects with nonzero 90-HU spiral CT scores on the first and second scans, respectively, but no calcium on the respective electron-beam CT scans.

Reader 2 identified six and five subjects with calcium on the first and second electron-beam CT scans, respectively, but no calcium on the basis of respective 90-HU spiral CT scores. Reader 2 identified four and five subjects with nonzero 90-HU spiral CT scores on the first and second scans, respectively, but no calcium on the respective electron-beam CT images.

Risk Scores
The results of stratifying subjects according to potential clinical cardiovascular risk, as proposed by Rumberger et al (12), are presented in Tables 4 and 5. There was only moderate agreement for all comparisons of risk stratification based on electron-beam CT and 130-HU spiral CT calcium scores for both readers and both scans. The {kappa} values ranged from a low of 0.58 for reader 2, based on scan 1 scores at both CT examinations, to a high of 0.64 for reader 2, based on scan 2 scores. There was a significant difference in the clinical risk stratifications determined by using electron-beam CT and 130-HU spiral CT scores (P < .05) for both readers and both scans. In those subjects with different clinical risk assessments based on the calcium scores measured by using the two scanners, the risk stratification based on the 130-HU spiral CT score usually was an underestimation of that determined by using the electron-beam CT score (Table 4).


View this table:
[in this window]
[in a new window]

 
TABLE 4. Differences in Clinical Cardiovascular Risk Stratification Based on Electron-Beam CT and 130-HU Spiral CT Calcium Scores

 

View this table:
[in this window]
[in a new window]

 
TABLE 5. Differences in Clinical Cardiovascular Risk Stratification Based on Electron-Beam CT and 90-HU Spiral CT Calcium Scores

 
The 90-HU spiral CT scores also were used to determine cardiovascular risk in subjects according to the Rumberger classification and compared with the corresponding electron-beam CT scores and risks. Table 5 shows the number of subjects in each clinical cardiovascular risk category according to electron-beam CT and 90-HU spiral CT calcium scores. Comparison of the clinical risk stratification based on the two CT scoring algorithms again revealed only moderate agreement for both readers and both scans. The {kappa} values ranged from a low of 0.55 for reader 1, based on scan 1 calcium scores at both CT examinations, to a high of 0.67 for reader 2, based on scan 2 scores. For reader 1, there was a significant difference between the clinical risk stratifications determined by using electron-beam CT scores and those determined by using 90-HU spiral CT scores. For reader 2, there was no significant difference in clinical risk stratification between the two modalities for either scan 1 (P = .61) or scan 2 (P = .45). In those subjects with different clinical risk assessments based on the calcium scores measured by using the two scanners, the risk stratification based on the 90-HU spiral CT score usually was an overestimation of that based on the electron-beam CT score.


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
We compared the interscan and interobserver variation in calcium scores determined by using two different CT imaging technologies and three scoring approaches. Both direct comparisons of scores and evaluations of the possible clinical implications of score differences were performed. The clinical implications of score differences are as important or possibly more important than the statistical differences among the different calcium score measurements. Study results (13,14) suggest that coronary calcium depicted by electron-beam CT is an important prognostic indicator of future cardiac events. However, because the use of spiral CT for the detection of coronary calcium is likely to increase, it is important for physicians to understand the similarities and differences between spiral and electron-beam CT technologies with regard to coronary artery calcium quantification.

Important considerations in interpreting the results of the current study include the relatively small study size and the relative paucity of calcium measurements across a broad clinical spectrum. Nevertheless, we believe this study is unique because it is, to our knowledge, the largest CT calcium measurement comparison study published to date and the only investigation in which repeated measurements were performed in the same subjects. Furthermore, because all scans were scored independently by two experienced readers, the degree of interobserver variation was measurable.

It is also important to note that the spiral CT data sets were obtained by using a single detector array and 0.8-second revolution speed, retrospective image segmentation, and ECG tagging. The differences incurred from this configuration are not generalizable to other spiral technologies that involve different numbers of detector arrays, different methods of image segmentation and ECG registration (eg, prospective or retrospective), and different acquisition times (0.5–1.0 second) and must be evaluated separately. Finally, the Agatston calcium scoring algorithm (9) was used in this study, because it is currently the most commonly used algorithm in clinical practice. The effect of using alternative potentially more useful algorithms, such as calcium volumes (15), was not addressed.

The effect of scanner variables in this study was minimized to the extent that was possible, because both scanners use 3-mm collimation, 512 x 512 image matrices, and approximately the same field of view; these parameters result in nearly identical pixel sizes. The other differences, such as those in kilovolt peak, milliampere value, and scan acquisition time, were suggested by the scanner manufacturers for coronary artery calcium imaging and thus were not altered.

Interobserver Variation
Interobserver variation is an important source of differences in calcium score. In the case of electron-beam CT, intraobserver and interobserver reliability for calcium scoring has been shown to be excellent, with coefficients greater than 0.99 for both intra- and interobserver reliability (16). We are not aware of any published studies on intra- or interobserver variability in calcium scoring at spiral CT. In this study, the interobserver variation between the two experienced readers was comparable between the calcium scores derived from electron-beam CT and 130-HU spiral CT algorithms. There was a trend toward less variation between readers at electron-beam CT image scoring, but a significant difference was not demonstrated. This trend may have been related to less cardiac motion and the lack of choice in selecting images for scoring when electron-beam CT data sets were used. The 90-HU spiral CT algorithm was associated with significantly greater interobserver variation (P < .01) compared with that seen with the electron-beam CT and 130-HU spiral CT algorithms. This may have been due to the effect of the higher calcium scores obtained when the 90-HU gray-scale threshold was used.

Interscan Variation
The reproducibility, or precision, of calcium measurement is an important consideration in the clinical utility of coronary calcium scoring. This variable is particularly important with respect to assessing for interval changes in measurable calcium following interventions (17). Studies (1820) have addressed interscan variability in calcium scores by using electron-beam CT, and values have ranged from 24% to 49%. We are not aware of any published studies involving the evaluation of interscan variation in calcium scoring at spiral CT. There are many potential subject-based sources of measurement error that contribute to interscan variation, including positioning, cardiac and respiratory motion, the anatomy of the coronary vessels, and poor ECG gating.

Scanner sources of measurement error, such as tube heating, scanning parameters, reconstruction algorithms, detector alignment, and calibration, also are possible, but they are usually easier to control. With the method involving spiral CT software (Smartscore), a further contributor to interscan variation is the requirement to select an optimal image from each anatomic level. The results from this study show that there was no significant difference in the interscan variation in scores for either reader, regardless of whether the data were derived from the electron-beam CT scanner or the spiral scanner with a 130-HU threshold. For reader 1, interscan variation was smaller for calcium scores measured at electron-beam CT compared with those measured at spiral CT with the 90-HU threshold, but this was not true for reader 2. Therefore, our study results suggest that interscan variation is probably comparable between scanners, although the factors that cause the variation may be different for the two units.

Intermodality Variation
Differences in calcium scores between different CT technologies are an area of considerable interest and increasing debate. Becker et al (5) compared electron-beam CT, gated nonspiral CT, and spiral CT with variable pitch for the quantification of coronary artery calcium. These investigators observed a high correlation between scores across all modalities but better agreement between electron-beam CT and gated nonspiral CT data. Similar to us in the current study, Carr et al (6) compared electron-beam CT with retrospectively gated subsecond spiral CT and found good correlation between the two imaging modalities. However, correlation analysis may not be the best approach, given the effect of the clustering of scores around a few values, especially in subjects with no identifiable calcium, and the relatively poor precision of calcium scoring methods. This issue is further complicated by the paucity of clinical outcomes data to determine the degree of precision and accuracy needed for clinical relevance.

The presence or absence of calcium is one well-defined cut point that has been suggested to have clinical utility (eg, in middle-aged patients who present with atypical chest pain). In our study, both readers identified more subjects who had a 130-HU spiral CT score of zero and a nonzero electron-beam CT score than the converse. Thus far, all of the cut points used to stratify subjects according to event risk and management have been based on electron-beam CT data (13,2124). If these values are to be applied to non–electron-beam CT–derived scores, correlation alone may be insufficient.

When the existing commercially available scoring algorithms for the described two scanners are used, there are significant differences between the scores generated with spiral CT and those generated with electron-beam CT. However, the threshold value used with spiral CT algorithms determines whether the calcium score is likely to be higher or lower than that expected with electron-beam CT. When the lower 90-HU threshold is applied, calcium scores are consistently higher than those derived from electron-beam CT data; the opposite is true when the 130-HU threshold is applied to spiral CT data.

The clinical relevance of these differences is not known, since there currently are no available clinical outcomes data associated with calcium scores determined by using spiral CT. Although mathematical correction algorithms are possible, a better approach may be to investigate whether a new threshold between 90 and 130 HU is preferable or to develop reference values based on alternative scoring algorithms, such as calcium volume, that would be specific for subjects with scores derived by using the spiral CT software (Smartscore). However, given the large clinical database of scores derived from electron-beam CT scans, a method to correlate spiral CT scores with electron-beam CT scores would be clinically useful.

Clinical Risk Stratification
To assess the clinical effect of the different calcium scores, we used the guidelines for clinical stratification suggested by Rumberger et al (12). Our study data suggest that coronary artery calcium scores obtained by using gated retrospective reconstruction algorithms from a spiral CT scanner are not directly comparable to those obtained by using electron-beam CT; this discrepancy results in differences in clinical risk stratification. When a threshold of 130 HU is used for calcium scoring of spiral CT data, a larger number of subjects are given a lower cardiovascular risk assessment and more subjects have no detectable calcium, as compared with the number of subjects with calcium depicted by electron-beam CT. Conversely, when a threshold of 90 HU is used for calcium scoring of spiral CT images, a larger number of subjects are given a higher risk assessment and more are shown to have apparent calcific lesions, compared with the number of subjects with calcium depicted by electron-beam CT.

Radiation Dose
The spiral CT protocol currently used results in a higher radiation dose to the subject than that delivered with the electron-beam CT protocol. The estimated dose for a single coronary calcium scan at electron-beam CT is 1.5 mGy (.15 rad), whereas that with the described spiral CT scanner is 2.4 mGy (.24 rad). These values can be compared to background radiation that is from natural origin, which is 3.0 mSv per year (25). Hence, electron-beam CT scanning results in an effective dose that is equivalent to about 6 months of background radiation, whereas scanning performed with the described spiral CT scanner results in a dose equivalent that is to nearly 10 months of background radiation.

In conclusion, spiral CT has not yet proved to be a feasible alternative to electron-beam CT for coronary artery calcium quantification. The calcium scores are not equivalent. There are systematic differences between calcium scores obtained by using single–detector array, subsecond spiral CT and those obtained by using electron-beam CT. Combining coronary artery calcium scores obtained from different CT technologies may confound attempts to develop reference values for different clinical management recommendations. Using electron-beam CT databases to risk stratify patients who undergo spiral CT may lead to incorrect clinical assessments. Further research is warranted to determine which detector technology, imaging protocol, and scoring algorithm permit the greatest agreement between data obtained by using the two CT scanners.


    FOOTNOTES
 
Abbreviation: ECG = electrocardiogram

Author contributions: Guarantors of integrity of entire study, J.G.G., H.C.Y.; study concepts, J.G.G., H.C.Y., D.R.A.; study design, J.G.G., H.C.Y., S.B.H., L.E.G., M.M.M.G.; literature research, J.G.G., H.C.Y., S.B.H.; clinical studies, J.G.G., S.B.H., A.M.E.; data acquisition, J.J.G., M.M.M.G., M.S.B.; data analysis/interpretation, J.G.G., J.W.S., A.M.E., H.C.Y., L.E.G.; statistical analysis, J.W.S., A.M.E., J.G.G., H.C.Y.; manuscript preparation, J.G.G., H.C.Y., A.M.E.; manuscript definition of intellectual content, J.G.G., H.C.Y.; manuscript editing, H.C.Y., J.G.G., A.M.E., D.R.A.; manuscript revision/review, H.C.Y., J.G.G., A.M.E.; manuscript final version approval, H.C.Y., J.G.G.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 

  1. Mautner GC, Mautner SL, Froehlich J, et al. Coronary artery calcification: assessment with electron beam CT and histomorphometric correlation. Radiology 1994; 192:619-623.[Abstract/Free Full Text]
  2. Rumberger JA, Simons DB, Fitzpatrick LA, Sheedy PF, Schwartz RS. Coronary artery calcium area by electron-beam computed tomography and coronary atherosclerotic plaque area: a histopathologic correlative study. Circulation 1995; 92:2157-2162.[Abstract/Free Full Text]
  3. Woodhouse CE, Janowitz WR, Viamonte M. Coronary arteries: retrospective cardiac gating technique to reduce cardiac motion artifact at spiral CT. Radiology 1997; 204:566-569.[Abstract/Free Full Text]
  4. Kachelriess M, Kalender WA. Electrocardiogram-correlated image reconstruction from subsecond spiral computed tomography scans of the heart. Med Phys 1998; 25:2417-2431.[CrossRef][Medline]
  5. Becker CR, Jakobs TF, Aydemir S, et al. Helical and single-slice conventional CT versus electron beam CT for the quantification of coronary artery calcification. AJR Am J Roentgenol 2000; 174:543-547.[Abstract/Free Full Text]
  6. Carr JJ, Crouse JR, III, Goff DC, Jr, D’Agostino RB, Jr, Peterson NP, Burke GL. Evaluation of subsecond gated helical CT for quantification of coronary artery calcium and comparison with electron beam CT. AJR Am J Roentgenol 2000; 174:915-921.[Abstract/Free Full Text]
  7. Jones DG, Shrimptin PC. Survey of CT practice in the UK III. Normalized organ doses calculated using Monte Carlo techniques: NRPB-R250, National Radiological Protection Board. Oxon, United Kingdom: Chilton, 1991.
  8. International Commission on Radiological Protection. 1990 Recommendations of the International Commission on Radiological Protection, ICRP Publication 60, Annals of the ICRP 21 (1-3) Oxford, England: Pergammon, 1991.
  9. Agatston AS, Janowitz WR, Hindner FJ, Zusmer NR, Viamonte M, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol 1990; 15:827-832.[Abstract]
  10. Broderick LS, Shemesh J, Wilensky RL, et al. Measurement of coronary artery calcium with dual-slice helical CT compared with coronary angiography: evaluation of CT scoring methods, interobserver variations, and reproducibility. AJR Am J Roentgenol 1996; 167:439-444.[Abstract/Free Full Text]
  11. Bland M. An introduction to medical statistics Oxford, England: Oxford University, 1987; 278.
  12. Rumberger JA, Brundage BH, Rader DJ, Kondos G. Electron beam computed tomographic coronary calcium scanning: a review and guidelines for use in asymptomatic patients. Mayo Clin Proc 1999; 74:243-252.[Medline]
  13. Arad Y, Spadaro LA, Goodman K, et al. Predictive value of electron beam computed tomography of the coronary arteries: 19-month follow-up of 1,173 asymptomatic patients. Circulation 1996; 93:1951-1953.[Abstract/Free Full Text]
  14. Raggi P, Callister TQ, Cooil B, et al. Identification of patients at increased risk of first unheralded acute myocardial infarction by electron-beam computed tomography. Circulation 2000; 101:850-855.[Abstract/Free Full Text]
  15. Callister TQ, Cooil B, Raya SP, Lippolis NJ, Russo DJ, Raggi P. Coronary artery disease: improved reproducibility of calcium scoring with an electron-beam CT volumetric method. Radiology 1998; 208:807-814.[Abstract/Free Full Text]
  16. Kaufmann RB, Sheedy PF, II, Breen JF, et al. Detection of heart calcification with electron beam CT: interobserver and intraobserver reliability for scoring quantification. Radiology 1994; 190:347-352.[Abstract/Free Full Text]
  17. Callister TQ, Raggi P, Cooil B, Lippolis NJ, Russo DJ. Effect of HMG-CoA reductase inhibitors on coronary artery disease as assessed by electron-beam computed tomography. N Engl J Med 1998; 339:1972-1978.[Abstract/Free Full Text]
  18. Greaser LE, III, Yoon HC, Mather RT, McNitt-Gray M, Goldin JG. Electron-beam CT: the effect of using a correction function on coronary artery calcium quantitation. Acad Radiol 1999; 6:40-48.[CrossRef][Medline]
  19. Yoon HC, Greaser LE, III, Mather R, Sinha S, McNitt-Gray MF, Goldin JG. Coronary artery calcium: alternate methods for accurate and reproducible quantitation. Acad Radiol 1997; 4:666-673.[CrossRef][Medline]
  20. Fallavollita JA, Kumar K, Brody AS, Bunnell IL, Canty JM, Jr. Detection of coronary artery calcium to differentiate patients with early coronary atherosclerosis from luminally normal arteries. Am J Cardiol 1996; 78:1281-1284.[CrossRef][Medline]
  21. Devries S, Wolfkiel C, Shah V, Chomka E, Rich S. Reproducibility of the measurement of coronary calcium with ultrafast computed tomography. Am J Cardiol 1995; 75:973-975.[CrossRef][Medline]
  22. Schmermund A, Bailey KR, Rumberger JA, Reed JE, Sheedy PF, II, Schwartz RS. An algorithm for noninvasive identification of angiographic three-vessel and/or left main coronary artery disease in symptomatic patients on the basis of cardiac risk and electron-beam computed tomographic calcium scores. J Am Coll Cardiol 1999; 33:444-452.[Abstract/Free Full Text]
  23. Rumberger JA, Sheedy PF, Breen JF, Schwartz RS. Electron beam computed tomographic coronary calcium score cutpoints and severity of associated angiographic lumen stenosis. J Am Coll Cardiol 1997; 29:1542-1548.[Abstract]
  24. Guerci AD, Spadaro LA, Popma JJ, et al. Relation of coronary calcium score by electron beam computed tomography to arteriographic findings in asymptomatic and symptomatic adults. Am J Cardiol 1997; 79:128-133.[CrossRef][Medline]
  25. National Council on Radiation Protection and Measurements. NCRP Report; 93:52-60.



This article has been cited by other articles:


Home page
HeartHome page
E S Houslay, S J Cowell, R J Prescott, J Reid, J Burton, D B Northridge, N A Boon, D E Newby, and on behalf of the Scottish Aortic Stenosis and Lipi
Progressive coronary calcification despite intensive lipid-lowering treatment: a randomised controlled trial
Heart, September 1, 2006; 92(9): 1207 - 1212.
[Abstract] [Full Text] [PDF]


Home page
CirculationHome page
M. E. Clouse, J. Chen, H. M. Krumholz, M. E. Clouse, J. Chen, and H. M. Krumholz
Noninvasive Screening for Coronary Artery Disease With Computed Tomography Is Useful
Circulation, January 3, 2006; 113(1): 125 - 146.
[Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
A. L. Daniell, N. D. Wong, J. D. Friedman, N. Ben-Yosef, R. Miranda-Peats, S. W. Hayes, X. Kang, M. G. Sciammarella, L. de Yang, G. Germano, et al.
Concordance of Coronary Artery Calcium Estimates Between MDCT and Electron Beam Tomography
Am. J. Roentgenol., December 1, 2005; 185(6): 1542 - 1545.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
R. C. Detrano, M. Anderson, J. Nelson, N. D. Wong, J. J. Carr, M. McNitt-Gray, and D. E. Bild
Coronary Calcium Measurements: Effect of CT Scanner Type and Calcium Measure on Rescan Reproducibility--MESA Study
Radiology, August 1, 2005; 236(2): 477 - 484.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
U. J. Schoepf, C. R. Becker, B. M. Ohnesorge, and E. K. Yucel
CT of Coronary Artery Disease
Radiology, July 1, 2004; 232(1): 18 - 37.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
J. Horiguchi, H. Yamamoto, Y. Akiyama, K. Marukawa, N. Hirai, and K. Ito
Coronary Artery Calcium Scoring Using 16-MDCT and a Retrospective ECG-Gating Reconstruction Algorithm
Am. J. Roentgenol., July 1, 2004; 183(1): 103 - 108.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
L. R. Van Hoe, K. G. De Meerleer, P. Ph. Leyman, and P. K. Vanhoenacker
Coronary Artery Calcium Scoring Using ECG-Gated Multidetector CT: Effect of Individually Optimized Image-Reconstruction Windows on Image Quality and Measurement Reproducibility
Am. J. Roentgenol., October 1, 2003; 181(4): 1093 - 1100.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
J. A. Rumberger and L. Kaufman
A Rosetta Stone for Coronary Calcium Risk Stratification: Agatston, Volume, and Mass Scores in 11,490 Individuals
Am. J. Roentgenol., September 1, 2003; 181(3): 743 - 748.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
N. Takahashi and K. T. Bae
Quantification of Coronary Artery Calcium with Multi-Detector row CT: Assessing Interscan Variability with Different Tube Currents—Pilot Study
Radiology, July 1, 2003; 228(1): 101 - 106.
[Abstract] [Full Text] [PDF]


Home page
CirculationHome page
H. Hecht, J. A. Rumberger, M. J. Budoff, R. Park, R. Detrano, P. Fu, Y. Ibrahim, M. Xiang, L. LaBree, and S. Azen
C-Reactive Protein and Electron Beam Tomography * Reply
Circulation, May 13, 2003; 107 (18): e123 - e124.
[Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
L. Berlin
Liability of Performing CT Screening for Coronary Artery Disease and Lung Cancer
Am. J. Roentgenol., October 1, 2002; 179(4): 837 - 842.
[Full Text] [PDF]


Home page
RadiologyHome page
B. Lu, N. Zhuang, S.-S. Mao, J. Child, S. Carson, H. Bakhsheshi, and M. J. Budoff
EKG-triggered CT Data Acquisition to Reduce Variability in Coronary Arterial Calcium Score
Radiology, September 1, 2002; 224(3): 838 - 844.
[Abstract] [Full Text] [PDF]


Home page
CirculationHome page
M. J. Budoff, G. A. Diamond, P. Raggi, Y. Arad, A. D. Guerci, T. Q. Callister, and D. Berman
Continuous Probabilistic Prediction of Angiographically Significant Coronary Artery Disease Using Electron Beam Tomography
Circulation, April 16, 2002; 105(15): 1791 - 1796.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire