Radiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Visser, K.
Right arrow Articles by Myriam Hunink, M. G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Visser, K.
Right arrow Articles by Myriam Hunink, M. G.
(Radiology. 2000;216:67-77.)
© RSNA, 2000


Vascular and Interventional Radiology

Peripheral Arterial Disease: Gadolinium-enhanced MR Angiography versus Color-guided Duplex US-A Meta-analysis1

Karen Visser, MSc and M. G. Myriam Hunink, MD, PhD

1 From the Departments of Epidemiology and Biostatistics (K.V., M.G.M.H.) and Radiology (M.G.M.H.), Erasmus Medical Center Rotterdam, Rm EE21-40a, Dr Molewaterplein 50, 3015 GE Rotterdam, the Netherlands, and the Department of Health Policy and Management, Harvard School of Public Health, Boston, Mass (M.G.M.H.). Received February 17, 1999; revision requested May 3; final revision received September 29; accepted October 25. Supported in part by the Persoongerichte Impuls voor Onderzoeksgroepen met Nieuwe Ideëen voor Excellente Research (PIONIER) award from the Netherlands Organization for Scientific Research. Address correspondence to M.G.M.H. (e-mail: hunink@epib.fgg.eur.nl).


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
PURPOSE: To summarize and compare the published data on gadolinium-enhanced magnetic resonance (MR) angiography and color-guided duplex ultrasonography (US) for the work-up for peripheral arterial disease.

MATERIALS AND METHODS: Studies published between January 1984 and November 1998 were included if (a) gadolinium-enhanced MR angiography and/or color-guided duplex US were performed for evaluation of arterial stenoses and occlusions in the work-up for peripheral arterial disease of the lower extremities, (b) conventional angiography was the reference standard, and (c) absolute numbers of true-positive, false-negative, true-negative, and false-positive results were available or derivable.

RESULTS: With a random effects model, pooled sensitivity for MR angiography (97.5% [95% CI: 95.7%, 99.3%]) was higher than that for duplex US (87.6% [95% CI: 84.4%, 90.8%]). Pooled specificities were similar: 96.2% (95% CI: 94.4%, 97.9%) for MR angiography and 94.7% (95% CI: 93.2%, 96.2%) for duplex US. Summary receiver operating characteristic analysis demonstrated better discriminatory power for MR angiography than for duplex US. Regression coefficients for MR angiography versus US were 1.67 (95% CI: -0.23, 3.56) with adjustment for covariates, 2.11 (95% CI: 0.12, 4.09) without such adjustment, and 1.73 (95% CI: 0.44, 3.02) with a random effects model.

CONCLUSION: Gadolinium-enhanced MR angiography has better discriminatory power than does color-guided duplex US and is a highly sensitive and specific method, as compared with conventional angiography, for the work-up for peripheral arterial disease.

Index terms: Arteries, extremities • Arteries, stenosis or obstruction, 92.72 • Arteries, MR, 92.12942, 92.12943 • Arteries, US, 92.12981, 92.12983 • Magnetic resonance (MR), comparative studies, 92.12942, 92.12943 • Ultrasound (US), comparative studies, 92.12981, 92.12983


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
The assessment of lifestyle-limiting intermittent claudication and critical ischemia prior to revascularization has traditionally been performed with conventional angiography. Conventional angiography is a widely used imaging modality that yields a "road map" of the vascular system, which is useful in choosing the optimal type and technique of revascularization procedure. Angiography is, however, an invasive procedure with a risk of morbidity and mortality (1,2). When possible, noninvasive methods are used in the initial assessment of peripheral arterial disease.

Duplex ultrasonography (US) has been shown to be a reliable noninvasive modality with fairly good sensitivity and specificity (3). The addition of color flow imaging to help guide duplex scanning improves the diagnostic performance (4). Duplex US is, however, operator dependent and labor intensive and does not provide a road map equivalent to that obtained with angiography. Gadolinium-enhanced magnetic resonance (MR) angiography is a relatively new minimally invasive imaging method used for the work-up of peripheral arterial disease. Intravenous administration of a gadolinium chelate is considered to be safe, and MR angiography provides high-quality three-dimensional images of the vascular system in a short time with high sensitivity and specificity (511). Disadvantages of MR angiography are the expense and the small number of cases in which the procedure is unsuccessful due to susceptibility artifacts or because the patient has claustrophobia.

A number of articles have recently been published on the topic of gadolinium-enhanced MR angiography, each a report of the experience from a single center with a limited number of patients. Before supporting MR angiography as a substitute for conventional (x-ray) angiography, the overall combined evidence should demonstrate whether MR angiography is a highly sensitive and specific modality. Furthermore, we are aware of no reports in which gadolinium-enhanced MR angiography was compared with color-guided duplex US. If a choice must be made between the imaging modalities, it should be largely dependent on the reported diagnostic accuracies of both methods, taking into account differences in applied positivity criteria and patient characteristics. A powerful tool for this kind of analysis is summary receiver operating characteristic (ROC) analysis (1214).

The purpose of this study was to summarize and compare the diagnostic performance of gadolinium-enhanced MR angiography and color-guided duplex US for the evaluation of arterial stenoses and occlusions in the work-up of peripheral arterial disease of the lower extremities and to compare both methods with conventional angiography.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Data Sources and Data Extraction
A search was performed of the medical literature for articles on gadolinium-enhanced MR angiography and color-guided duplex US that were published between January 1984 and November 1998 (14). For the period between January 1984 and June 1994, we used articles on color-guided duplex US included in a previously published meta-analysis (4,1520). For gadolinium-enhanced MR angiography, we limited the search to articles published between January 1990 and November 1998 because gadolinium-enhanced MR angiography was introduced in the early 1990s. A Medline search was performed by using the following keywords and words related to these keywords: peripheral vascular, arterial occlusive, peripheral arterial, leg, limb, lower extremity, popliteal, femoral, and iliac, combined with MR angiography, magnetic resonance, duplex, Doppler, and ultrasonography. Additional references were obtained from bibliographies of reviews and original articles, and experts in the field were consulted. The PubMed search engine was used to find the most recently published articles.

Articles (511,1539) were included in the analysis if they met the following criteria: (a) Gadolinium-enhanced MR angiography, color-guided duplex US, or both, were performed to demonstrate stenoses and occlusions of the arteries in the lower extremities; (b) results of conventional angiography were used as the reference standard; and (c) the absolute numbers of true-positive (TP), false-negative (FN), true-negative (TN), and false-positive (FP) results were available or could be derived for a defined cutoff criterion for angiography—usually a reduction in arterial diameter of more than 50%. In the case of multiple published reports by the same author(s) over a brief time, we tried to contact the author(s) to determine whether the patient populations overlapped. Use of the same patient population more than once in our analysis could bias the results. Among the articles (6,23,28,3941) in which data were reported for the same patient population, we included those (6,23,39) with a research question most relevant to our meta-analysis. Moreover, we tried to contact the authors of articles that reported a measure of agreement (eg, {kappa} statistic) between the comparison modality and angiography rather than the absolute numbers of TP, FN, TN, and FP results. One author (26) gave us the relevant data, but two (5,42) neglected to reply despite repeated requests (total of three requests to each).

Each author independently extracted the data from all articles by using a standardized spreadsheet. The authors were not blinded with regard to identifying information of the individual manuscripts because this has been shown to be unnecessary (43). Extracted data included variables related to study design, patient characteristics, diagnostic imaging protocol, and absolute numbers of TP, FN, TN, and FP results (Tables 14). The absolute numbers were most often available for arterial segments rather than for limbs or patients. If the results were tabulated for different readers, then the results of the first reader were used. If more than one examination technique was presented in the same article, we used the technique advised by the authors. US results for iliac segments were excluded if stenoses were indirectly determined on the basis of Doppler waveform analysis results for the common femoral arteries. MR angiographic results for segments examined with time-of-flight or phase-contrast techniques and without gadolinium enhancement were excluded from the analysis.


View this table:
[in this window]
[in a new window]

 
TABLE 1. Summary of MR Angiography Characteristics of Included Studies
 

View this table:
[in this window]
[in a new window]

 
TABLE 2. Summary of Duplex US Characteristics of Included Studies
 

View this table:
[in this window]
[in a new window]

 
TABLE 3. Clinical Characteristics of Included Studies: MR Angiography
 

View this table:
[in this window]
[in a new window]

 
TABLE 4. Clinical Characteristics of Included Studies: Duplex US
 
Discrepancies in data extraction between the two authors were noted and resolved at consensus. The {kappa} value was calculated as a measure of agreement between extracted categoric variables in the analysis, and the correlation coefficient (r value) was calculated as a measure of agreement between extracted continuous variables in the analysis. The natural logarithm of the diagnostic odds ratio (D) was calculated as follows: D = ln[(TP x TN)/(FP x FN)]. This value represents a summary measure of the diagnostic performance per study (ie, the discriminatory power of the examination). This was the measure of interest in the summary ROC analysis. The correlation between the natural logarithms of the diagnostic odds ratios as derived from the individual studies by the two authors was calculated to summarize the overall agreement in the data extracted by both authors.

Data Synthesis
Funnel plot.—To detect publication bias, (ie, the bias resulting from studies with a positive result being published more often than studies with a negative result), we constructed a funnel plot (44). In a funnel plot, the number of units measured per individual study (arterial segments, in this case) is plotted as a function of the measure of interest (the natural logarithm of the diagnostic odds ratio, in this case). In the absence of publication bias, the data points form a symmetric funnel-shaped distribution, whereas a skewed and asymmetric distribution indicates the presence of publication bias. Funnel-plot symmetry was determined informally by means of visual inspection of the graph.

Weighted pooled analysis.—Pooled values for effect size are often calculated by means of a weighted pooling of the individual effect sizes, with weights equal to the reciprocal of the variance of each study. To apply this method, the assumption of homogeneity of effect sizes must hold (45,46). We checked the homogeneity of effect sizes with a statistical test, and only the sensitivity of MR angiography was homogeneous. We therefore used a random effects model, which can accommodate heterogeneous, as well as homogeneous, effect sizes. The pooled values based on this model include an estimated component of variance due to interstudy variation (45,46). We calculated the pooled sensitivity, specificity, and natural logarithm of the diagnostic odds ratio and constructed 95% CIs.

Summary ROC analysis.—Summary ROC analysis is a meta-analytic method to summarize and combine the true- and false-positive rates for different diagnostic studies (1214). The method involved development of a regression model with the dependent variable being the natural logarithm of the diagnostic odds ratio from each study and the independent variable being a measure of the positivity criterion (S) of the study (ie, classification of an examination as positive): S = ln[(TP x FP)/(TN x FN)]. With this method, one assumes that the differences in examination performance reported in the literature are due partly to variations in the positivity criterion used by different authors; the regression analysis thus allows one to adjust for these differences. Adjustment for important clinical variables and comparison of examinations are also possible. Examples of meta-analyses that used a summary ROC analysis can be found in De Vries et al (4) and Fleischmann et al (47).

The adjustment for clinical variables is accomplished by including them in the regression model. Inclusion of a dummy variable in the regression analysis for the type of diagnostic examination performed (1 for MR angiography, 0 for duplex US) makes it possible to compare the tests. The regression coefficient of this dummy variable is a measure of the difference in discriminatory power between the examinations. A positive regression coefficient indicates increased discriminatory power for MR angiography relative to that of duplex US, whereas a negative regression coefficient indicates reduced discriminatory power.

To prevent undefined values for diagnostic odds ratios, positivity criteria, and their variances that result from zero values for TP, FN, TN, or FP results, 0.5 was added to each TP, FN, TN, and FP value (13).

We assessed the effect of publication year; continent (North America vs other), mean age (65 years or younger vs older than 65 years), prevalence of diseased segments per study, blinded interpretation of the test result (yes or probably vs no or not reported), blinded interpretation of the reference test result (yes vs no or not reported), inclusion of consecutive patients (yes vs no or not reported), type of imager (Ultramark [ATL] vs Acuson vs other for duplex US; Philips Medical Systems vs Siemens Medical Systems vs other for MR angiography), and dose of gadolinium (in millimoles per kilogram body weight) for MR angiography. A quality score was defined on the basis of the following criteria: blinded interpretation of MR or US images, blinded interpretation of the reference modality results, and inclusion of consecutive patients. Studies fulfilling all criteria were given a quality score of 1; all others were given a score of 0. Also, a four-tiered rating of quality for diagnostic imaging studies, described by Kent et al (48), was determined for each study and analyzed by using three dummy variables.

Owing to missing data, the proportion of patients with intermittent claudication could not be analyzed as a covariate and was, therefore, excluded from all analyses. The proportions of femoropopliteal and infrapopliteal segments were missing for three articles, and only the subset of articles with complete data for the relevant variables was used. Age was not reported in six articles, and another three reported median age instead of mean age. The proportion of male patients was not reported in five articles. The maximum number of days between MR angiography or duplex US and the conventional angiography was not reported in four articles. Estimates of missing values were calculated (imputed) with weighted means or with a best-subset regression analysis (Stata reference manual, vol 2, release 4.0; College Station, Tex: Stata Statistical Software) and were used to explore the effect of clinical variables by using all the available articles to ensure that no potentially important covariate was overlooked.

MR angiography and duplex US were first analyzed separately and were subsequently compared in one model. Univariate analyses were performed to assess the effect of each clinical covariate by using the subset of articles with complete data for that variable and estimated values if necessary. The latter were used to select variables for the final analysis only if no or minor differences in the results between the subset of articles with complete data and the calculation with estimated values were found. Significant variables (P < .05) were subsequently assessed in a multivariate model per examination. Variables with a P value greater than .05 but less than .10 were retained in the model if the explanatory power of the model increased substantially (adjusted R2 increased by 0.05).

In the final multivariate analysis in which MR angiography and duplex US were compared, missing values for significant variables in the model were not substituted with estimates, and only the subset of articles with complete data for the selected variables was used. The selection of variables for the final model was performed by analyzing each variable in turn and considering significant variables alone, so as to avoid exclusion of as few studies as possible. Also, interaction terms were incorporated in this analysis to allow for differential effects, depending on the examination. We tested for heterogeneity across studies by comparing the 95% CI of the observed values of the natural logarithm of the diagnostic odds ratio in each study with that of the predicted values of the diagnostic odds ratio by using the final model. Finally, we re-analyzed the final summary ROC model with a random effects regression analysis (Stata technical bulletin no. 42, College Station, Tex: Stata Statistical Software), which took interstudy variability into account. All analyses were performed with SPSS for Windows (release 7.5.2; SPSS, Chicago, Ill) and STATA (release 5.0, Stata Statistical Software) software.

Sensitivity analyses.—A so-called jackknife type of sensitivity analysis of the final model was accomplished by performing multiple summary ROC analyses and excluding each article in turn. The jackknife sensitivity analysis is used to determine the contribution of the results in each article to the overall analysis. Three articles on duplex US used another definition of disease as determined at conventional angiography: Instead of 50% stenosis, 70% stenosis was used in one study (27), and severe vessel wall irregularities were used in two others (31,32). In a sensitivity analysis, with dummy variables for the studies with another definition of disease, we determined whether these studies demonstrated a difference in diagnostic performance as compared with the other studies on duplex US. As before, a positive coefficient indicated increased discriminatory power, and a negative coefficient indicated reduced discriminatory power. In one study on MR angiography (26), the authors reported that gadolinium-based contrast material was administered only in selected patients, and we evaluated the results in this study by using a dummy variable for comparison with the other MR angiography studies.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Review of Studies
Our literature search resulted in 760 references, of which we retrieved 92 articles. Sixty-seven articles were excluded because (a) MR angiography was performed without gadolinium enhancement (n = 37); (b) the absolute numbers of TP, FN, TN, and FP results either were not available or could not be derived (n = 11); (c) duplex US was not color guided (n = 7); (d) no standard of reference was used (n = 4); (e) only treatment recommendations were reported (n = 3); (f) authors reported on the same patients in more than one article (n = 3); (g) no original data were reported (n = 1); or (h) only results of aneurysms and vascular grafts were reported (n = 1). None of the 160 non–English-language articles fulfilled the inclusion criteria for the meta-analysis. Thirty-one articles (511,1539) met our inclusion criteria, of which six (1520) were available from a previous meta-analysis (4). Three articles used another definition of disease (27,31,32), and, in one MR angiography study (26), gadolinium enhancement was not used in all patients. These four studies were evaluated only in the sensitivity analysis, which resulted in nine articles on MR angiography and 18 on duplex US for the baseline analysis.

Overall, 38 of 372 (10%) discrepancies in data extraction occurred between the two authors and ranged from zero to 12 of 31 (0%–39%) for the different variables (Table 5). All discrepancies were resolved by means of consensus. In Tables 1 and 2, the examination characteristics of the 31 studies included in the meta-analysis are outlined; Tables 3 and 4 present the clinical characteristics. All studies but one (25) were judged to have been prospective. The MR angiographic results in 216 patients (from nine articles) were included in the baseline analysis. The mean age among patients who underwent MR angiography was 63 years; 72% were men, and 28% were women. Duplex US results reported in 18 studies with 1,059 patients were included in the baseline analysis. The mean age among patients who underwent duplex US was 65 years; 65% were men, and 35% were women. The funnel plot (Fig 1) for the number of analyzed segments as a function of the discriminatory power of the study (natural logarithm of the diagnostic odds ratio) demonstrated a symmetric funnel-shaped distribution for the duplex US studies, which suggests that publication bias was unlikely to be present. Although the MR angiographic studies were symmetrically distributed, there were a few with a large number of segments; therefore, publication bias could not be properly evaluated.


View this table:
[in this window]
[in a new window]

 
TABLE 5. Discrepancies and Measures of Agreement between Two Authors for Data Extraction from 31 Studies
 


View larger version (15K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 1. Funnel plot shows discriminatory power (D, natural logarithm of diagnostic odds ratio) versus number of segments evaluated for pooled data from MR angiography (solid line) and duplex US (dotted line) studies. The pooled discriminatory power for MR angiography is greater than that for duplex US, which indicates that the diagnostic performance of MR angiography was better than that of duplex US. Horizontal error bars = 95% CI, {block} = MR results from individual studies, {circ} = US results from individual studies. The distribution of data points looks fairly funnel-shaped and symmetric for duplex US, which suggests that publication bias was unlikely. For MR angiography, there were too few studies with a large number of segments to enable evaluation of publication bias.

 
Weighted Pooled Analysis
On the basis of a random effects model, the pooled sensitivity for MR angiography (97.5% [95% CI: 95.7%, 99.3%]) was higher than that for duplex US (87.6% [95% CI: 84.4%, 90.8%]). The pooled specificities were similar (for MR angiography, 96.2% [95% CI: 94.4%, 97.9%]; for duplex US, 94.7% [95% CI: 93.2%, 96.2%]). The pooled value of the natural logarithm of the diagnostic odds ratio (Fig 1) was 6.43 [95% CI: 5.66, 7.19] for MR angiography and 4.99 [95% CI: 4.30, 5.68]) for duplex US, which indicated that, overall, the discriminatory power of MR angiography was better than that of duplex US.

Summary ROC Analysis
No significant predictors were demonstrated in the univariate analysis for MR angiography, and no effect was demonstrated for different positivity criteria (regression coefficient, 0.16 [95% CI: -0.66, 0.98]; P = .65) The univariate analysis for duplex US demonstrated that as the maximum number of days between duplex US and conventional angiography increased, the discriminatory power of duplex US decreased [regression coefficient, -0.031 per day [95% CI: -0.060, -0.002]; P = .04). In the same model, the regression coefficient for the positivity criterion of duplex US was a significant predictor [regression coefficient, -0.66 [95% CI: -1.14, -0.19]; P = .01). For both MR angiography and duplex US, neither the quality scores nor the individual covariates for evaluating individual aspects of quality were significant predictors of diagnostic performance.

In the comparison analysis, without adjustment for covariates, the discriminatory power of MR angiography (regression coefficient, 2.11 [95% CI: 0.12, 4.09]) was better than that of duplex US (P = .04). When we adjusted for each covariate in turn, the discriminatory power of MR angiography again was better than that of duplex US, with regression coefficients of 1.18–2.27. In the comparison analysis, the time between duplex US and conventional angiography and the positivity criterion were significant predictors, with similar coefficients as in the analysis for duplex US examination alone. Age had a significant effect on discriminatory power, with a regression coefficient of -0.13 per year (95% CI: -0.250, -0.003; P = .05).

In the final model with adjustment for multiple covariates, the discriminatory power of MR angiography was better than that of duplex US but with a slightly lower regression coefficient of 1.67 (95% CI: -0.23, 3.56) that only approached statistical significance (P = .08). The interaction terms were included to allow for a duplex US–specific effect for the maximum number of days between duplex US and conventional angiography (regression coefficient, -0.031 per day [95% CI: -0.055, -0.006]; P = .02) and for the positivity criterion (regression coefficient, -0.63 [95% CI -1.05, -0.21]; P = .005) (Table 6). Age was not a significant predictor in the multivariate model. The adjusted R2 value for the final model was 0.41. Figure 2 presents the summary ROC curves determined on the basis of the final model for MR angiography and duplex US, adjusted to 0 days between duplex US and conventional angiography.


View this table:
[in this window]
[in a new window]

 
TABLE 6. Final Model for Comparison between MR Angiography and Duplex US
 


View larger version (18K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 2. Summary ROC (SROC) curves for MR angiography and duplex US based on the final model, adjusted to 0 days between duplex US and conventional angiography. The summary ROC curve for MR angiography is further to the upper left than is that of duplex US, indicating that the discriminatory power of MR angiography was better than that of duplex US.

 
Heterogeneity
The 95% CI of the observed discriminatory power of each examination was compared with the 95% CI of the values predicted with the final model. The predicted values from the MR angiographic studies all fell within the observed 95% CIs, which was indicative of homogeneity. The same was true for all but three of the duplex US articles. The three articles were by Pinto et al (37), who reported very high sensitivity (96%); Aly et al (23), who reported high sensitivity (92%) and specificity (99%); and Sensier et al (39), who reported low sensitivity (79%). Application of a random effects regression analysis to the final summary ROC model to account for the unexplained heterogeneity demonstrated that the discriminatory power of MR angiography was better than that of duplex US, with a regression coefficient of 1.73 (95% CI: 0.44, 3.02; P = .009).

Sensitivity Analyses
Exclusion of all articles, one by one, from the final model did not have a large effect on the difference in discriminatory power between MR angiography and duplex US (regression coefficient range, 1.33–2.14). In a sensitivity analysis, we included three duplex US studies in which another definition of disease or another positivity criterion was used. The study with another percentage of diameter reduction as the definition of disease (27) demonstrated better discriminatory power, but this difference was not significant in comparison with results from the other duplex US studies (regression coefficient, 2.66 [95% CI: -6.93, 12.25]; P = .56). The two studies by Koelemay et al (31,32) used irregularities of the vessel wall and luminal narrowing seen at duplex US as positivity criteria and severe vessel wall irregularities seen at conventional angiography as the definition of disease. Results from these two studies demonstrated a discriminatory power that was lower than those of the other duplex US studies (regression coefficient, -2.16 [95% CI: -3.21, -1.10]; P = .001). In the study by Cambria et al (26), a gadolinium-based contrast agent was administered only in selected patients, which decreased the discriminatory power relative to that of the other MR angiography studies (regression coefficient, -2.20 [95% CI: -3.92, -0.49]; P = .02).


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
The current meta-analysis compared gadolinium-enhanced MR angiography and color-guided duplex US for the evaluation of stenoses and occlusions in the work-up for peripheral arterial disease of the lower extremities. The results suggest that the discriminatory power of MR angiography was better than that of duplex US, which was demonstrated both with the summary ROC results and with the pooled weighted estimates. In comparison with conventional angiography, both imaging modalities provided good diagnostic performance. Both had high specificity, but the sensitivity of duplex US was lower than that of MR angiography. The analysis also demonstrated that an increase in time between duplex US and conventional angiography resulted in a decrease in the discriminatory power of duplex US.

A limitation of pooling sensitivities and specificities is that different positivity criteria used in individual studies are not taken into account. Summary ROC analysis, on the other hand, allows adjustment for different positivity criteria. Furthermore, summary ROC analysis can be extended to a multivariate regression analysis to adjust for differences in patient characteristics, study design, and diagnostic imaging protocols. Adjustment for these differences was limited in our analysis, however, because not all articles included the relevant details. For example, the mean age of patients was not always reported. The results based on comparative summary ROC analysis of the subset of studies in which mean age was reported suggested that both types of studies had lower discriminatory power in elderly patients, but firm conclusions about the effect of age cannot be made. Furthermore, the percentage of patients with intermittent claudication and the percentages of male and female patients could not be extracted from all articles. Finally, although most of the duplex US articles reported site-specific results, only five of the nine MR angiography articles did so, which made a comparative subgroup analysis by anatomic site impractical. We did, however, adjust for the proportion of femoropopliteal and infrapopliteal segments in our analysis and found no difference in effect with this adjustment.

As with all meta-analyses, the present study was limited by the ambiguity of the originally reported data. This ambiguity can lead to differences in interpretation and discrepancies in extraction of data. To minimize the bias due to this limitation, both authors extracted the data independently. Discrepancies occurred in 10% of the extracted data points. Overall, the authors demonstrated good agreement with regard to the extracted information, with {kappa} values ranging from 0.63 to 1.00 and correlation coefficients (r values) ranging from 0.92 to 1.00.

Another limitation of meta-analyses is that the quality of the original studies may affect the results. L'Abbé et al (49) recommended that a quality score be calculated for studies included in a meta-analysis. In our analysis, we evaluated the quality of the study design and reporting methods by distinguishing studies that fulfilled all quality criteria versus those that did not and by using a published rating score (48) for the quality of diagnostic imaging studies. In the summary ROC analysis, neither the quality scores nor the individual covariates that constituted the quality score were significant predictors of diagnostic performance.

Publication bias may have affected our results. Although we demonstrated that publication bias was unlikely to be present for duplex US studies, we cannot exclude such bias, because the limited number of data points could have decreased the power of detecting publication bias with the funnel plot. Moreover, the limited number of MR angiography studies, all of which included relatively small numbers of patients, did not enable us to detect whether publication bias was present. Another potential issue related to publication bias is that early reports of diagnostic test results generally are more favorable. This could have potentially biased the results against duplex US, because publications on duplex US have appeared since the early 1980s, whereas gadolinium-enhanced MR angiography was first performed in the early 1990s. To determine whether this may have influenced the results, we evaluated the effect of publication year and found that the discriminatory power of MR angiography and duplex US did not change over the years.

In general, the time between MR angiography and conventional angiography was shorter (<=14 days; mean, 5 days) than that between duplex US and conventional angiography (<=61 days; mean, 17 days). With an increase in the period between the comparison examination (MR angiography or duplex US) and the reference standard examination (conventional angiography), one would expect a greater change in the disease status due, for example, to progression of disease (50). Thus, with an increase in the time between the comparison and the reference examinations, one can expect a decrease in the discriminatory power of the comparison examination, which was indeed demonstrated in this analysis for duplex US. In fact, the lower discriminatory power of duplex US as compared with MR angiography was explained in part by the longer time between duplex US and conventional angiography relative to that between MR angiography and conventional angiography. This implies that the comparison and reference examinations should ideally be performed on the same day and that comparisons between MR angiography and duplex US should take this factor into account, which we did by adjusting for this variable in the final model.

The reported sensitivities for duplex US span a broad range, which may be explained by the fairly long delay between US and conventional angiography (discussed in the preceding paragraph), operator dependency, differences in technique, variation among duplex US machines, or differences in patient populations. Results from a previous study (51) in which US assessment of carotid arterial stenosis was evaluated suggested that differences in the hardware or software of duplex US machines could cause discrepancies in measured velocities. We could not, however, detect a difference in diagnostic performance for different duplex US machines.

Questions have been raised concerning the use of conventional angiography as the reference standard for comparison with MR angiography. Owen et al (52) and Carpenter et al (53) reported that conventional angiography may not be a good reference method for demonstrating runoff vessels, because MR angiography demonstrated more patent vessels than did conventional angiography. Thus, some authors (26,42) reported a measure of agreement ({kappa} statistic) rather than the sensitivity and specificity for the comparison of MR angiographic results with conventional angiographic results. Cambria et al (26) reported {kappa} values of 0.48–0.60, and Quinn et al (42) reported substantial to perfect agreement ({kappa} = 0.61–1.00) for nearly all anatomic segments.

The authors of three articles on MR angiography (8,10,38) compared different techniques for performing the examination. In our meta-analysis, we included only the results of gadolinium-enhanced MR angiography because gadolinium enhancement has rapidly become the standard and has been shown to substantially improve the diagnostic performance of MR angiography (8,38,54). With the ongoing technical developments in MR imaging, one can expect future improvements in the discriminatory power of MR angiography. Major improvements in duplex US are less likely, although the use of intravascular contrast agents could potentially improve this method, as well. Such improvements may necessitate an update of the meta-analysis in the future.

Ideally, MR angiography and duplex US should be compared in the same group of patients or should be randomly assigned to groups of patients (14). The literature search did not retrieve any articles in which gadolinium-enhanced MR angiography was compared directly with color-guided duplex US. It is possible that the demonstrated differences in our analysis of diagnostic performance between MR angiography and duplex US may reflect differences in study or patient characteristics. In fact, the current results suggest that part of the superiority in diagnostic performance of MR angiography, as compared with that of duplex US, was explained by such differences. Furthermore, it should be noted that both examinations were performed in highly selected patient populations. Almost all studies were conducted in an academic setting in either North America or Europe and included patients usually scheduled for preinterventional work-up for peripheral arterial disease. Widespread use of MR angiography and duplex US in patients with broader clinical indications might result in different diagnostic performance of these examinations; therefore, generalization of our results should be made with caution.

The goal of imaging in the work-up for peripheral arterial disease is not to discriminate between patients with and those without disease (the history and ankle-brachial index do that), but rather to discriminate between diseased and nondiseased segments, that is, to localize the disease. Thus, in determining the sensitivity and specificity of imaging examinations for peripheral arterial disease, data analysis according to segment probably is the most relevant, and, in all articles but one (16), results were indeed reported according to segment rather than according to limb or patient. This would imply that multiple segments per patient were analyzed in each study and that observations within each study may have been correlated. Correlation of the observations within each study is a characteristic of the individual study results and does not imply that the data points used in a meta-analysis are correlated. In a meta-analysis, potential bias related to this problem can be adjusted if the correlations in the individual studies are known, which generally is not the case. Nevertheless, the fact that disease severity in arterial segments is correlated within a patient does not necessarily mean that the diagnostic performance is correlated as well.

Ultimately, diagnostic information according to segment must be integrated to enable treatment decision making for the patient. Evaluation and optimization of the decision-making process will require an extensive analysis that must take into account not only the diagnostic accuracies of the examination, as presented here, but also the effects of imaging on treatment planning, prognosis, quality of life, local expertise, availability of equipment, and costs.

In conclusion, our results suggest that the discriminatory power of gadolinium-enhanced MR angiography was better than that of color-guided duplex US and that MR angiography was a highly sensitive and specific method, as compared with conventional angiography, for the work-up for peripheral arterial disease, which implies that MR angiography could potentially replace duplex US and conventional angiography.


    ACKNOWLEDGMENTS
 
We thank Richard P. Cambria, MD, and John A. Kaufman, MD, for kindly providing the data from their study, and Thomas F. Hany, MD, and Kai Yu Ho, MD, PhD, for kindly providing additional information.


    FOOTNOTES
 
Abbreviations: FN = false-negative, FP = false-positive, ROC = receiver operating characteristic, TN = true-negative, TP = true-positive

Author contributions: Guarantor of integrity of entire study, M.G.M.H.; study concepts and design, M.G.M.H., K.V.; definition of intellectual content, M.G.M.H., K.V.; literature research, K.V.; data acquisition, M.G.M.H., K.V.; data analysis, K.V.; statistical analysis, M.G.M.H., K.V.; manuscript preparation, K.V.; manuscript editing, M.G.M.H., K.V.; manuscript review, M.G.M.H.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 

  1. Egglin TK, O'Moore PV, Feinstein AR, Waltman AC. Complications of peripheral arteriography: a new system to identify patients at increased risk. J Vasc Surg 1995; 22:787-794.[Medline]
  2. Hessel SJ, Adams DF, Abrams HL. Complications of angiography. Radiology 1981; 138:273-281.[Abstract/Free Full Text]
  3. Koelemay MJW, Den Hartog D, Prins MH, Kromhout JG, Legemate DA, Jacobs MJHM. Diagnosis of arterial disease of the lower extremities with duplex ultrasonography. Br J Surg 1996; 83:404-409.[Medline]
  4. De Vries SO, Hunink MG, Polak JF. Summary receiver operating characteristic curves as a technique for meta-analysis of the diagnostic performance of duplex ultrasonography in peripheral arterial disease. Acad Radiol 1996; 3:361-369.[Medline]
  5. Snidow JJ, Johnson MS, Harris VJ, et al. Three-dimensional gadolinium-enhanced MR angiography for aortoiliac inflow assessment plus renal artery screening in a single breath hold. Radiology 1996; 198:725-732.[Abstract/Free Full Text]
  6. Hany TF, Debatin JF, Leung DA, Pfammatter T. Evaluation of the aortoiliac and renal arteries: comparison of breath-hold, contrast-enhanced, three-dimensional MR angiography with conventional catheter angiography. Radiology 1997; 204:357-362.[Abstract/Free Full Text]
  7. Adamis MK, Li W, Wielopolski PA, et al. Dynamic contrast-enhanced subtraction MR angiography of the lower extremities: initial evaluation with a multisection two-dimensional time-of-flight sequence. Radiology 1995; 196:689-695.[Abstract/Free Full Text]
  8. Poon E, Yucel EK, Pagan-Marin H, Kayne H. Iliac artery stenosis measurements: comparison of two-dimensional time-of-flight and three-dimensional dynamic gadolinium-enhanced MR angiography. AJR Am J Roentgenol 1997; 169:1139-1144.[Abstract/Free Full Text]
  9. Rofsky NM, Johnson G, Adelman MA, Rosen RJ, Krinsky GA, Weinreb JC. Peripheral vascular disease evaluated with reduced-dose gadolinium-enhanced MR angiography. Radiology 1997; 205:163-169.[Abstract/Free Full Text]
  10. Ho KY, de Haan MW, Kessels AG, Kitslaar PJ, van Engelshoven JM. Peripheral vascular tree stenoses: detection with subtracted and nonsubtracted MR angiography. Radiology 1998; 206:673-681.[Abstract/Free Full Text]
  11. Ho KY, Leiner T, de Haan MW, Kessels AG, Kitslaar PJ, van Engelshoven JM. Peripheral vascular tree stenoses: evaluation with moving-bed infusion-tracking MR angiography. Radiology 1998; 206:683-692.[Abstract/Free Full Text]
  12. Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med 1993; 12:1293-1316.[Medline]
  13. Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making 1993; 13:313-321.
  14. Irwig L, Tosteson AN, Gatsonis C, et al. Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med 1994; 120:667-676.[Abstract/Free Full Text]
  15. Cossman DV, Ellison JE, Wagner WH, et al. Comparison of contrast arteriography to arterial mapping with color-flow duplex imaging in the lower extremities. J Vasc Surg 1989; 10:522-529.[Medline]
  16. Davies AH, Magee TR, Parry R, et al. Duplex ultrasonography and pulse-generated run-off in selecting claudicants for femoropopliteal angioplasty. Br J Surg 1992; 79:894-896.[Medline]
  17. Moneta GL, Yeager RA, Lee RW, Porter JM. Noninvasive localization of arterial occlusive disease: a comparison of segmental Doppler pressures and arterial duplex mapping. J Vasc Surg 1993; 17:578-582.[Medline]
  18. Mulligan SA, Matsuda T, Lanzer P, et al. Peripheral arterial occlusive disease: prospective comparison of MR angiography and color duplex US with conventional angiography. Radiology 1991; 178:695-700.[Abstract/Free Full Text]
  19. Polak JF, Karmel MI, Mannick JA, O'Leary DH, Donaldson MC, Whittemore AD. Determination of the extent of lower-extremity peripheral arterial disease with color-assisted duplex sonography: comparison with angiography. AJR Am J Roentgenol 1990; 155:1085-1089.[Abstract/Free Full Text]
  20. Whelan JF, Barry MH, Moir JD. Color flow Doppler ultrasonography: comparison with peripheral arteriography for the investigation of peripheral vascular disease. J Clin Ultrasound 1992; 20:369-374.[Medline]
  21. Zeuchner J, Geitung JT, Lukes P, Gothlin JH. Angiography and colour flow duplex ultrasonography in the evaluation of peripheral ischaemic occlusive arterial disease. Acta Radiol 1994; 35:270-274.[Medline]
  22. AbuRahma AF, Khan S, Robinson PA. Selective use of segmental Doppler pressures and color duplex imaging in the localization of arterial occlusive disease of the lower extremity. Surgery 1995; 118:496-503.[Medline]
  23. Aly S, Sommerville K, Adiseshiah M, Raphael M, Coleridge Smith PD, Bishop CC. Comparison of duplex imaging and arteriography in the evaluation of lower limb arteries. Br J Surg 1998; 85:1099-1102.[Medline]
  24. Arya S. Comparison of color Doppler sonography and angiography in assessing lower limb arterial occlusive disease. Indian J Radiol Imaging 1996; 6:27-32.
  25. Bergamini TM, Tatum CM, Jr, Marshall C, Hall-Disselkamp B, Richardson JD. Effect of multilevel sequential stenosis on lower extremity arterial duplex scanning. Am J Surg 1995; 169:564-566.[Medline]
  26. Cambria RP, Kaufman JA, L'Italien GJ, et al. Magnetic resonance angiography in the management of lower extremity arterial occlusive disease: a prospective study. J Vasc Surg 1997; 25:380-389.[Medline]
  27. Currie IC, Jones AJ, Wakeley CJ, et al. Non-invasive aortoiliac assessment. Eur J Vasc Endovasc Surg 1995; 9:24-28.[Medline]
  28. Hany TF, Schmidt M, Davis CP, Gohde SC, Debatin JF. Diagnostic impact of four postprocessing techniques in evaluating contrast-enhanced three-dimensional MR angiography. AJR Am J Roentgenol 1998; 170:907-912.[Abstract/Free Full Text]
  29. Karacagil S, Lofberg AM, Almgren B, et al. Duplex ultrasound scanning for diagnosis of aortoiliac and femoropopliteal arterial disease. Vasa 1994; 23:325-329.[Medline]
  30. Karacagil S, Lofberg AM, Granbo A, Lorelius LE, Bergqvist D. Value of duplex scanning in evaluation of crural and foot arteries in limbs with severe lower limb ischaemia: a prospective comparison with angiography. Eur J Vasc Endovasc Surg 1996; 12:300-303.[Medline]
  31. Koelemay MJ, Legemate DA, van Gurp J, Ponson AE, Reekers JA, Jacobs MJ. Colour duplex scanning and pulse-generated run-off for assessment of popliteal and cruropedal arteries before peripheral bypass surgery. Br J Surg 1997; 84:1115-1119.[Medline]
  32. Koelemay MJ, Legemate DA, de Vos H, van Gurp JA, Reekers JA, Jacobs MJ. Can cruropedal colour duplex scanning and pulse generated run-off replace angiography in candidates for distal bypass surgery. Eur J Vasc Endovasc Surg 1998; 16:13-18.[Medline]
  33. Lai DT, Huber D, Glasson R, et al. Colour duplex ultrasonography versus angiography in the diagnosis of lower-extremity arterial disease. Cardiovasc Surg 1996; 4:384-388.[Medline]
  34. Laissy JP, Debray MP, Menegazzo D, et al. Prospective evaluation of peripheral arterial occlusive disease by 2D MR subtraction angiography. J Magn Reson Imaging 1998; 8:1060-1065.[Medline]
  35. Larch E, Minar E, Ahmadi R, et al. Value of color duplex sonography for evaluation of tibioperoneal arteries in patients with femoropopliteal obstruction: a prospective comparison with anterograde intraarterial digital subtraction angiography. J Vasc Surg 1997; 25:629-636.[Medline]
  36. Linke RJ, Davies RP, Giles AJ, Walsh JA, Thompson BW. Colour duplex ultrasound: a screening modality for femoropopliteal disease in patients with intermittent claudication. Australas Radiol 1994; 38:320-323.[Medline]
  37. Pinto F, Lencioni R, Napoli V, et al. Peripheral ischemic occlusive arterial disease: comparison of color Doppler sonography and angiography. J Ultrasound Med 1996; 15:697-704.[Abstract]
  38. Quinn SF, Sheley RC, Szumowski J, Shimakawa A. Evaluation of the iliac arteries: comparison of two-dimensional time of flight magnetic resonance angiography with cardiac compensated fast gradient recalled echo and contrast-enhanced three-dimensional time of flight magnetic resonance angiography. J Magn Reson Imaging 1997; 7:197-203.[Medline]
  39. Sensier Y, Hartshorne T, Thrush A, Nydahl S, Bolia A, London NJ. A prospective comparison of lower limb colour-coded duplex scanning with arteriography. Eur J Vasc Endovasc Surg 1996; 11:170-175.[Medline]
  40. Aly S, Jenkins MP, Zaidi FH, Smith PD, Bishop CC. Duplex scanning and effect of multisegmental arterial disease on its accuracy in lower limb arteries. Eur J Vasc Endovasc Surg 1998; 16:345-349.[Medline]
  41. Sensier Y, Hartshorne T, Thrush A, Handford H, Nydahl S, London NJ. The effect of adjacent segment disease on the accuracy of colour duplex scanning for the diagnosis of lower limb arterial disease. Eur J Vasc Endovasc Surg 1996; 12:238-242.[Medline]
  42. Quinn SF, Sheley RC, Semonsen KG, Leonardo VJ, Kojima K, Szumowski J. Aortic and lower-extremity arterial disease: evaluation with MR angiography versus conventional angiography. Radiology 1998; 206:693-701.[Abstract/Free Full Text]
  43. Berlin JA. Does blinding of readers affect the results of meta-analyses? University of Pennsylvania Meta-analysis Blinding Study Group. Lancet 1997; 350:185-186.[Medline]
  44. Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. J R Stat Soc 1988; 151:419-463.
  45. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7:177-188.[Medline]
  46. Fleiss JL. The statistical basis of meta-analysis. Stat Methods Med Res 1993; 2:121-145.[Medline]
  47. Fleischmann KE, Hunink MG, Kuntz KM, Douglas PS. Exercise echocardiography or exercise SPECT imaging? a meta-analysis of diagnostic test performance. JAMA 1998; 280:913-920.[Abstract/Free Full Text]
  48. Kent DL, Haynor DR, Larson EB, Deyo RA. Diagnosis of lumbar spinal stenosis in adults: a metaanalysis of the accuracy of CT, MR, and myelography. AJR Am J Roentgenol 1992; 158:1135-1144.[Abstract/Free Full Text]
  49. L'Abbe KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Ann Intern Med 1987; 107:224-233.
  50. Da Silva A, Widmer LK. Arterienprojekt: peripher arterielle verschlusskrankheit. In: Widmer LK, Stähelin HB, Nissen C, Da Silva A, eds. Venen-, arterien-krankheiten, koronare herzkrankheit bei berufstätigen: prospektiv-epidemiologische untersuchung basler studie I-III. Bern, Switzerland: Huber, 1981; 137-240.
  51. Kuntz KM, Polak JF, Whittemore AD, Skillman JJ, Kent KC. Duplex ultrasound criteria for the identification of carotid stenosis should be laboratory specific. Stroke 1997; 28:597-602.[Abstract/Free Full Text]
  52. Owen RS, Carpenter JP, Baum RA, Perloff LJ, Cope C. Magnetic resonance imaging of angiographically occult runoff vessels in peripheral arterial occlusive disease. N Engl J Med 1992; 326:1577-1581.[Abstract]
  53. Carpenter JP, Owen RS, Baum RA, et al. Magnetic resonance angiography of peripheral runoff vessels. J Vasc Surg 1992; 16:807-813.[Medline]
  54. Snidow JJ, Aisen AM, Harris VJ, et al. Iliac artery MR angiography: comparison of three-dimensional gadolinium-enhanced and two-dimensional time-of-flight techniques. Radiology 1995; 196:371-378.[Abstract/Free Full Text]



This article has been cited by other articles:


Home page
Med Decis MakingHome page
L.R. Arends, T.H. Hamza, J.C. van Houwelingen, M.H. Heijenbrok-Kal, M.G.M. Hunink, and T. Stijnen
Bivariate Random Effects Meta-Analysis of ROC Curves
Med Decis Making, September 1, 2008; 28(5): 621 - 638.
[Abstract] [PDF]


Home page
Med Decis MakingHome page
T. H. Hamza, J. B. Reitsma, and T. Stijnen
Meta-Analysis of Diagnostic Studies: A Comparison of Random Intercept, Normal-Normal, and Binomial-Normal Bivariate Summary ROC Approaches
Med Decis Making, September 1, 2008; 28(5): 639 - 649.
[Abstract] [PDF]


Home page
Am. J. Roentgenol.Home page
R. Ouwendijk, M. de Vries, T. Stijnen, P. M. T. Pattynama, M. R. H. M. van Sambeek, J. Buth, A. V. Tielbeek, D. A. van der Vliet, L. J. SchutzeKool, P. J. E. H. M. Kitslaar, et al.
Multicenter Randomized Controlled Trial of the Costs and Effects of Noninvasive Diagnostic Imaging in Patients with Peripheral Arterial Disease: The DIPAD Trial
Am. J. Roentgenol., May 1, 2008; 190(5): 1349 - 1357.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
S. Thurnher, S. Miller, G. Schneider, C. Ballarati, G. Bongartz, C. U. Herborn, S. Schoenberg, M. A. Cova, G. Morana, K. Niazi, et al.
Diagnostic Performance of Gadobenate Dimeglumine Enhanced MR Angiography of the Iliofemoral and Calf Arteries: A Large-Scale Multicenter Trial
Am. J. Roentgenol., November 1, 2007; 189(5): 1223 - 1237.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
M. H. Heijenbrok-Kal, M. C. J. M. Kock, and M. G. M. Hunink
Lower Extremity Arterial Disease: Multidetector CT Angiography Meta-Analysis
Radiology, November 1, 2007; 245(2): 433 - 439.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
T. Albrecht, E. Foert, R. Holtkamp, M. A. Kirchin, C. Ribbe, F. K. Wacker, M. Kruschewski, and B. C. Meyer
16-MDCT Angiography of Aortoiliac and Lower Extremity Arteries: Comparison with Digital Subtraction Angiography
Am. J. Roentgenol., September 1, 2007; 189(3): 702 - 711.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
M. de Vries, R. Ouwendijk, K. Flobbe, P. J. Nelemans, A. G. Kessels, G. H. Schurink, J. A. van der Vliet, F. M. J. Heijstraten, P. W. M. Cuypers, L. E. M. Duijm, et al.
Peripheral Arterial Disease: Clinical and Cost Comparisons between Duplex US and Contrast-enhanced MR Angiography--A Multicenter Randomized Trial.
Radiology, August 1, 2006; 240(2): 401 - 410.
[Abstract] [Full Text] [PDF]


Home page
Occup Med (Lond)Home page
A. Thompson and R. House
Hand-arm vibration syndrome with concomitant arterial thrombosis in the hands
Occup. Med., August 1, 2006; 56(5): 317 - 321.
[Abstract] [Full Text] [PDF]


Home page
CMAJHome page
A. W.S. Rutjes, J. B. Reitsma, M. Di Nisio, N. Smidt, J. C. van Rijn, and P. M.M. Bossuyt
Evidence of bias and variation in diagnostic accuracy studies.
Can. Med. Assoc. J., February 14, 2006; 174(4): 469 - 476.
[Abstract] [Full Text] [PDF]


Home page
radtechHome page
B. FURLOW
Aortic Emergencies
Radiol. Technol., September 1, 2005; 77(1): 41 - 49.
[Abstract] [Full Text] [PDF]


Home page
RadioGraphicsHome page
H. Ota, K. Takase, H. Rikimaru, M. Tsuboi, T. Yamada, A. Sato, S. Higano, T. Ishibashi, and S. Takahashi
Quantitative Vascular Measurements in Arterial Occlusive Disease
RadioGraphics, September 1, 2005; 25(5): 1141 - 1158.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
G. S. Gazelle, P. M. McMahon, U. Siebert, and M. T. Beinfeld
Cost-effectiveness Analysis in the Assessment of Diagnostic Imaging Technologies
Radiology, May 1, 2005; 235(2): 361 - 370.
[Abstract] [Full Text] [PDF]