|
|
||||||||
Evidence-based Practice |
1 From the Program for the Assessment of Radiological Technology (ART Program), Dept of Epidemiology and Biostatistics, and Dept of Radiology, Erasmus MC, University Med Center Rotterdam, Dr Molewaterplein 50, Rm Ee21-40B, 3015GE Rotterdam, the Netherlands (K.V., M.C.J.M.K., M.G.M.H.); Dept of Health Policy and Management, Harvard School of Public Health, Boston, Mass (K.M.K., G.S.G., M.G.M.H.); Division of Vascular Surgery, Brigham and Womens Hosp, Boston, Mass (M.C.D.); and Decision Analysis and Technology Assessment Group, Dept of Radiology, Massachusetts General Hosp, Harvard Med School, Boston, Mass (G.S.G.). From the 2001 RSNA scientific assembly. Received Apr 15, 2002; revision requested Jun 19; revision received Jul 26; accepted Sep 23. Supported in part by the Netherlands Organization for Scientific Research. Address correspondence to K.V. (e-mail: k.visser@erasmusmc.nl).
| ABSTRACT |
|---|
|
|
|---|
MATERIALS AND METHODS: A decision model was used to compare the societal cost-effectiveness of a new imaging modality with that of gadolinium-enhanced MR angiography. Main outcome measures were quality-adjusted life years (QALYs) and lifetime costs. By using threshold analysis of a given willingness to pay per QALY, target values for costs, sensitivity for detection of significant stenoses, and proportion of cases requiring additional work-up with intraarterial digital subtraction angiography owing to equivocal results of the new modality were determined. The base case evaluated was that of 60-year-old men with severe intermittent claudication and assumed an incremental cost-effectiveness threshold of $100,000 per QALY.
RESULTS: If treatment were limited to angioplasty, a new imaging modality would be cost-effective if the costs were $300 and the sensitivity was 85%, even if up to 35% of patients needed additional work-up. When both angioplasty and bypass surgery were considered as treatment options, a new imaging modality was cost-effective if the costs were $300, the sensitivity was higher than 94%, and 20% of patients required additional work-up.
CONCLUSION: Multidetector row CT angiography, as compared with currently used imaging modalities such as MR angiography, has the potential to be cost-effective in the evaluation of patients with intermittent claudication.
© RSNA, 2003
Index terms: Arteries, stenosis or obstruction, 92.721 Computed tomography (CT), angiography, 92.12916 Cost-effectiveness Radiology and radiologists, socioeconomic issues
| INTRODUCTION |
|---|
|
|
|---|
Multidetector row computed tomographic (CT) angiography has recently been developed as a potential imaging modality for the diagnosis of PAD. The preliminary results of studies to evaluate CT angiography are promising (16,17). Also, other examinations such as MR angiography with blood pool agents (18), MR angiography (19) or DSA with carbon dioxide as the contrast material (20), and duplex US with contrast material (21) have been suggested as new imaging modalities for the detection of PAD.
Currently, the future role of these imaging modalities is speculative. To determine whether a new imaging modality has the potential to be cost-effective, as compared with the modalities currently used in practice, the diagnostic accuracy, costs, and complications associated with the new modality should be known. In the early development of new technologies, these parameters are generally unknown and it is difficult to predict what the exact values for these parameters will be. However, because these values are known for the currently used modalities, it is possible to calculate the target values that a new modality should meet to be cost-effective compared with the modalities currently used for diagnostic work-up (2224). Calculations of this kind can help focus not only the development of new modalities for the diagnostic work-up of PAD but also the development of new technologies in health care in general.
The purpose of our study was to determine the target values for diagnostic accuracy that would make multidetector row CT angiography, as compared with gadolinium-enhanced MR angiography, cost-effective in terms of the following parameters: the sensitivity for detection of significant stenoses, the proportion of cases requiring additional work-up with DSA because of equivocal results, and the costs of multidetector row CT angiography in the work-up of patients with intermittent claudication.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Diagnostic work-up with gadolinium-enhanced MR angiography consisted of localizing the lesion (ie, suprainguinal or infrainguinal) and determining the treatment plan (percutaneous angioplasty, bypass surgery, or supervised exercise program). Results were defined as equivocal when the examination was technically inadequate (eg, because of poor vessel opacification, incorrect timing, artifacts, or early venous filling) or for some other reason the examination did not enable formulation of a treatment plan (eg, discrepancy between symptoms and MR angiographic findings or doubt about the hemodynamic significance of a stenosis). Intraarterial DSA was performed when the MR angiography result was equivocal or could not be performed because of a contraindication (eg, claustrophobia). DSA was also performed when no significant lesion was localized at MR angiography; this outcome was considered to be a false result. Furthermore, we recognized that MR angiography could yield incorrect information, and, as a result, patients could be treated incorrectly.
For percutaneous treatment, we assumed that the DSA examination performed just prior to the procedure would correctly depict the findings that had been incorrectly depicted at MR angiography. If the percutaneous intervention procedure was then canceled, the costs were considered to be equal to the costs of performing DSA plus some extra expenses for the inefficient use of personnel, housing, and equipment. The rates of complication associated with planned but not performed angioplasty were considered to be equal to the rates of complication associated with diagnostic DSA. For bypass surgery, we assumed that an incorrect MR angiography result would not be detected unless the wrong arterial segment was bypassed, in which case the patient would still have symptoms and thus return to the hospital for DSA followed by repeat intervention. Figure 1 is a flowchart of the decision tree.
|
In the second scenario, that of more invasive treatment, bypass surgery was performed in those patients who did not have lesions that were suitable for angioplasty. For recurrent symptoms of intermittent claudication or critical limb ischemia, a second treatment was considered: percutaneous treatment, if feasible; otherwise bypass surgery was performed. For those patients with a history of coronary artery disease, it was assumed, because of the higher complication rates for these individuals, that bypass surgery could be performed only if the patient developed critical limb ischemia. Finally, there are always some patients (5%, assumption) who have imaging results indicating that no revascularization would be considered unless the patient developed critical limb ischemia.
Data Sources
Diagnostic examination characteristics.Values for the sensitivity of gadolinium-enhanced MR angiography in the detection of significant stenoses were available from a previously performed meta-analysis (12). The probabilities of treatment recommendations based on gadolinium-enhanced MR angiography findings were derived from the literature (15). The examination characteristics of gadolinium-enhanced MR angiography were available from studies in which MR angiography was compared with DSA, which was considered the reference standard (12,15,28). We incorporated the risks of morbidity and mortality associated with DSA (1,2) and assumed that gadolinium-enhanced MR angiography did not involve risks. The diagnostic DSA examinations were planned in such a way that angioplasty could be performed immediately afterward if the patient had a suitable lesion. The examination characteristics of MR angiography and DSA are presented in Table 1.
|
Invasive treatment for suprainguinal lesions consisted of angioplasty with selective stent placement and aortic bifurcation surgery. Invasive treatment for infrainguinal lesions consisted of angioplasty and either femoropopliteal or femoroinfrapopliteal bypass surgery. Patency rates were available from published meta-analyses (3032). The annual rate of critical limb ischemia in patients with intermittent claudication was 0.017 for patients younger than 65 years (33) and 0.036 for patients aged 65 years and older (3336). Limb amputation was performed if treatment for critical limb ischemia failed and three invasive interventions had already been performed in the diseased limb.
Costs.Medicare reimbursement rates were used for the costs of gadolinium-enhanced MR angiography and DSA and yielded estimates of $574 and $1,183, respectively (Table 2). Costs for revascularization vary more widely among patients than do costs for diagnostic work-up; therefore, we decided to use the costs available from a study that was performed to assess the costs of revascularization procedures for PAD as a function of patient characteristics (37). These costs were adjusted for the age, sex, history of coronary artery disease, and presenting symptoms (intermittent claudication vs critical limb ischemia) of patients. The estimated costs were $25,790 for aortic bifurcation surgery, $8,290 for suprainguinal angioplasty, $18,110 for infrainguinal bypass surgery, and $4,480 for infrainguinal angioplasty (Table 2). Although the costs of amputations vary widely among patients, we used Medicare reimbursement rates because amputations are rare among patients with intermittent claudicationand, thus, cost estimates have little effect on the resultsand a more elaborate cost-accounting analysis was not within the scope of this study.
|
Health-related quality of life.Estimated health values for patients with intermittent claudication were available from a study performed with participants in an exercise program in the Netherlands (39). These values were derived from responses to the EuroQol-5D (a generic questionnaire on quality of life), which were converted to time trade-off values. The values were 0.79 for patients with no or mild claudication and 0.71 for those with severe claudication (Table 2). The estimated health values for patients with critical limb ischemia, amputation below the knee (including transmetatarsal amputations), and amputation above the knee were available from a study conducted among the general public (40). Scenarios describing these three health states were presented, and time trade-off estimates were calculated. For patients with critical limb ischemia, the utility estimate was 0.35 (40) (Table 2). The estimated health value for patients who had undergone below-the-knee amputation was 0.61, whereas that for patients who had undergone above-the-knee amputation was 0.20 (40) (Table 2).
Determination of Thresholds
Cost-effectiveness analysis was performed to determine whether multidetector row CT angiography, as compared with gadolinium-enhanced MR angiography, would be cost-effective in the work-up of patients with intermittent claudication. Lifetime costs and quality-adjusted life years (QALYs) were calculated (with a discount rate of 3%) (42), and a strategy was considered to be cost-effective if the additional cost per QALY did not exceed the societys willingness to paythat is, the amount of money that society is willing to pay for one additional QALY. For these analyses, we varied the cost-effectiveness threshold between $50,000 and $250,000 per QALY gained and used a threshold of $100,000 per QALY gained for the baseline analysis.
On the basis of the analysis, we determined what combinations of costs, sensitivity for detection of significant stenosis, and proportion of patients requiring additional work-up with DSA owing to equivocal CT angiography results (eg, because of technically failed examinations, artifacts, or vessel wall calcifications) would be required for multidetector row CT angiography to be cost-effective compared with MR angiography. To determine these thresholds for a new imaging modality, we had to make assumptions about the risks involved and about the treatment recommendations based on multidetector row CT angiography findings. In terms of the mortality- and morbidity-related risks associated with CT angiography, we assumed that these risks equaled those that are associated with the use of a low-osmolality contrast agent: probabilities of 9.0 x 10-6 for mortality risk and 3.1 x 10-4 for morbidity risk (43). Furthermore, the probabilities of a given treatment being recommended on the basis of CT angiography findings were assumed to be the same as those for MR angiography (Table 1). For sensitivity analysis, we assumed that the probabilities of a given treatment being recommended on the basis of CT angiography findings were the same as those recommended on the basis of duplex US (44) or DSA findings.
In a base-case analysis, cohorts of 60-year-old men with symptoms of severe unilateral claudication for 1 year, an ankle-brachial index of 0.70, and no history of coronary artery disease were evaluated. Target values for CT angiography in both the minimally invasive scenario and the more invasive treatment scenario were determined. Two other patient cohorts were considered: 40-year-old men with characteristics similar to those in the base case and 70-year-old men with a history of coronary artery disease and other characteristics similar to those in the base case. Women were not considered in this analysis because the results of previous analyses showed that the results of treatment for women were similar to the results of treatment for men (29). In the sensitivity analysis, the target criteria for CT angiography that would make this examination, as compared with DSA, cost-effective were determined. Also, sensitivity analyses were performed to determine the estimated health value with no or mild claudication (range, 0.750.83) and the costs of revascularization (50% and 150% of baseline estimates), because previous analyses have shown that the results of evaluating treatment for patients with intermittent claudication were sensitive for these parameters (29).
| RESULTS |
|---|
|
|
|---|
|
|
|
|
|
|
|
There was an inverse relationship between the health-related quality of life with no or mild intermittent claudication and the estimated costs of a new imaging modality. The costs for the new imaging modality would need to be lower if the quality of life was higher. If the costs for the revascularization were higher than our baseline estimate, the new modality would potentially have a higher cost. However, the differences in estimated target values for the range in health-related quality of life estimates and the range in cost of revascularization were modest (Table 4).
| DISCUSSION |
|---|
|
|
|---|
Our study was limited by the fact that we used various data sources and made a number of assumptions to keep the model tractable. Such limitations are inherent to decision models and cost-effectiveness analyses. For instance, in our model we considered DSA the reference-standard examination; this precedent is well established in the literature on the diagnostic work-up of patients with PAD (12). Assuming that DSA is the reference standard implies that the new imaging modalities that are potentially more effective than DSA could not be evaluated with the model that we used.
Furthermore, with the described model it was assumed that MR angiography and CT angiography were clinically interchangeable; however, this assumption may not be realistic. Patients with renal insufficiency might be better served by undergoing MR angiography to avoid the nephrotoxicity of iodinated contrast agents, whereas patients with contraindications to MR angiography, such as those who have a pacemaker or are claustrophobic, might be better served by undergoing CT angiography. However, patients with renal insufficiency, pacemakers, or claustrophobia constitute the minority of PAD cases, whereas the described model addresses what the primary choice of imaging should be and allows for secondary imaging examinations, if necessary. For example, the model took into account that a proportion of patients cannot undergo MR angiography because of contraindications, in which case the patients undergo DSA.
Another limitation of the study was that we did not consider regional health care circumstances such as the expertise of the radiologists and the availability of equipment. In an earlier study (25), it was found that differences in quality-adjusted life expectancy and lifetime costs among diagnostic imaging modalities were small, and a new imaging modality that enabled the target values to be met would be in the same range as MR angiography, duplex US, and DSA.
To determine the cost-effectiveness of a new imaging modality that fulfills the target criteria assessed in the current study, it might be better to compare CT angiography with the currently used work-up modality in a pragmatic empirical setting. Such a comparison could be made in a randomized controlled trial in which patients are randomly placed in either the new imaging modality group or the currently used work-up modality group (45) and followed up for a certain time. Possible outcome measures would be the quality of life of the patients, the costs incurred by performing the work-up imaging examination, including those for supplementary imaging and treatment, the confidence of the physician in the examination result, and the patients and/or the physicians preferred imaging modalities. This suggested study design would also take into account local expertise, physicians preferences, and equipment availability.
A final limitation was that we assumed that the societys willingness to pay (ie, amount of money society is willing to pay for one additional QALY) could be defined. The amount society is willing to pay depends on many variables, such as the characteristics of the health care system, the general economy, and the decision context. The actual value is always hypothetical. Recently, an attempt to estimate societys willingness to pay was made by converting estimates of value of life, which were available from various sources, to dollars per QALY gained (46). A range of willingness-to-pay values, from $25,000 to $428,000 per QALY (in 1997 U.S. dollars), was observed (46).
In our base-case analysis, we used $100,000 per QALY as an estimate of societys willingness to pay. We performed an extensive sensitivity analysis and found that the results did not change substantially when societys willingness to pay was varied (from $50,000 to $250,000/QALY gained). We chose $100,000 per QALY as a baseline value instead of the commonly quoted $50,000 per QALY for various reasons: First, the incremental cost-effectiveness ratios for generally accepted interventions vary between $10,000 and $100,000 per QALY gained (47), indicating that the threshold should be $100,000 per QALY. Second, a willingness to pay of $50,000 per QALY has been quoted for well over 10 years and to our knowledge has not been adjusted for either inflation or increasing levels of welfare use. Third, we wanted to determine the least stringent target values that would need to be met for a new technology, and the use of a high threshold value yields the least stringent target criteria.
Currently, several new imaging techniques have been suggested for use in the work-up of patients with PAD (1621,4850). The most promising of these techniques seems to be multidetector row CT angiography, which is simple to perform, fast, and quickly becoming widely available. Preliminary results indicate that multidetector row CT angiography has high diagnostic accuracy and a sensitivity close to our estimated target value (17,4850). The cost of a contrast materialenhanced CT angiography examination was estimated to be $237 (in 1997 U.S. dollars) (51), which was below the target cost. The fact that CT angiography depicts the calcified vessel wall is a disadvantage because the appearance of calcium interferes with the accurate interpretation of stenosis severity and thus may necessitate additional work-up.
On the other hand, contraindications to CT angiography are rare. Usually, a low-osmolality contrast material is used to perform CT angiography, and a small degree of risk associated with the use of contrast material was incorporated into our analysis. The long-term risks of radiation were not considered in our analysis. However, the risk of a one-time exposure is low, and the life expectancy of most patients who have PAD is shorter than the time it typically takes to develop long-term harmful effects from radiation.
In conclusion, compared with currently used imaging examinations such as MR angiography, multidetector row CT angiography has the potential to be cost-effective in the evaluation of patients with intermittent claudication. The role of new imaging modalities that have fairly good preliminary results can be assessed by performing a pragmatic randomized controlled trial in which the new modality is compared with the imaging modality that is currently being used for diagnostic work-up.
| FOOTNOTES |
|---|
Author contributions: Guarantor of integrity of entire study, M.G.M.H.; study concepts, all authors; study design, K.V., M.C.J.M.K., M.G.M.H.; literature research, K.V., M.C.J.M.K.; data acquisition, K.V.; data analysis/interpretation, all authors; statistical analysis, K.V.; manuscript preparation, K.V.; manuscript definition of intellectual content, all authors; manuscript editing, K.V.; manuscript revision/review and final version approval, all authors.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. K. Willmann, B. Baumert, T. Schertler, S. Wildermuth, T. Pfammatter, F. R. Verdun, B. Seifert, B. Marincek, and T. Bohm Aortoiliac and Lower Extremity Arteries Assessed with 16-Detector Row CT Angiography: Prospective Comparison with Digital Subtraction Angiography Radiology, September 1, 2005; 236(3): 1083 - 1093. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. S. Gazelle, P. M. McMahon, U. Siebert, and M. T. Beinfeld Cost-effectiveness Analysis in the Assessment of Diagnostic Imaging Technologies Radiology, May 1, 2005; 235(2): 361 - 370. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. G. M. Hunink Decision Making in the Face of Uncertainty and Resource Constraints: Examples from Trauma Imaging Radiology, May 1, 2005; 235(2): 375 - 383. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. O. Stolberg Treatment of Abdominal Aortic Aneurysms: Review with Evidence-based Methods Radiology, September 1, 2003; 228(3): 614 - 616. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| RADIOLOGY | RADIOGRAPHICS | RSNA JOURNALS ONLINE |