|
|
||||||||
Evidence-based Practice |
1 From the Institute for Technology Assessment and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Zero Emerson Place, Suite 2H, Boston, MA 02114 (G.S.G., P.M.M., M.T.B., E.F.H.); and Center for Risk Analysis and Department of Health Policy & Management, Harvard School of Public Health, Boston, Mass (G.S.G., P.M.M., M.C.W.). Received December 17, 2003; revision requested February 24, 2004; revision received March 9; accepted April 12. Supported in part by the National Cancer Institute under R01-CA/HS83960 and the U.S. Department of the Army under DAMD 17-99-2-9001. Address correspondence to G.S.G.
| ABSTRACT |
|---|
|
|
|---|
MATERIALS AND METHODS: A state-transition decision model for evaluating the (societal) cost-effectiveness of RF ablation and hepatic resection in patients with CRC liver metastases was developed. The model tracks the presence, number, size, location, growth, detection, and removal of up to 15 individual metastases in each patient. Survival, quality of life, and cost are predicted on the basis of disease extent. Imaging, ablation, and resection affect outcomes through detection and elimination of individual metastases. Several patient care strategies were developed and compared on the basis of cost, effectiveness, and incremental cost-effectiveness (expressed as dollars per quality-adjusted life-year [QALY]). Extensive sensitivity analysis was performed to evaluate the impact of alternative scenarios and assumptions on results.
RESULTS: A strategy permitting ablation of up to five metastases with computed tomographic (CT) follow-up every 4 months resulted in a gain of 0.65 QALYs relative to a no-treat strategy, at an incremental cost of $2400 per QALY. Compared with this ablation strategy, a strategy permitting resection of up to four metastases, one repeat resection, and CT follow-up every 6 months resulted in an additional gain of 0.76 QALYs at an incremental cost of $24 300 per QALY. Across a range of model assumptions, more aggressive treatment strategies (ie, ablation or resection of more metastases, treatment of recurrent metastases, more frequent follow-up imaging) were superior to less aggressive strategies and had incremental cost-effectiveness ratios of less than $35 000 per QALY. Findings were insensitive to changes in most model parameters; however, results were somewhat sensitive to changes in size thresholds for RF ablation, the number of metastases present, and surgery and treatment costs.
CONCLUSION: RF ablation is a cost-effective treatment option for patients with CRC liver metastases. However, in most scenarios, hepatic resection is more effective (in terms of QALYs gained) than RF ablation and has an incremental cost-effectiveness ratio of less than $35 000 per QALY.
© RSNA, 2004
Index terms: Cost-effectiveness Economics, medical Liver neoplasms, 761.33 Liver neoplasms, therapy, 761.1269 Radiofrequency (RF) ablation, 761.1269
| INTRODUCTION |
|---|
|
|
|---|
Several factors have been observed to correlate with survival in patients with metastatic CRC. Principal among these is the extent of liver replaced by tumor (3,79,1116). Other factors, such as serum alkaline phosphatase levels (2,3,79,13,15,17) and carcinoembryonic antigen levels (8,15), have also been identified as important predictors, although they may in fact serve as indicators of the extent of liver metastasis (14) rather than as independent predictors of outcome.
The predominant effect of liver tumor involvement suggests that a successful locally targeted therapy could increase life expectancy. Though based only on observational trials, there is now substantial evidence that resection of liver metastases from CRC can result in long-term survival in some patients (10,16,1838). Less invasive alternatives to surgical resection include percutaneous tumor ablation by using methods such as radiofrequency (RF) ablation (3968), cryosurgery (6973), or interstitial laser thermotherapy (7479). In most cases these procedures can be performed percutaneously on an outpatient basis, although laparotomy is sometimes required to protect adjacent viscera or, for larger lesions, to occlude vascular inflow. Percutaneous tumor ablation is particularly attractive owing to its predictable results, relatively low cost, and low complication rate.
We recently published the results of a cost-effectiveness analysis of hepatic resection in patients with CRC liver metastases (80). The purpose of our current study was to evaluate the relative cost-effectiveness of RF ablation and hepatic resection in patients with metachronous liver metastases from CRC, and more generally, to compare the outcomes, cost, and cost-effectiveness of a variety of treatment and follow-up strategies.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Cost-effectiveness Model
For the analysis, we developed a state-transition Monte Carlo decision model (8587). With Monte Carlo simulation, it is possible to simulate cohorts of hypothetical patients. For each patient, probabilistic events and outcomes are randomly assigned values from population distributions, and the expected outcomes are determined. The process is repeated for each individual in the cohort, and averages are computed for the entire cohort. The model used in this study was based on a model previously used to evaluate the cost-effectiveness of surgical removal of metastases in patients with liver metastases from CRC (80). The model contains three states: alive _treat, alive_notreat, and dead. All patients begin in the alive_treat state. Patients in the alive_treat state are potential candidates for treatment (ie, tumor ablation or resection). Patients transition to the alive_notreat state when they have either been found to be "untreatable" (ie, to have more metastases than the threshold for treatment in the strategy being considered) or when they have had the maximum allowable number of treatments for the strategy under consideration. The dead state is self-explanatory.
At the end of each cycle, patients return to one of the three model states according to event and transition probabilities defined in the model. This process continues until all patients in the initial cohort reach the dead state, at which point the simulation is terminated. The model includes only one generic imaging and treatment strategy, which is defined by using specific model parameters (eg, treatment threshold, image and possibly treat interval, test sensitivity).
The model tracks up to 15 individual hepatic metastases in each patient, specifying and updating tumor location, size, rate of growth, detection, and removal or ablation. The model was analyzed by simulating cohorts of hypothetical patients, one at a time, from initial presentation until death (1 month cycle length) while tracking disease progression, diagnostic tests, procedures, complications, survival, and costs.
For each hypothetical patient, the number of metastases present is drawn at random from a population distribution. Metastases are then distributed throughout the liver. We assume that each metastasis has an independent, equal probability of being located in each of the eight liver segments (8890). The size of each metastasis is similarly drawn at random from a population distribution. Over time, metastases that are present grow, may be detected with imaging tests, and may be removed during resection. Growth in tumor volume is assumed to be exponential, at rates determined from the literature (91). We assume that no new liver metastases develop over time, since all patients are assumed to have undergone removal of their primary tumors. However, metastases can be missed at initial diagnosis but can later be detected with repeat imaging tests. Such metastases would account for the "new metastases," which were probably present but undetected earlier, that have been reported to occur in clinical series (9294).
The frequency with which follow-up imaging tests are performed is explicitly modeled. Each time a patient undergoes a diagnostic imaging test, metastases may be (independently) detected or missed. Tumor detection is based on test sensitivity, although it is assumed that below a certain (definable) size threshold, all metastases are missed. We assume that helical contrast materialenhanced computed tomographic (CT) scanning is used in all patients.
On the basis of the CT results, a decision is made regarding the candidacy of each patient for treatment (or for repeat treatment, in the event of newly detected metastases or local treatment failure). We allow the possibility of different criteria for determining treatment candidacy, depending on the number of metastases identified (less than or equal to one, two, three, four, five, or six) and the number of hepatic segments involved. In patients undergoing surgical removal of metastases, additional metastases may be found at the time of surgery, either by palpation of the liver or by using intraoperative ultrasonography (US). The detection of these additional metastases could influence the decision to proceed with surgical removal of metastases and/or modify the plan for resection.
As a result of treatment, patients are either free of metastatic disease or have residual metastases, depending on the number and location of metastases detected, the location of metastases not detected, and the procedure performed. Patients may also suffer surgical morbidity or mortality. Each of these events is explicitly modeled.
For the current study, several modifications to the surgical-removal-of-metastases model were required. These are described below. A schematic diagram of the revised model is illustrated in Figure 1.
|
Parameter Estimation
Model parameters were estimated from the literature where valid data were available and otherwise consisted of our best estimates (consensus of authors). To determine parameter estimates, we performed a comprehensive review of the English-language literature by using PubMed and reviewing the bibliographies of articles thus identified. Base-case estimates and ranges used in sensitivity analyses are summarized in Table 1.
|
We estimated the morbidity and mortality probabilities associated with liver tumor ablation to be 0.02 and 0.003, respectively (101). We used the same estimates for the probability of morbidity and mortality for all instances of liver tumor ablation (ie, initial or repeat ablation).
We used 0.85 as our base-case estimate for CT sensitivity. This was increased from the estimate used in our analysis of hepatic resection to reflect the ongoing improvements in CT technology (117). Lower estimates were used in sensitivity analyses.
Costs
Costs were estimated from a societal perspective. Costs were converted to 1998 dollars by using the medical care component of the Consumer Price Index (118). For the base-case analysis, costs and quality-adjusted life-years (QALYs) were discounted at a real annual rate of 3%. We also considered discount rates of 0% and 5% in sensitivity analyses. Base-case estimates for all costs are summarized in Table 2. Our approach to estimating costs for the model has been previously described (80). We describe our approach to deriving costs that were added to the revised model below.
|
We estimated the time required for RF ablation as 1 day, which included the time associated with travel, waiting, the procedure, and postprocedural monitoring. As in our previous analysis of hepatic resection (80), we did not include the costs of transportation, care by family and friends, or household modification related to diagnostic testing or treatment.
We assumed that up to three liver tumors could be treated with ablation on 1 day. Therefore, the total estimated cost of ablation was the same for patients undergoing treatment of one to three metastases (on any single day). For patients undergoing treatment of four to six metastases, it was assumed that two treatment sessions would be required. Cost estimates were adjusted accordingly. The cost of repeat RF ablation was assumed to be the same as the cost of initial therapy.
We estimated that, on average, complications from ablation would require 1 day of hospitalization. It was believed that resource use during this day of hospitalization would be comparable to resource use for patients sustaining laparotomy-related complications. We therefore used the estimated per diem routine (ie, nonintensive care unit) care costs among patients having diagnosis-related group, or DRG, codes 191/192 who underwent hepatic resection at our institution in fiscal year 1998 (that were used to estimate laparotomy costs) to estimate complication costs for ablation. These cost estimates were derived by using software from Eclypsis (previously Transition Systems; Boca Raton, Fla) that interfaces with the hospital accounting system and can access patient records according to DRG and/or Current Procedural Terminology codes, admitting and/or discharge diagnosis, or principal procedure performed, among other criteria.
Treatment Outcomes
Several reports have described the "natural history" of patients with untreated metastases (3,79,11,12,1416). Although these reports have spanned 3 decades and represent the experience at several institutions in different countries, they are remarkably consistent. The single most important determinant of survival appears to be the extent of liver replacement by tumor. Different investigators have reported liver involvement by using different criteria. These include the following: less than 25% versus 25% or more of total LVRT (3,7,15), unilateral versus bilateral metastases (9,11,12,14,15), and fewer than four versus four or more metastases (8,9,16). Each of these criteria is likely to have divided groups of patients along roughly the same lines (eg, patients with unilateral metastases are unlikely to have
25% LVRT). Furthermore, estimates of median survival that are based on the different categorizing criteria are similar. We assigned to patients with less than 25% (but more than 0%) LVRT a median survival of 11.5 months, and to patients with LVRT of 25% or more a median survival of 6.3 months on the basis of a weighted average of the studies reporting survival as a function of percentage LVRT (3,7,15). Because we explicitly modeled the number, size, and growth of all metastases, it was possible to calculate percentage LVRT in each patient and to revise it with each cycle of the model. State-to-state transition probabilities for patients with liver metastases were calculated from the corresponding estimated median survivals assuming constant hazard rates (ie, exponential survival curves) (120,121).
For our base-case analysis, we assigned mortality hazard rates to patients without liver metastases (either initially or following successful treatment) that were twice the age- and sex-adjusted rates for the U.S. population (as reported in the 1988 U.S. Life Tables); data from the National Cancer Institute Survival, Epidemiology, and End Results, or SEER, registry were consistent with our estimates of hazard rates for patients with no metastases. To estimate hazard rates for the analyses by using the SEER database, the age- and sex-specific 1-year survival probabilities were used to calculate the hazard rates (by age and sex) for patients with "localized" disease. The hazard rates for patients with localized disease derived from the SEER data are approximately the same as those assigned to patients with no metastases in our base-case analysis. Lower mortality hazard rates were considered in sensitivity analyses; see below for details.
The effectiveness of ablation depends on the size of the lesions treated. We derived the probability of obtaining complete tumor necrosis, according to tumor size, from a study by Solbiati et al (52), in which 117 patients with 179 CRC liver metastases were treated with RF ablation and followed up for up to 5 years. On the basis of the results of this study, we estimated that complete tumor necrosis would be achieved in 78.4%, 47.2%, and 31.6% of tumors 2.5 cm or smaller, larger than 2.5 cm but smaller than or equal to 4 cm, and larger than 4 cm, respectively. For lesions in which only partial necrosis was achieved, the model assigned a postablation tumor volume that was equal to 5% of the pretreatment volume. Imaging and treatment strategies involving in situ ablation were specified to permit multiple treatment sessions. For the base-case analysis, we limited the total number of ablation sessions to three per lesion.
QALYs were used as the primary end point with which the effectiveness of each of the testing strategies was assessed. We assigned years of life without hepatic metastases QALY weights equal to age- and sex-adjusted population values (122). The limited data that are available (123,124) regarding QOL in patients with metastatic CRC suggest that the majority (approximately 95%) of survival is spent with a normal (age-adjusted) QOL. QOL then declines rapidly at the end of life (median time at which QOL declines: last 12 days of life). We therefore modeled QALYs by subtracting a toll in the final cycle (month) before death, estimating that QOL in the month prior to death was 60% of that for age- and sex-matched control subjects. QALY tolls were also assessed to account for decreased QOL following RF ablation, hepatic resection, or laparotomy.
To evaluate the effect of improvements in RF ablation, we created and evaluated two additional scenarios: "improved RF," in which complete tumor necrosis was achieved in 100%, 75%, and 50% of treated tumors 2.5 cm or smaller, larger than 2.5 cm but smaller than or equal to 4 cm, and larger than 4 cm but smaller than or equal to 10 cm, respectively; and "perfect RF," in which complete tumor necrosis was achieved in all treated tumors. For the base-case analysis, patients with one or more tumors larger than 5 cm in diameter were not considered candidates for ablation. Different thresholds for treatment candidacy were evaluated in sensitivity analyses.
Resection strategies were similar to those included in the initial analysis of hepatic resection alone (80), with two exceptions. First, we permitted one repeat resection in all considered strategies. Second, we considered more thresholds for surgical candidacy (less than or equal to one, two, three, four, five, or six metastases seen).
Analyses Performed
The model was analyzed as a first-order Monte Carlo simulation. We simulated cohorts of 100 000 hypothetical patients, one at a time, from initial presentation until death, while tracking disease progression, tests, procedures, complications, survival, and costs. Sample size was determined adaptively to achieve convergence of estimates and separation of strategies in terms of cost, effectiveness, and cost-effectiveness. We modeled several strategies for RF ablation and hepatic resection, including those that have been advocated in the literature or used in practice. Strategies for RF ablation differed in the maximum number of lesions that could be treated, the maximum number of repeat ablations allowed, and the frequency of follow-up imaging. Resection strategies differed in approach (segmental resection vs wedge excision), maximum number of lesions or segments removed, and frequency of follow-up imaging. Ablation and resection strategies were compared in similar cohorts (ie, identically defined target populations), but with allowance for random variation. All comparisons also included costs and outcomes for patients in the entry cohort who were not candidates for the therapy being evaluated.
The base-case analysis was performed by using cohorts of 65-year-old men, a 3% discount rate for both cost and effectiveness, and estimates for costs, treatment effectiveness, and other event probabilities as described above and in Table 1. Included in the comparison is a reference strategy in which neither ablation nor resection is offered and thus follow-up CT is not performed (the "no-treat" strategy). For both RF ablation and hepatic resection, we simulated all possible combinations of follow-up interval (4, 6, or 12 months) and treatment threshold (less than or equal to one, two, three, four, five, or six metastases seen). For each strategy, we calculated total costs and QALYs and compared strategies by using incremental cost-effectiveness ratios (ICERs). Strategies that cost more but yielded lower total benefitsthat is, they were "dominated"and those that had a higher ICER than the next most costly and effective strategythat is, strategies that were "weakly dominated"were eliminated.
Extensive sensitivity analysis was performed to investigate the effects of changes in model parameters on estimated costs and effectiveness. The following parameters were varied: patient age and sex; mortality hazard rates (for patients with and those without metastases); number of metastases; tumor size and doubling time; diagnostic test sensitivity; maximum tumor size treatable with RF ablation; success in achieving local control of treated lesions; costs of ablation, resection, and laparotomy; costs of patient care; and the discount rate used for costs and QALYs. Additional analyses in which several of the parameters were simultaneously varied were performed (Tables 1 and 2).
| RESULTS |
|---|
|
|
|---|
|
|
|
Across all scenarios, when all possible RF ablation and resection strategies were considered (results not shown), more aggressive surgical strategies were superior (ie, resulted in more QALYs gained) to RF ablation. In most cases, the ICERs of even the most aggressive surgical strategies were less than $35 000 per QALY. An additional finding was that some of the less aggressive RF ablation strategies (eg, treatment of one to two metastases) were both less expensive and more effective than the no-treat strategy.
| DISCUSSION |
|---|
|
|
|---|
These results suggest that physicians performing ablation and resection should be encouraged to select patients for therapy on the basis of technical feasibility rather than numerical thresholds and to pursue repeat treatment when new lesions are identified after initial therapy. Our results suggest that increasing the threshold for treatment candidacy could result in moderate population-wide QALY gains.
For example, in our base-case scenario, moving from a strategy of treating (with ablation) only one metastasis with 12-month follow-up to a strategy of treating up to six metastases with 4-month follow-up increased the quality-adjusted life expectancy (averaged across the entire patient cohort, including both patients who were and patients who were not candidates for therapy) from 0.8381 to 1.3270. Applying this to a population of 10 000 patients would represent a gain of 489 QALYs. When resection is considered, the resulting gain would be even greater: 2516 QALYs. It should also be noted that there are generally no other potentially curative therapeutic options for these patients. Furthermore, the results suggest that RF ablation of larger lesions should be encouraged, even though local control rates (on an individual-lesion basis) diminish as the size of the target tumor increases. Raising the size threshold for treatment permits more patients to be considered candidates for therapy and results in substantial QALY gains across the population.
The results were relatively insensitive to changes in most model parameters. However, the results were sensitive to changes in the number of metastases present (ie, the assumed population distribution), the size threshold above which lesions were considered untreatable with RF ablation, and the cost of RF ablation. More generally, any changes in model parameters that increased the effectiveness of RF resulted in an increase in the ICER for resection relative to RF ablation. Furthermore, as local control rates were increased (ie, while moving from the base-case assumptions to perfect RF), the ICER of RF ablation versus "no-test/no-treat" decreased, and the ICER of resection versus RF ablation increased. Improved local control results in longer survival and fewer repeat procedures, both of which tended to favor RF ablation in the comparisons. Of note, however, the magnitude of these changes was not always large. For example, in our base-case scenario (CT sensitivity 0.85), moving from base-case to perfect RF only resulted in a gain of 0.0297 QALY and had a correspondingly small effect on the ICER of resection versus ablation.
Increasing the number of metastases present reduced the number of patients in the cohort who were candidates for therapy and thus decreased the average effectiveness, cost, and total gain in life expectancy (that might be expected across a population) of even the most aggressive management strategy. However, given base-case assumptions regarding local control rates, this reduction in the number of treatment candidates had little effect on the ICER of ablation versus the no-treat reference strategy. As local control rates were increased (ie, when moving to improved RF and perfect RF), the effect of reduced candidacy rates was to decrease the ICER of ablation versus the no-treat strategy, as compared with the base-case analysis results. In essence, improved RF effectiveness resulted in both longer life expectancy and lower costs. These effects (ie, the benefits associated with achieving local control) were more pronounced as the number of metastases per patient increased.
In contrast, increasing the number of metastases present substantially increased the ICER of resection versus ablation. Because fewer patients would be candidates for resection, and because postoperative recurrence rates would increase with more metastases per patient, gains in QALYs across the cohort were more expensive to achieve. It is important to note, however, that even given the assumption that the average number of metastases per patient is 10 (as opposed to six in the base-case scenario), the ICER of the reference ablation strategy (relative to the no-treat strategy) was $3500 per QALY, and the ICER of the reference resection strategy (relative to the ablation strategy) was $47 500 per QALY.
Increasing the size threshold for treatment with RF ablation resulted in more patients being eligible for treatment and in greater QALY gains across the cohort of patients treated with RF. It also substantially increased the ICER of resection relative to RF ablation because the cost and effectiveness of surgery were not affected. It is important to note that these results were generally consistent across different scenarios (ie, base case, improved RF, perfect RF).
The sensitivity to the costs of RF ablation is not particularly surprising: Increasing or decreasing these costs would be expected to affect cost-effectiveness ratios. However, even when the cost of RF ablation is increased by 50%, a strategy permitting ablation of five or fewer metastases with 4-month follow-up had an ICER of less than $5000 per QALY relative to the no-treat reference strategy.
The principal limitations of our study were related to the necessary simplification of reality that was required in developing a tractable model, as well as to the uncertainty that surrounds some of our parameter estimates. For example, we did not specifically model chemotherapy costs. As in our prior study, we used aggregate estimates for the costs of caring for patients that were based on their disease extent. Therefore, it was not possible to investigate the effects of chemotherapy costs (alone) on cost-effectiveness. However, our sensitivity analysis examined the effect of decreasing overall patient care costs by 50%, and results were similar to those of the base-case scenario. We also did not specifically model extrahepatic metastases, and, although our results appear consistent with those of reported clinical series, one must be careful not to generalize to populations that are dissimilarfor example, one in which there is a much higher incidence of extrahepatic metastases.
With respect to parameter uncertainty, we attempted to provide reasonable estimates for each of the specific model parameters and probability distributions and to justify these estimates with references to the published literature and by validating the results of our simulations against published results from clinical trials. The greatest parameter uncertainty undoubtedly relates to life expectancy (and therefore our transition probabilities) in patients with no metastases (see above), and, to a lesser extent, in patients with limited metastases. Few would dispute that patients with extensive liver metastases have an extremely poor prognosis. Our estimated life expectancy in these patients (ie, those with
25% LVRT) of 6.3 months is supported by results of several published studies (3,7,16). However, patients who undergo hepatic resection are a highly selected subgroup of all patients with metastatic CRC, and it is difficult to estimate how long these patients might live without surgery. Our approach, by modeling the actual size and growth of individual metastases and basing life expectancy on percentage LVRT seems reasonable; the only question is whether or not the hazard rate assigned to patients with limited metastases is too high. We addressed this issue through sensitivity analysis, in which the hazard rate in patients with metastases was increased or decreased by 50%, and found little change in results compared with the base-case analysis.
Finally, there is certainly heterogeneity across patients with respect to virtually all model parameters, particularly those relating to outcome and cost. We did not attempt to assess the potential impact of population heterogeneity on our results because of the unavailability of data on which to base range estimates. In addition, through second-order Monte Carlo simulation ("probabilistic sensitivity analysis") it may be possible to assess the global impact of parametric uncertainty on model results. However, superimposing a second-order simulation on our first-order Monte Carlo model was not possible in its current form. Additional data collection and analysis in these areas may be of use in the future.
In conclusion, the results of this study suggest that RF ablation and hepatic resection are relatively cost-effective management strategies for patients with limited hepatic metastases from CRC. Our results further suggest that physicians should be relatively aggressive in their approach to managing these patients and specifically suggest that aggressive surgical approaches are likely to result in substantial QALY gains at a reasonable cost.
| FOOTNOTES |
|---|
The information does not necessarily reflect the position of the government, and no endorsement should be inferred.
Authors stated no financial relationship to disclose.
Author contributions: Guarantor of integrity of entire study, G.S.G.; study concepts, G.S.G.; study design, G.S.G., M.C.W.; literature research, G.S.G., P.M.M.; data acquisition, G.S.G., P.M.M., M.T.B.; data analysis/interpretation, all authors; statistical analysis, G.S.G., E.F.H.; manuscript preparation, G.S.G.; manuscript definition of intellectual content, editing, revision/review, and final version approval, all authors
| REFERENCES |
|---|
|
|
|---|