Radiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Published online before print April 21, 2005, 10.1148/radiol.2353040726
This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
2353040726v1
235/3/843    most recent
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Heinrich, M. C.
Right arrow Articles by Uder, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Heinrich, M. C.
Right arrow Articles by Uder, M.
(Radiology 2005;235:843-849.)
© RSNA, 2005


Experimental Studies

Cytotoxic Effects of Ionic High-osmolar, Nonionic Monomeric, and Nonionic Iso-osmolar Dimeric Iodinated Contrast Media on Renal Tubular Cells in Vitro1

Marc C. Heinrich, MD, Martin K. Kuhlmann, MD, Aleksandar Grgic, MD, Martina Heckmann, MD, Bernhard Kramann, MD and Michael Uder, MD

1 From the Department of Diagnostic Radiology (M.C.H., A.G., M.H., B.K.) and Department of Medicine, Division of Nephrology and Hypertension (M.K.K.), University Hospital of Saarland, Homburg/Saar, Germany; and Department of Diagnostic Radiology, University Hospital of Erlangen, Maximiliansplatz 1, 91054 Erlangen, Germany (M.U.). From the 2004 RSNA Annual Meeting. Received April 22, 2004; revision requested June 29; revision received July 21; accepted August 18. Address correspondence to M.U. (e-mail: michael.uder@idr.imed.uni-erlangen.de).


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
PURPOSE: To compare the cytotoxic effects of dimeric and monomeric iodinated contrast media on renal tubular cells in vitro with regard to osmolality.

MATERIALS AND METHODS: LLC-PK1 cells were incubated with ioxithalamate, ioversol, iomeprol-300, iomeprol-150, iodixanol, iotrolan, and hyperosmolar mannitol solutions for 1–24 hours at concentrations from 18.75 to 150 mg of iodine per milliliter. Cytotoxic effects were assessed with 3-(4,5-dimethyl-2-thiazolyl)-2,5-diphenyl-2H-tetrazolium bromide (MTT) assay. Data were analyzed with one-way analysis of variance; post hoc tests were performed.

RESULTS: At equal iodine concentrations, ioxithalamate showed stronger cytotoxic effects than did other contrast media (MTT conversion for ioxithalamate was 4% vs that for ioversol of 32%, that for iomeprol-300 of 34%, that for iodixanol of 40%, and that for iotrolan of 41% of undamaged control cells at 75 mg of iodine per milliliter, n = 61–90, P < .001); there was no significant difference between low-osmolar monomeric and iso-osmolar dimeric contrast media (P > .05). At equal molarity, dimeric contrast media induced significantly stronger cytotoxic effects than did low-osmolar monomeric contrast media (40% for iodixanol and 41% for iotrolan vs 64% for ioversol and 59% for iomeprol-300 at 98.5 mmol/L, n = 61–75, P < .001). At equimolar concentrations, both dimeric contrast media showed stronger cytotoxic effects than did iso-osmolar formulation of iomeprol-150 (51% for iodixanol and 50% for iotrolan vs 77% for iomeprol-150 at 98.5 mmol/L, n = 35–40, P < .001). Mannitol solutions induced weaker cytotoxic effects than did corresponding contrast media compounds (74% for mannitol-520 vs 34% for iomeprol-300 and 41% for mannitol-1860 vs 4% for ioxithalamate, P < .001).

CONCLUSION: Besides hyperosmolality, direct cytotoxic effects of contrast media molecules contribute to their cytotoxic effects. Results of this study indicate that dimeric contrast media molecules have a greater potential for cytotoxic effects on proximal renal tubular cells in vitro than do monomeric contrast media molecules.

© RSNA, 2005


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Contrast medium–induced nephropathy remains one of the most important clinical problems after intravascular administration of iodinated contrast media. Although the incidence of contrast-induced nephropathy is considered low, patients with preexisting renal insufficiency, whether or not it is associated with diabetes mellitus, are at high risk for developing contrast-induced nephropathy (13). Contrast-induced nephropathy is associated with high in-hospital mortality and a poor long-term survival, especially if nephropathy that requires dialysis occurs (35). The pathogenesis of contrast-induced nephropathy is poorly understood. Hemodynamic changes of renal blood flow, which lead to hypoxia of the renal medulla, and direct cytotoxic effects of contrast media on renal cells are thought to contribute to the pathogenesis of contrast-induced nephropathy (6,7).

The osmolality of contrast media is considered to play an important role in the pathogenesis of contrast-induced nephropathy. Low-osmolar nonionic contrast media have been shown to have fewer nephrotoxic effects than do high-osmolar ionic contrast media (1,2,8). In addition, findings in a recent study suggest that in high-risk patients the iso-osmolar dimer iodixanol is associated with fewer nephrotoxic effects than are low-osmolar monomeric contrast media (9). This study has caused debate (10), however, and results of another clinical study showed no significant differences between the renal effects of iodixanol and those of monomeric contrast media (11). Therefore, it is not yet clarified whether dimeric iso-osmolar contrast media really exert fewer nephrotoxic effects than do low-osmolar monomeric contrast media.

Researchers in early in vitro studies found evidence for direct renal tubular cell toxic effects of contrast media (12,13). In vitro experiments are a way to examine the cytotoxic effects of contrast media on renal cells because of the absence of confounding variables, which can be found in vivo (eg, hypoxia due to hemodynamic changes or other systemic mechanisms) (14). The finding of fewer in vivo nephrotoxic effects of low-osmolar contrast media, as compared with those of high-osmolar ionic compounds, correlates with their fewer in vitro cytotoxic effects (14). Researchers in previous studies have compared the effects of different classes of contrast media on renal tubular cells only at equal iodine concentrations. To compare the potential for nephrotoxic effects of monomeric and dimeric contrast media molecules, however, it is necessary to compare the contrast media on a molar basis and to control the effects of osmolality. Thus, the purpose of our study was to compare the cytotoxic effects of monomeric and dimeric contrast media at equal iodine concentrations, as well as at equal molarity, on renal tubular cells in vitro, with special regard to osmolality.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Chemicals
All chemicals were purchased from a commercial manufacturer (Sigma Chemical, Munich, Germany) unless otherwise noted.

Cell Cultures
LLC-PK1 cells that are from a proximal tubular epithelial cell line of porcine origin were obtained from a cell culture collection (American Type Culture Collection, Rockville, Md) and grown in modified medium 199, supplemented with 10% fetal bovine serum (FBS; Invitrogen, Paisley, Scotland), 100 U/mL penicillin, and 100 µg/mL streptomycin (Seromed, Vienna, Austria), at 37°C with a humidified atmosphere of 95% air and 5% CO2. Cells were grown to confluence in flasks (75 cm2) over 6–7 days, treated with trypsin, and seeded into 96 microtiter plates (Greiner, Frickenhausen, Germany). Only confluent cell monolayers with dome formation were studied.

Experimental Solutions
Cells were incubated with either control media (serum-free and phenol red–free medium 199) or various doses of contrast media diluted in serum-free medium 199. Ready-to-use formulations of all contrast media were used. These contrast media included the nonionic dimer iotrolan (Isovist-300; Schering, Berlin, Germany), the nonionic dimer iodixanol (Visipaque 320; Amersham Buchler, Ismaning, Germany), the nonionic monomers iomeprol-300 and iomeprol-150 (Imeron 300 and Imeron 150; Bracco-Byk-Gulden, Konstanz, Germany), the nonionic monomer ioversol (Optiray 300; Mallinckrodt, St Louis, Mo), and the ionic monomer ioxithalamate (Telebrix 300; Guerbet, Sulzbach, Germany). The contrast media we used, with corresponding concentrations and osmolalities, are summarized in the Table.


View this table:
[in this window]
[in a new window]

 
Contrast Media Used in the Study

 
To exclude any effects caused by the dilution of growth factors in the tissue medium by the contrast media solutions, we performed control experiments with isotonic NaCl solution. We tested mannitol control solutions with osmolalities corresponding to those of iomeprol-300 (520 mOsm/kg H2O) and ioxithalamate (1860 mOsm/kg H2O) to study the effect of hyperosmolality.

Experiments
To assess concentration and time dependency of contrast media–mediated cell injury, we used the low-osmolar nonionic monomer iomeprol-300. The concentrations we used ranged from 18.75 to 150 mg of iodine per milliliter, and the incubation times varied from 1 hour, to 5 hours, to 24 hours (12 specimens were tested for each concentration and incubation time).

To compare the effects of different contrast media, cells were incubated for 24 hours. The numbers of specimens tested at concentrations of 49.25 mmol/L (low) and 98.5 mmol/L (high), respectively, are enclosed within parentheses, for the following contrast media: iodixanol (n = 69 and n = 75), iotrolan (n = 66 and n = 61), ioversol (n = 70 and n = 77), iomeprol-300 (n = 71 and n = 61), and ioxithalamate (n = 77 and n = 90). As a control, cells were incubated with corresponding volumes of a mannitol solution with an osmolality of 1860 mOsm/kg H2O (n = 69 and n = 72) and with an osmolality of 520 mOsm/kg H2O (n = 66 and n = 58) and with saline solution (n = 60 and n = 72). For the evaluation to which amount the osmolality contributes to cell injury, we performed separate experiments in which iodixanol (n = 24 and n = 40), iotrolan (n = 24 and n = 40), and iomeprol-300 (n = 17 and n = 35) were compared with the iso-osmolar formulation iomeprol-150 (n = 18 and n = 35) at concentrations of 49.25 mmol/L (low) and 98.5 mmol/L (high) for 24 hours in the same experiments.

Determination of Cell Injury
Cell viability was assessed by using the 3-(4,5-dimethyl-2-thiazolyl)-2,5-diphenyl- 2H-tetrazolium bromide (MTT) uptake assay. The conversion of MTT, a tetrazolium salt, into formazan depends on the activity of a group of mitochondrial dehydrogenases and, thus, is an indicator of cell metabolic activity. The MTT assay was performed according to Mosmann (15), with modifications. An equal volume of MTT reagent (5 mg/mL phosphate-buffered saline) was added to the cell supernatant and incubated 4 hours at 37°C. Supernatants were removed, and 100 µL lysis buffer (20% sodium dodecyl sulfate, 33.3% dimethylformamide, 2% acetic acid, pH 4.7) was added per well; plates were shaken at room temperature for 30 minutes, and absorbance was measured at 570 nm, with 630 nm as reference. The measurements were performed automatically by a microplate reader (Dynatech MR 5000; Dynex Technologies, Chantilly, Va). The incubation with the experimental solutions, MTT, and lysis buffer was performed by one author (M.C.H.).

Statistical Analysis
The data are reported as percentage of undamaged control cells and are presented as the mean ± the standard error of the mean. To compare the effects of the contrast media and to compare the contrast media with the mannitol solutions and the NaCl solution, data were analyzed with one-way analysis of variance, followed by analysis with the Tukey post hoc test for multiple comparisons. MTT reduction after incubation with iomeprol-300 at various doses and various incubation times was compared with the reduction in untreated control cells by means of one-way analysis of variance, followed by analysis with the Dunnett post hoc test for multiple comparisons. A difference with a P value < .05 was considered significant. For statistical analysis and graphic representations, statistical software (Prism 3.03, 2002; GraphPad Software, San Diego, Calif) was used.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Concentration- and Time-dependent Injury in LLC-PK1 Cells
To assess concentration and time dependency of contrast-mediated cell injury on LLC-PK1 cells by measuring mitochondrial activity with MTT assay, we used the low-osmolar nonionic monomer iomeprol-300. The concentrations used ranged from 18.75 to 150 mg of iodine per milliliter, and the incubation times varied between 1 and 24 hours. As shown in Figure 1, iomeprol-300 induced a time- and concentration-dependent cell injury, as assessed with the MTT assay. A significant effect was observed even at a concentration of 18.75 mg of iodine per milliliter after an incubation time of 24 hours (93% ± 6, P < .01 vs unexposed control cells, n = 12). At 1 hour after incubation with iomeprol-300, a significant effect was observed at a concentration of greater than 75 mg of iodine per milliliter (92% ± 2, P < .01 vs unexposed control cells, n = 12).



View larger version (19K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 1. Graph shows concentration and time dependency of the cytotoxic effect of iomeprol-300 in LLC-PK1 cells as assessed with MTT assay. The cells were incubated with iomeprol-300 for 1, 5, and 24 hours, respectively, at concentrations ranging from 18.75 to 150 mg of iodine per milliliter (mg I/ml). The data were reported as percentage of undamaged control cells (% of control). Data show the mean ± standard error of the mean (n = 12).

 
Comparison of Contrast Media
Ioxithalamate, iomeprol-300, ioversol, iodixanol, and iotrolan showed a significant dose-dependent inhibition of MTT conversion (Fig 2). Both dimeric contrast media showed a slightly weaker effect (40% ± 3 for iodixanol and 41% ± 2 for iotrolan; n = 61–75) than did the two monomeric contrast media at a concentration of 75 mg of iodine per milliliter (32% ± 2 for ioversol and 34% ± 2 for iomeprol-300; n = 61–77). This difference was not statistically significant (P > .05). At equal iodine concentrations, the ionic compound ioxithalamate showed a significantly stronger effect than did all other tested contrast media (P < .001). After incubation with ioxithalamate, the MTT conversion was 4% ± 0.3 of the undamaged control cells at a concentration of 75 mg of iodine per milliliter (n = 90).



View larger version (24K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 2. Graph shows comparison of cytotoxic effects of different iodinated contrast media as assessed with MTT assay at equal iodine concentrations. LLC-PK1 cells were incubated with contrast media for 24 hours at concentrations of 37.5 and 75 mg of iodine per milliliter (mg I/ml). Ioxithalamate induced a significantly stronger effect than did the other contrast media. There was no significant difference between the nonionic contrast media. The data were reported as percentage of undamaged control cells (% of control). Data show the mean ± standard error of the mean (n = 61-90). * = P < .001 for ioxithalamate versus iodixanol, ioxithalamate versus iotrolan, ioxithalamate versus iomeprol-300, and ioxithalamate versus ioversol.

 
When we compared the data on a molar basis, the results were different. Both dimeric contrast media showed a significantly stronger inhibition of MTT conversion, as compared with both monomeric contrast media (40% ± 3, 41% ± 2, 64% ± 2, and 59% ± 2 for iodixanol, iotrolan, ioversol and iomeprol-300, respectively, at a concentration of 98.5 mmol/L; n = 61–75; P < .001 for the difference between the monomeric and the dimeric contrast media) (Fig 3). The effects of the dimeric contrast media were as strong as those of the ionic contrast medium, as observed with ioxithalamate (41% ± 2 at a concentration of 98.5 mmol/L; P > .05).



View larger version (27K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 3. Graph shows cytotoxic effects of different iodinated contrast media assessed with MTT assay plotted against the concentration of contrast media molecules in the solution (millimoles of contrast media per liter). LLC-PK1 cells were incubated with contrast media for 24 hours at concentrations ranging from 49.25 to 197 mmol/L (mM). The dimeric contrast media iotrolan and iodixanol showed a significantly stronger inhibition of MTT conversion than did the monomeric contrast media ioversol and iomeprol-300. The data were reported as percentage of undamaged control cells (% of control). Data show the mean ± standard error of the mean (n = 61-90). * = P < .001 for ioxithalamate versus ioversol and ioxithalamate versus iomeprol-300; + = P < .001 for ioversol versus iodixanol, ioversol versus iotrolan, iomeprol-300 versus iodixanol, and iomeprol-300 versus iotrolan.

 
Effect of Osmolality and Dilution
To exclude inhibition of MTT conversion caused by dilution of the tissue culture medium by the contrast media, the growth medium of the cells was diluted with 0.9% NaCl. A 1:8 dilution of the growth medium (corresponding to a contrast media concentration of 37.5 mg of iodine per milliliter) showed no significant effect on the MTT assay (98% ± 2; n = 60; P > .05), whereas a 1:4 dilution induced a slight but significant inhibition of MTT conversion (89% ± 2; n = 72; P < .001). This effect was significantly smaller, however, than that of all contrast media tested (P < .001) (Fig 4).



View larger version (33K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 4. Comparison of cytotoxic effects of ioxithalamate and iomeprol-300 with equal volumes of isotonic saline and equiosmolal mannitol solutions as assessed with MTT assay. LLC-PK1 cells were incubated with contrast media, 0.9% NaCl, and corresponding mannitol solutions, respectively, for 24 hours at concentrations of 12.5% and 25% vol/vol. Dilution of the growth media with 0.9% NaCl showed only minor effects. The effects of the mannitol solutions were significantly weaker than those of the corresponding contrast media. The data were reported as percentage of undamaged control cells (% of control). Data show the mean ± standard error of the mean (n = 54-90). * = P < .001 for mannitol-520 versus iomeprol-300 and mannitol-1860 versus ioxithalamate, mg I/ml = milligrams of iodine per milliliter.

 
To evaluate the effect of hyperosmolality on the tubular cells, we tested mannitol control solutions with osmolalities that corresponded to those of ioxithalamate and iomeprol-300 (1860 mOsm/kg H2O and 520 mOsm/kg H2O, respectively). Hereafter, these mannitol solutions will be referred to as mannitol-1860 and mannitol-520. As shown in Figure 4, both mannitol solutions showed a significant dose-dependent inhibition of the MTT assay. This effect was markedly more pronounced with the mannitol-1860 solution when it was compared with that of the mannitol-520 solution (P < .001). The effects of the mannitol solutions were significantly weaker when they were compared with those of the corresponding contrast media (74% ± 3 and 34% ± 2 for mannitol-520 and iomeprol-300 and 41% ± 1 and 4% ± 0.3 for mannitol-1860 and ioxithalamate, respectively, at 25% vol/vol; n = 58–90; P < .001) (Fig 4).

At concentrations of 49.25 and 98.5 mmol/L, the dimeric contrast media iodixanol (69% ± 2 and 51% ± 4, n = 24–40) and iotrolan (71% ± 1 and 50% ± 2, n = 24–40) induced a more pronounced inhibition of MTT conversion, as compared with that of iomeprol-150 (81% ± 2 and 77% ± 2, n = 18–35, P < .001) (Fig 5). At a concentration of 98.5 mmol/L, the iso-osmolar compound iomeprol-150 showed a slightly weaker effect on the MTT assay than did iomeprol-300 (69% ± 1 and 77% ± 2 for iomeprol-300 and iomeprol-150, respectively; n = 17–35; P < .05) (Fig 5). At this concentration, the mannitol-520 solution showed an inhibition of MTT conversion at 94% ± 2 of the undamaged control cells.



View larger version (21K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 5. Graph shows comparison of cytotoxic effects of the dimeric iso-osmolar contrast media iotrolan and iodixanol with those of low-osmolar monomer iomeprol-300 and those of the iso-osmolar formulation iomeprol-150 assessed with MTT assay at equimolar concentrations (in millimoles per liter [mM]). LLC-PK1 cells were incubated with contrast media for 24 hours at concentrations ranging from 49.25 to 197 mmol/L. Dimeric contrast media iotrolan and iodixanol showed a significantly stronger inhibition of MTT conversion than did monomeric contrast media iomeprol-300 and iomeprol-150. Iomeprol-150 induced a slightly weaker effect than did iomeprol-300. The data were reported as percentage of undamaged control cells (% of control). Data show the mean ± standard error of the mean (n = 17-40). * = P < .001 for iodixanol versus iomeprol-300, iodixanol versus iomeprol-150, iotrolan versus iomeprol-300, and iotrolan versus iomeprol-150; + = P < .05 for iomeprol-150 versus iomeprol-300.

 

    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
At equal iodine concentrations, our investigation showed no significant differences between the direct cytotoxic effects of nonionic monomeric and dimeric contrast media on renal proximal tubular cells in vitro, whereas the ionic contrast media demonstrated a markedly stronger effect when the effect was compared with that of the other contrast media. When we compared the data on a molar basis, however, the dimeric contrast media showed a significantly stronger effect on the tubular cells than did the nonionic monomeric contrast media. This suggests a greater cytotoxic effect of the dimeric contrast media molecules.

This finding, that at equal iodine concentrations the ionic high-osmolar monomer ioxithalamate induced a significantly stronger effect on the tubular cells than did the nonionic low-osmolar monomeric and iso-osmolar dimeric contrast media, is in agreement with results in previous in vitro studies (1621). Findings in those previous studies indicated a greater nephrotoxic potential of ionic hyperosmolar contrast media when they were compared with nonionic contrast media. The greater in vitro toxic effects of the ionic hyperosmolar contrast media, as compared with those of the nonionic contrast media, correlate with their greater nephrotoxic effects in vivo (8,22). The hyperosmolality of ionic contrast media often is thought to play the pivotal role in the greater nephrotoxic effects of these compounds. To distinguish chemotoxic effects of the contrast media molecules from effects caused by hyperosmolality, we used as controls hyperosmolar mannitol solutions with the same osmolality as iomeprol-300 and ioxithalamate.

Both mannitol solutions showed cytotoxic effects whereby the high-osmolar mannitol solution exerted more pronounced effects than did the low-osmolar solution. Since the mannitol solutions had significantly fewer toxic effects than did the corresponding contrast media, however, the cytotoxic effects of contrast media cannot solely be caused by their hyperosmolality. Furthermore, at a concentration of 98.5 mmol/L, iomeprol-300 showed a slightly stronger effect on the MTT assay than did the iso-osmolar compound iomeprol-150. At this concentration, the mannitol-520 solution induced only a slight inhibition of MTT conversion. Thus, only the small difference between iomeprol-150 and iomeprol-300 is probably caused by the hyperosmolality of iomeprol-300. Our results confirm findings in previous in vitro studies, which have shown that hyperosmolality of contrast media cannot fully explain their cytotoxic effects (18,20,21,2325) or other contrast-induced side effects (2629).

Hyperosmolality cannot be the only reason for contrast-induced cytotoxic effects, since in our study the iso-osmolar contrast media also showed cytotoxic effects. When the dimeric iso-osmolar contrast media iodixanol and iotrolan were compared with the monomeric low-osmolar contrast media iomeprol and ioversol at equal iodine concentrations, no significant difference in cytotoxic effects was observed. This finding is in agreement with results in previous studies of renal tubular cell cultures. No significant difference between iohexol and iodixanol was found on the renal epithelial Madin Darby canine kidney (or MDCK) cell line monolayers with regard to cell viability, transmonolayer resistance, and inulin permeability (19). In human renal proximal tubular epithelial (or HRPTE) cells, iomeprol, iopamidol, and iodixanol decreased MTT reduction at 51.4%, 51.9%, and 52.8%, respectively (20). In contrast, iotrolan induced a somewhat more pronounced cell injury than did iohexol, iomeprol, and iopamidol, when they were assessed by using the 2-(2-methoxy-4-nitrophenyl)-3-(4-nitrophenyl)-5-(2, 4-disulfophenyl)-2H-tetrazolium, monosodium salt (or WST-8) assay in LLC-PK1 cells (21). Also in the study of Hardiek et al (20), the dimer iodixanol produced a stronger inhibition of MTT conversion than did iomeprol and iopamidol in LLC-PK1 cells at 31%, 52%, and 39% of the undamaged control cells, respectively.

At equal molarity, the dimeric contrast media iotrolan and iodixanol showed a significantly stronger reduction of MTT conversion than did the monomeric contrast media iomeprol-300 and ioversol. To compare the effects of the monomeric and dimeric contrast media molecules, the different osmolalities must be taken into account when compounds with the same iodine concentrations are used. For this reason, we performed experiments with the iso-osmolar compound iomeprol-150, which contains 150 mg of iodine per milliliter. Identical volumes of iomeprol-150 and of the dimeric contrast media contain the same number of contrast media molecules and have almost the same osmolality. Also, with these conditions, the dimeric contrast media showed a significantly more pronounced cytotoxic effect in comparison with that of iomeprol. Therefore, the difference in toxic effects in tubular cells must be attributed to the contrast medium molecule itself or to additives in the contrast medium, because differences in osmolality were excluded in our experiments. Investigators in previous studies (16,20), however, showed that the additives trometamol and edetate calcium disodium did not play a substantial role in the cytotoxic effects of contrast media.

To examine the toxic properties of contrast media in renal tubular cells in vitro, the dilution of the tissue culture media with the use of ready-to-use formulations must be considered. At a concentration of 75 mg of iodine per milliliter, 25% of the culture medium was replaced by contrast media. This replacement could be responsible for toxic effects. The dilution of the growth media by the same volume of isotonic NaCl solution, however, showed a reduction of MTT levels only at 89% ± 1.66. In addition, researchers in earlier studies have shown that the dilution of the growth medium does not explain the contrast-induced cytotoxic effects in cell culture experiments at the concentrations used (23,24).

In our study, LLC-PK1 cells, which are from a proximal tubular epithelial cell line of porcine origin, were used to determine the toxic effects of contrast media on renal tubular cells. LLC-PK1 cells are a well-characterized renal epithelial model system for the investigation of cytotoxic effects of various substances (30,31). Cytotoxic effects of ontrast media also have been investigated in LLC-PK1 cells in previous studies (16,18,20,21). Results in a study of Hardiek et al (20) indicated that human renal proximal tubular cells (HRPTE) respond to contrast media in a manner similar to the way that LLC-PK1 cells respond. Thus, LLC-PK1 cells seem to be a suitable model system for the investigation of cytotoxic effects of contrast media on renal tubular cells.

The contrast media concentrations and incubation times used in our study were chosen carefully with regard to the clinical situation. Contrast media doses administered clinically (even during angiography of the abdominal aorta or the renal arteries) result in plasma concentrations of approximately 10 mg of iodine per milliliter and usually do not exceed 20 mg of iodine per milliliter (14,20). Because contrast media are concentrated in the renal proximal tubules as a result of reabsorption of water, the concentration of contrast media in the renal tubules is much higher than it is in plasma (32). After intravascular administration of contrast media in rabbits, urinary concentrations higher than 100 mg of iodine per milliliter have been measured (33). We compared different contrast media at concentrations of 37.5 and 75 mg of iodine per milliliter. These concentrations are in the range of those that have been used in previous cell culture studies (16,1821,23,24). In some studies, concentrations of as much as 100–150 mg of iodine per milliliter were used (20,21,23).

In healthy volunteers, contrast media were rapidly excreted almost exclusively by means of renal glomerular filtration (34). The elimination half-life increases progressively, however, with increasing renal impairment (35). In patients with chronic renal failure, the elimination half-life of iopamidol was about 70 hours (36). Furthermore, in patients with contrast-induced nephropathy, a persistent nephrogram after more than 24 hours is a common finding (37). We demonstrated time-dependent cell injury induced by contrast media at incubation times between 1 and 24 hours. The contrast media were compared after an incubation time of 24 hours, which also has been used in several studies on renal tubular cells before (20,38,39). In one study, an incubation time of as much as 3 days was used (25). Therefore, with regard to the high urinary contrast medium concentration and the prolonged exposure of the tubular cells to the contrast medium in patients with renal insufficiency, the concentrations and incubation times used in our study were in the range of those that can occur in clinical situations.

For investigation of contrast-induced cell injury, we used the MTT assay. MTT is a yellow tetrazolium salt that is converted into a blue formazan product by mitochondrial dehydrogenases when it is incubated with living cells. With the assay, detection of very small numbers of living cells is allowed, and the amount of formazan generated is directly proportional to the number of living cells. Only living cells with active mitochondria cleave MTT, in which the amount of formazan generated depends on the level of energy metabolism in the cell (15). Therefore, this assay is an indicator for cell viability, proliferation, and metabolic activity. The MTT assay is a well-established method for assessment of cytotoxic effects of various substances in cell cultures (30,40) and also has been used before to investigate cytotoxic effects of contrast media in some studies (17,20,25). The molecular mechanisms by which contrast media induce direct cytotoxic effects on renal cells are poorly understood. Findings in some studies have suggested that oxidative stress is involved in contrast-induced renal damage (4144). Researchers in another recent in vitro study, however, have shown toxic effects of contrast media to be dissociated from tubular cell oxidant stress (25). There are also conflicting results with regard to contrast-induced apoptosis in renal tubular cells. Researchers in some studies demonstrated apoptosis in renal tubular cell cultures (21,24,39), whereas investigators in another study found no evidence of contrast-induced apoptosis (20).

Whether dimeric contrast media have fewer nephrotoxic effects than do monomeric contrast media in vivo is a matter of debate. Findings in a clinical study suggested that contrast-induced nephropathy is less likely to develop in high-risk patients when iodixanol is used rather than when low-osmolar nonionic contrast media are used (9). Results in that study are arguably controversial for the following reasons: the small number of patients who developed acute renal failure; the significant differences in proteinuria, in the duration of diabetes, and in the use of angiotensin-converting enzyme inhibitors in the iohexol group compared with the iodixanol group; and the lack of standardized vigorous hydration of the patients (10). Moreover, in another clinical study, Baker et al (45) showed a markedly higher incidence of contrast-induced nephropathy after administration of iodixanol, as compared with the findings in the study of Aspelin et al (9). Furthermore, in a recent clinical trial, no significant differences in the renal effects of iopamidol 370 and iodixanol 320 were observed (11). Katayama et al (46) reported a similar renal tolerability of iodixanol and iomeprol after intraarterial injection. Further studies are required to investigate the effect of dimeric contrast media in comparison with that of monomeric contrast media on renal function in vivo.

Some limitations of our study have to be considered. As in all in vitro experiments, in our study an artificial model system was used to compare the cytotoxic effects of the contrast media. This design does not consider the complex, multifactorial pathogenesis of contrast-induced nephropathy in vivo. In vitro experiments with cultured renal cells, however, are an established method to examine the cytotoxic effects of drugs, especially contrast media, without confounding variables, which can be found in vivo, such as hypoxia caused by hemodynamic changes or other systemic mechanisms (14). Furthermore, the MTT assay used in our study is an indicator for cell viability, proliferation, and metabolic activity. The inhibition of MTT conversion by contrast media observed in our study could be explained not only by a reduced number of viable cells but also by reduced mitochondrial activity. Researchers in two studies have shown indications for contrast-induced mitochondrial dysfunction. Hardiek et al (20) demonstrated an increase in mitochondrial membrane potential by contrast media, and they suggested that a consecutive decrease in dehydrogenase activity could potentially explain the inhibition of MTT conversion by contrast media. Investigators in another study (25) found evidence for contrast-induced mitochondrial damage because of cytochrome c loss into the cell supernatant solution. They suggested that there may be a link between the observed contrast-induced plasma membrane damage and mitochondrial injury (25). The mechanisms by which contrast media exert their cytotoxic effects, however, remain uncertain.

In conclusion, in our study, we demonstrated that, although hyperosmolality contributes to the cytotoxic effects of hyperosmolar contrast media in renal proximal tubular cells, hyperosmolality plays only a minor role in the case of low-osmolar contrast media. Direct cytotoxic effects of the contrast media molecules seem to be the most important factor in the case of low-osmolar and iso-osmolar contrast media. The iso-osmolar dimeric contrast media showed strong cytotoxic effects, which were significantly (P < .001) more pronounced when they were compared with those of the low-osmolar monomeric contrast media at equimolar concentrations. This finding suggests a greater potential for nephrotoxic effects of the dimeric contrast media molecules when they are compared with the monomeric contrast media molecules.

Practical application: The design of our experiments, especially the use of iso-osmolar formulations of monomeric contrast media, allows comparison between the biologic activity of the molecules of different types of contrast media, with exclusion of the physicochemical properties of the solutions, such as osmolality. This may offer a further approach to study which molecular mechanisms cause contrast-induced nephropathy. For clinical practice, the fact that dimeric contrast media molecules are more toxic than monomeric nonionic contrast media molecules in vitro means that one should exercise caution when one is advising radiologists about a preference for use of dimeric contrast media in at-risk patients on the basis of findings in available studies. It seems possible that the different levels of biologic activity of the molecules are especially important in subgroups of patients with certain comorbidities or in whom certain medications are used concomitantly with contrast media and that these patients have been unequally distributed in the few studies with small numbers of these patients so far.


    FOOTNOTES
 
Abbreviation: MTT = 3-(4,5-dimethyl-2-thiazolyl)-2,5-diphenyl-2H-tetrazolium bromide

Authors stated no financial relationship to disclose.

See also the editorial by Katzberg in this issue.

Author contributions: Guarantors of integrity of entire study, M.C.H., M.U.; study concepts and design, all authors; literature research, M.C.H.; experimental studies, M.C.H.; data acquisition, M.C.H.; data analysis/interpretation, all authors; statistical analysis, M.C.H., M.U.; manuscript preparation and editing, M.C.H., M.U.; manuscript definition of intellectual content, revision/review, and final version approval, all authors


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 

  1. Rudnick MR, Goldfarb S, Wexler L, et al. Nephrotoxicity of ionic and nonionic contrast media in 1196 patients: a randomized trial. The Iohexol Cooperative Study. Kidney Int 1995; 47:254-261.
  2. Morcos SK, Thomsen HS, Webb JA. Contrast-media-induced nephrotoxicity: a consensus report. Contrast Media Safety Committee, European Society of Urogenital Radiology (ESUR). Eur Radiol 1999; 9:1602-1613.
  3. Rihal CS, Textor SC, Grill DE, et al. Incidence and prognostic importance of acute renal failure after percutaneous coronary intervention. Circulation 2002; 105:2259-2264.[Abstract/Free Full Text]
  4. Gruberg L, Mintz GS, Mehran R, et al. The prognostic implications of further renal function deterioration within 48 h of interventional coronary procedures in patients with pre-existent chronic renal insufficiency. J Am Coll Cardiol 2000; 36:1542-1548.[Abstract/Free Full Text]
  5. Freeman RV, O’Donnell M, Share D, et al. Nephropathy requiring dialysis after percutaneous coronary intervention and the critical role of an adjusted contrast dose. Am J Cardiol 2002; 90:1068-1073.[CrossRef][Medline]
  6. Morcos SK. Contrast media-induced nephrotoxicity: questions and answers. Br J Radiol 1998; 71:357-365.[Abstract]
  7. Ide JM, Lancelot E, Pines E, Corot C. Prophylaxis of iodinated contrast media-induced nephropathy: a pharmacological point of view. Invest Radiol 2004; 39:155-170.[CrossRef][Medline]
  8. Barrett BJ, Carlisle EJ. Metaanalysis of the relative nephrotoxicity of high- and low-osmolality iodinated contrast media. Radiology 1993; 188:171-178.[Abstract/Free Full Text]
  9. Aspelin P, Aubry P, Fransson SG, Strasser R, Willenbrock R, Berg KJ. Nephrotoxic effects in high-risk patients undergoing angiography. N Engl J Med 2003; 348:491-499.[Abstract/Free Full Text]
  10. Gruber SJ, Shapiro CJ. Nephropathy induced by contrast medium (letter). N Engl J Med 2003; 348:2257.[Free Full Text]
  11. Hardiek K, Katholi R, Ogden C, Pianfetti L. Double blind, randomized, comparison of iopamidol 370 and iodixanol 320: renal response in diabetic subjects (abstr) In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America, 2003; 541.
  12. Talner LB, Davidson AJ. Effect of contrast media on renal extraction of PAH. Invest Radiol 1968; 3:301-309.[CrossRef][Medline]
  13. Humes HD, Hunt DA, White MD. Direct toxic effect of the radiocontrast agent diatrizoate on renal proximal tubule cells. Am J Physiol 1987; 252(2 pt 2):F246-F255.
  14. Haller C, Hizoh I. The cytotoxicity of iodinated radiocontrast agents on renal cells in vitro. Invest Radiol 2004; 39:149-154.[CrossRef][Medline]
  15. Mosmann T. Rapid colorimetric assay for cellular growth and survival: application to proliferation and cytotoxicity assays. J Immunol Methods 1983; 65:55-63.[CrossRef][Medline]
  16. Andersen KJ, Christensen EI, Vik H. Effects of iodinated x-ray contrast media on renal epithelial cells in culture. Invest Radiol 1994; 29:955-962.[CrossRef][Medline]
  17. Dascalu A, Peer A. Effects of radiologic contrast media on human endothelial and kidney cell lines: intracellular pH and cytotoxicity. Acad Radiol 1994; 1:145-150.[CrossRef][Medline]
  18. Haller C, Schick CS, Zorn M, Kubler W. Cytotoxicity of radiocontrast agents on polarized renal epithelial cell monolayers. Cardiovasc Res 1997; 33:655-665.[Abstract/Free Full Text]
  19. Schick CS, Haller C. Comparative cytotoxicity of ionic and non-ionic radiocontrast agents on MDCK cell monolayers in vitro. Nephrol Dial Transplant 1999; 14:342-347.[Abstract/Free Full Text]
  20. Hardiek K, Katholi RE, Ramkumar V, Deitrick C. Proximal tubule cell response to radiographic contrast media. Am J Physiol Renal Physiol 2001; 280:F61-F70.[Abstract/Free Full Text]
  21. Yano T, Itoh Y, Sendo T, Kubota T, Oishi R. Cyclic AMP reverses radiocontrast media-induced apoptosis in LLC-PK1 cells by activating A kinase/PI3 kinase. Kidney Int 2003; 64:2052-2063.[CrossRef][Medline]
  22. Donadio C, Lucchesi A, Tramonti G, et al. Glomerular and tubular effects of contrast media diatrizoate and iopromide. Ren Fail 1996; 18:657-666.[Medline]
  23. Hizoh I, Strater J, Schick CS, Kubler W, Haller C. Radiocontrast-induced DNA fragmentation of renal tubular cells in vitro: role of hypertonicity. Nephrol Dial Transplant 1998; 13:911-918.[Abstract/Free Full Text]
  24. Hizoh I, Haller C. Radiocontrast-induced renal tubular cell apoptosis: hypertonic versus oxidative stress. Invest Radiol 2002; 37:428-434.[CrossRef][Medline]
  25. Zager RA, Johnson AC, Hanson SY. Radiographic contrast media-induced tubular injury: evaluation of oxidant stress and plasma membrane integrity. Kidney Int 2003; 64:128-139.[CrossRef][Medline]
  26. Uder M, Utz J, Pahl MB, Schneider G, Kramann B, Trautwein W. Iodinated radiographic contrast media inhibit the capacitative calcium entry into smooth muscle cells of the swine renal artery. Invest Radiol 2001; 36:734-742.[CrossRef][Medline]
  27. Uder M, Heinrich M, Jansen A, et al. cAMP and cGMP do not mediate the vasorelaxation induced by iodinated radiographic contrast media in isolated swine renal arteries. Acta Radiol 2002; 43:104-110.[CrossRef][Medline]
  28. Uder M, Humke U, Pahl M, Jansen A, Utz J, Kramann B. Nonionic contrast media iohexol and iomeprol decrease renal arterial tone: comparative studies on human and porcine isolated vascular segments. Invest Radiol 2002; 37:440-447.[CrossRef][Medline]
  29. Heinrich M, Schneider G, Grgic A, Humke U, Kramann B, Uder M. Effects of dimeric radiographic contrast medium iotrolan on swine renal arteries: comparison with monomeric contrast media iohexol and iomeprol. Invest Radiol 2004; 39:406-412.[CrossRef][Medline]
  30. Ahlenstiel T, Burkhardt G, Kohler H, Kuhlmann MK. Bioflavonoids attenuate renal proximal tubular cell injury during cold preservation in Euro-Collins and University of Wisconsin solutions. Kidney Int 2003; 63:554-563.[CrossRef][Medline]
  31. Thamilselvan S, Khan SR, Menon M. Oxalate and calcium oxalate mediated free radical toxicity in renal epithelial cells: effect of antioxidants. Urol Res 2003; 31:3-9.[Medline]
  32. Ueda J, Nygren A, Sjoquist M, Jacobsson E, Ulfendahl HR, Araki Y. Iodine concentrations in the rat kidney measured by x-ray microanalysis: comparison of concentrations and viscosities in the proximal tubules and renal pelvis after intravenous injections of contrast media. Acta Radiol 1998; 39:90-95.[Medline]
  33. Spataro RF, Fischer HW, Boylan L. Urography with low-osmolality contrast media: comparative urinary excretion of iopamidol, Hexabrix, and diatrizoate. Invest Radiol 1982; 17:494-500.[CrossRef][Medline]
  34. Rosati G. Clinical pharmacology of iomeprol. Eur J Radiol 1994; 18(suppl 1):S51-S60.
  35. Lorusso V, Taroni P, Alvino S, Spinazzi A. Pharmacokinetics and safety of iomeprol in healthy volunteers and in patients with renal impairment or end-stage renal disease requiring hemodialysis. Invest Radiol 2001; 36:309-316.[CrossRef][Medline]
  36. Donnelly PK, Burwell N, McBurney A, Ward JW, Walls J, Watkin EM. Hemodialysis and iopamidol clearance after subclavian venography. Invest Radiol 1993; 28:629-632.[CrossRef][Medline]
  37. Love L, Johnson MS, Bresler ME, Nelson JE, Olson MC, Flisak ME. The persistent computed tomography nephrogram: its significance in the diagnosis of contrast-associated nephrotoxicity. Br J Radiol 1994; 67:951-957.[Abstract]
  38. Andersen KJ, Vik H, Eikesdal HP, Christensen EI. Effects of contrast media on renal epithelial cells in culture. Acta Radiol Suppl 1995; 399:213-218.[Medline]
  39. Peer A, Averbukh Z, Berman S, Modai D, Averbukh M, Weissgarten J. Contrast media augmented apoptosis of cultured renal mesangial, tubular, epithelial, endothelial, and hepatic cells. Invest Radiol 2003; 38:177-182.[CrossRef][Medline]
  40. Zhang W, Torabinejad M, Li Y. Evaluation of cytotoxicity of MTAD using the MTT-tetrazolium method. J Endod 2003; 29:654-657.[Medline]
  41. Bakris GL, Lass N, Gaber AO, Jones JD, Burnett JC, Jr. Radiocontrast medium-induced declines in renal function: a role for oxygen free radicals. Am J Physiol 1990; 258(1 pt 2):F115-F120.
  42. Yoshioka T, Fogo A, Beckman JK. Reduced activity of antioxidant enzymes underlies contrast media-induced renal injury in volume depletion. Kidney Int 1992; 41:1008-1015.[Medline]
  43. Katholi RE, Woods WT, Jr, Taylor GJ, et al. Oxygen free radicals and contrast nephropathy. Am J Kidney Dis 1998; 32:64-71.[Medline]
  44. Wasaki M, Sugimoto J, Shirota K. Glucose alters the susceptibility of mesangial cells to contrast media. Invest Radiol 2001; 36:355-362.[CrossRef][Medline]
  45. Baker CS, Wragg A, Kumar S, De Palma R, Baker LR, Knight CJ. A rapid protocol for the prevention of contrast-induced renal dysfunction: the RAPPID study. J Am Coll Cardiol 2003; 41:2114-2118.[Abstract/Free Full Text]
  46. Katayama H, Spinazzi A, Fouillet X, Kirchin MA, Taroni P, Davies A. Iomeprol: current and future profile of a radiocontrast agent. Invest Radiol 2001; 36:87-96.[CrossRef][Medline]



This article has been cited by other articles:


Home page
RadiologyHome page
S. A. Nguyen, P. Suranyi, J. G. Ravenel, P. K. Randall, P. B. Romano, K. A. Strom, P. Costello, and U. J. Schoepf
Iso-Osmolality versus Low-Osmolality Iodinated Contrast Medium at Intravenous Contrast-enhanced CT: Effect on Kidney Function
Radiology, July 1, 2008; 248(1): 97 - 105.
[Abstract] [Full Text] [PDF]


Home page
Eur Heart JHome page
G. Romano, C. Briguori, C. Quintavalle, C. Zanca, N. V. Rivera, A. Colombo, and G. Condorelli
Contrast agents and renal cell apoptosis
Eur. Heart J., May 8, 2008; (2008) ehn197v1.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
B. Elmstahl, U. Nyman, P. Leander, K. Golman, C.-M. Chai, D. Grant, R. Doughty, R. Pehrson, J. Bjork, and T. Almen
Iodixanol 320 Results in Better Renal Tolerance and Radiodensity than Do Gadolinium-based Contrast Media: Arteriography in Ischemic Porcine Kidneys
Radiology, April 1, 2008; 247(1): 88 - 97.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Soc. Nephrol.Home page
E. Seeliger, B. Flemming, T. Wronski, M. Ladwig, K. Arakelyan, M. Godes, M. Mockel, and P. B. Persson
Viscosity of Contrast Media Perturbs Renal Hemodynamics
J. Am. Soc. Nephrol., November 1, 2007; 18(11): 2912 - 2920.
[Abstract] [Full Text] [PDF]


Home page
Br J AnaesthHome page
G. T. C. Wong and M. G. Irwin
Contrast-induced nephropathy
Br. J. Anaesth., October 1, 2007; 99(4): 474 - 483.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
M. C. Heinrich, M. K. Kuhlmann, S. Kohlbacher, M. Scheer, A. Grgic, M. B. Heckmann, and M. Uder
Cytotoxicity of Iodinated and Gadolinium-based Contrast Agents in Renal Tubular Cells at Angiographic Concentrations: In Vitro Study
Radiology, December 19, 2006; (2006) 2422060245.
[Abstract] [Full Text]


Home page
RadiologyHome page
M. O. Downes, M. Heinrich, and M. Uder
In vitro study of various iodinated contrast media.
Radiology, June 1, 2006; 239(3): 918 - 921.
[Full Text] [PDF]


Home page
Am. J. Physiol. Renal Physiol.Home page
H. T. Lee, M. Jan, S. C. Bae, J. D. Joo, F. R. Goubaeva, J. Yang, and M. Kim
A1 adenosine receptor knockout mice are protected against acute radiocontrast nephropathy in vivo
Am J Physiol Renal Physiol, June 1, 2006; 290(6): F1367 - F1375.
[Abstract] [Full Text] [PDF]


Home page
CirculationHome page
M. Tepel, P. Aspelin, and N. Lameire
Contrast-Induced Nephropathy: A Clinical and Evidence-Based Approach
Circulation, April 11, 2006; 113(14): 1799 - 1806.
[Full Text] [PDF]


Home page
RadiologyHome page
T. Skotland, D. Grant, M. Heinrich, and M. Uder
In Vitro Cytotoxic Effects of Iodinated Contrast Media on a Renal Tubular Cell Line
Radiology, February 1, 2006; 238(2): 758 - 760.
[Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
M. Heinrich, M. Uder, and T. Gleeson
Pathogenesis of Contrast-Induced Nephropathy
Am. J. Roentgenol., October 1, 2005; 185(4): 1079 - 1079.
[Full Text] [PDF]


Home page
RadiologyHome page
R. W. Katzberg
Contrast Medium-induced Nephrotoxicity: Which Pathway?
Radiology, June 1, 2005; 235(3): 752 - 755.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
2353040726v1
235/3/843    most recent
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar