Radiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Published online before print June 27, 2005, 10.1148/radiol.2361040791
This Article
Right arrow Figures Only
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Appendix
Right arrow All Versions of this Article:
2361040791v1
236/1/102    most recent
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Stengel, D.
Right arrow Articles by Ekkernkamp, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Stengel, D.
Right arrow Articles by Ekkernkamp, A.
(Radiology 2005;236:102-111.)
© RSNA, 2005


Evidence-based Practice

Association between Compliance with Methodological Standards of Diagnostic Research and Reported Test Accuracy: Meta-Analysis of Focused Assessment of US for Trauma1

Dirk Stengel, MD, MSc, Kai Bauwens, MD, Grit Rademacher, MD, Sven Mutze, MD, PhD and Axel Ekkernkamp, MD, PhD

1 From the Clinical Epidemiology Division, Department of Orthopedic and Trauma Surgery (D.S., K.B., A.E.), and the Institute of Radiology (G.R., S.M.), Unfallkrankenhaus Berlin Trauma Center, Warener Str 7, 12683 Berlin, Germany. Received May 1, 2004; revision requested July 6; revision received July 9; accepted August 15. Address correspondence to D.S. (e-mail: dirk.stengel{at}ukb.de).

PURPOSE: To study whether compliance with methodological standards affected the reported accuracy of screening ultrasonography (US) for trauma.

MATERIALS AND METHODS: Meta-analysis was conducted of prospective investigations in which US was compared with any diagnostic reference test in patients with suspected abdominal injury. Reports were retrieved from electronic databases without language restrictions; added information was gained with manual search. Two reviewers independently assessed methodological rigor by using 27 items contained in the Standards for Reporting of Diagnostic Accuracy (STARD) checklist and the Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Reviews (QUADAS) instrument. Inconsistencies were resolved by means of consensus. Summary receiver operating characteristics and random-effects meta-regression were used to model the effect of methodological standards and other study features on US accuracy.

RESULTS: A total of 62 trials, which included a total of 18 167 participants, were eligible for meta-analysis. The average proportion of men or boys was 71.7%, the mean age was 30.6 years ± 10.8 (standard deviation), and the mean injury severity score was 16.7 ± 8.3. The prevalence of abdominal trauma was 25.1% (95% confidence interval [CI]: 21.1%, 29.1%). Pooled overall sensitivity and specificity of US were 78.9% (95% CI: 74.9%, 82.9%) and 99.2% (95% CI: 99.0%, 99.4%), respectively. Varying end points (hemoperitoneum or organ damage) did not change these results. US accuracy was much lower in children (sensitivity, 57.9%; specificity, 94.3%). Strong heterogeneity was observed in sensitivity, whereas specificity remained constant across trials. There was evidence of publication bias. Initial interobserver agreement with methodological standards ranged from poor ({kappa} = 0.03, independent verification of US findings) to perfect ({kappa} = 1.00, sufficiently short interval between US and reference test). By consensus, studies fulfilled a median of 13 methodological criteria (range, five to 20 criteria). In investigations that lacked individual methodological standards, researchers overestimated pooled sensitivity, with predicted differences of 9%–18%. The use of a single reference test, specification of the number of excluded patients, and calculation of CIs independently contributed to predicted sensitivity in a multivariate model. In 16 investigations (1309 subjects), a single reference test was used, which provided a combined sensitivity of 66.0% (95% CI: 56.2%, 75.8%).

CONCLUSION: Bias-adjusted sensitivity of screening US for trauma is low. Adherence to methodological standards included in appraisal instruments like STARD and QUADAS is crucial to obtain valid estimates of test accuracy.

Supplemental material: radiology.rsnajnls.org/cgi/content/full/2361040791/DC1

© RSNA, 2005




This article has been cited by other articles:


Home page
NeurologyHome page
N. Smidt, A.W.S. Rutjes, D. A.W.M. van der Windt, R. W.J.G. Ostelo, P. M. Bossuyt, J. B. Reitsma, L. M. Bouter, and H. C.W. de Vet
The quality of diagnostic accuracy studies since the STARD statement: has it improved?
Neurology, September 12, 2006; 67(5): 792 - 797.
[Abstract] [Full Text] [PDF]


Home page
radtechHome page
T. G. ODLE
Blunt Pelvic Trauma
Radiol. Technol., January 1, 2006; 77(3): 200 - 219.
[Abstract] [Full Text] [PDF]