HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Figures Only Full Text All Versions of this Article: 2341040049v1 234/2/323    most recent Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Dreyer, K. J. Articles by Thrall, J. H. Search for Related Content PubMed PubMed Citation Articles by Dreyer, K. J. Articles by Thrall, J. H.

Application of Recently Developed Computer Algorithm for Automatic Classification of Unstructured Radiology Reports: Validation Study¹

¹ From the Division of Computing and Information Services, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 100 Charles River Plaza, Suite 471, Cambridge St, Boston, MA 02114. Received January 9, 2004; revision requested March 12; revision received April 6; accepted May 19. Address correspondence to K.J.D. (e-mail: kdreyer@partners.org).

PURPOSE: To validate the accuracy of Lexicon Mediated Entropy Reduction (LEXIMER), a new information theory–based computer algorithm developed by the authors for independent analysis and classification of unstructured radiology reports based on the presence of clinically important findings (F_T, where _T represents "true") and recommendations for subsequent action (R_T).

MATERIALS AND METHODS: The study was approved by the Human Research Committee of the institutional review board. Consecutive de-identified radiology reports (n = 1059) comprising results of barium studies (n = 99), computed tomography (n = 107), mammography (n = 90), magnetic resonance imaging (n = 108), nuclear medicine (n = 99), positron emission tomography (n = 106), radiography (n = 212), ultrasonography (n = 131), and vascular procedures (n = 107) were independently analyzed by two radiologists and then with LEXIMER to categorize the reports into F_T and F_T0 (containing or not containing clinically important findings) categories and R_T and R_T0 (containing or not containing recommendations for subsequent action) categories. Accuracy, sensitivity, specificity, and positive and negative predictive values of LEXIMER for placing reports into F_T and F_T0 and R_T and R_T0 categories were assessed by using appropriate statistical tests.

RESULTS: There was strong interobserver concordance between the two radiologists for placing radiology reports into F_T and R_T categories ( = 0.9, P < .01). For the LEXIMER program, accuracy, sensitivity, specificity, and positive and negative predictive values, respectively, were 97.5% (95% confidence interval [CI]: 96.6%, 98.5%), 98.9% (95% CI: 97.9%, 99.6%), 94.9% (95% CI: 93.1%, 96.0%), 97.5% (95% CI: 96.6%, 98.0%), and 97.7% (95% CI: 95.8%, 98.8%) for placing radiology reports into F_T and F_T0 categories and 99.6% (95% CI: 99.2%, 99.9%), 98.2% (95% CI: 95.0%, 99.6%), 99.9% (95% CI: 99.4%, 99.99%), 99.4% (95% CI: 96.3%, 99.9%), and 99.7% (95% CI: 98.9%, 99.9%) for placing reports into R_T and R_T0 categories.

CONCLUSION: LEXIMER is an accurate automated engine for evaluating the percentage positivity of clinically important findings and rates of recommendation for subsequent action in unstructured radiology reports.

© RSNA, 2004

This article has been cited by other articles:

				P. A. Dang, M. K. Kalra, M. A. Blake, T. J. Schultz, E. F. Halpern, and K. J. Dreyer Extraction of Recommendation Features in Radiology with Natural Language Processing: Exploratory Study Am. J. Roentgenol., August 1, 2008; 191(2): 313 - 320. [Abstract] [Full Text] [PDF]

				L. W. D'Avolio and A. A.T. Bui The Clinical Outcomes Assessment Toolkit: A Framework to Support Automated Clinical Records-based Outcomes Assessment and Performance Measurement Research J. Am. Med. Inform. Assoc., May 1, 2008; 15(3): 333 - 340. [Abstract] [Full Text] [PDF]

				L. W. D'Avolio, M. S. Litwin, S. O. Rogers Jr., and A. A.T. Bui Facilitating Clinical Outcomes Assessment through the Automated Identification of Quality Measures for Prostate Cancer Surgery J. Am. Med. Inform. Assoc., May 1, 2008; 15(3): 341 - 348. [Abstract] [Full Text] [PDF]

				G. P. Krestin, J. C. Miller, S. J. Golding, G. G. Frija, G. M. Glazer, H. G. Ringertz, and J. H. Thrall Reinventing Radiology in a Digital and Molecular Age: Summary of Proceedings of the Sixth Biannual Symposium of the International Society for Strategic Studies in Radiology (IS3R), August 25 27, 2005 Radiology, September 1, 2007; 244(3): 633 - 638. [Full Text] [PDF]

				J. H. Thrall Building Research Programs in Diagnostic Radiology * Part III. Clinical and Translational Research Radiology, April 1, 2007; 243(1): 5 - 9. [Full Text] [PDF]

				S. I. Lee, A. Saokar, K. J. Dreyer, J. B. Weilburg, J. H. Thrall, and P. F. Hahn Does Radiologist Recommendation for Follow-up with the Same Imaging Modality Contribute Substantially to High-Cost Imaging Volume? Radiology, March 1, 2007; 242(3): 857 - 864. [Abstract] [Full Text] [PDF]

				B. de Bruijn, A. Cranney, S. O'Donnell, J. D. Martin, and A. J. Forster Identifying Wrist Fracture Patients with High Accuracy by Automatic Categorization of X-ray Reports J. Am. Med. Inform. Assoc., November 1, 2006; 13(6): 696 - 698. [Abstract] [Full Text] [PDF]

				J. H. Thrall Reinventing Radiology in the Digital Age: Part II. New Directions and New Stakeholder Value Radiology, October 1, 2005; 237(1): 15 - 18. [Full Text] [PDF]