Universidad de Granada Digibug
 

Repositorio Institucional de la Universidad de Granada >
1.-Investigación >
Departamentos, Grupos de Investigación e Institutos >
Departamento de Traducción e Interpretación >
DTI - Artículos >

Please use this identifier to cite or link to this item: http://hdl.handle.net/10481/23990

Title: Question-answering systems as efficient source of terminological information: evaluation
Authors: Olvera Lobo, María Dolores
Gutiérrez-Artacho, Juncal
Issue Date: Dec-2010
Abstract: Background:  Question-answering systems (or QA Systems) stand as a new alternative for Information Retrieval Systems. Most users frequently need to retrieve specific information about a factual question to obtain a whole document. Objectives:  The study evaluates the efficiency of QA systems as terminological sources for physicians, specialised translators and users in general. It assesses the performance of one open-domain QA system, START, and one restricted-domain QA system, MedQA. Method:  The study collected two hundred definitional questions (What is…?), either general or specialised, from the health website WebMD. Sources used by the open-domain QA system, START, and the restricted-domain QA system, MedQA, were studied to retrieve answers, and later a range of evaluation measures (precision, Mean Reciprocal Rank, Total Reciprocal Rank, First Hit Success) were applied to mark the quality of answers. Results:  It was established that both systems are useful in the retrieval of valid definitional healthcare information, with an acceptable degree of coherent and precise responses from both. The answers supplied by MedQA were more reliable that those of START in the sense that they came from specialised clinical or academic sources, most of them showing links to further research articles. Conclusions:  Results obtained show the potential of this type of tool in the more general realm of information access, and the retrieval of health information. They may be considered a good, reliable and reasonably precise alternative in alleviating the information overload. Both QA systems can help professionals and users can obtain healthcare information.
Sponsorship: HUM 466. Acceso y evaluación de la información científica
Publisher: Health Libraries Group
Keywords: Decision support techniques
Evaluation studies as topic
Information storage and retrieval
Natural language processing
MedQA
START
URI: http://hdl.handle.net/10481/23990
ISSN: 1471-1842
1471-1834
Rights : Creative Commons Attribution-NonCommercial-NoDerivs 3.0 License
Citation: Olvera Lobo, M.D.; Gutiérrez-Artacho, J. Question-answering systems as efficient source of terminological information: evaluation. Health Information and Libraries Journal, 27(4): 268-276 (2010). [http://hdl.handle.net/10481/23990]
Appears in Collections:DTI - Artículos

Files in This Item:

File Description SizeFormat
Question_answering_systems.pdf606.97 kBAdobe PDFView/Open
Recommend this item

This item is licensed under a Creative Commons License
Creative Commons

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

 

Valid XHTML 1.0! OpenAire compliant DSpace Software Copyright © 2002-2007 MIT and Hewlett-Packard - Feedback

© Universidad de Granada