Murdoch University Research Repository

Welcome to the Murdoch University Research Repository

The Murdoch University Research Repository is an open access digital collection of research
created by Murdoch University staff, researchers and postgraduate students.

Learn more

Evaluation of response quality for heterogeneous question answering systems

Wong, W., Sahib, S. and Goh, O.S. (2005) Evaluation of response quality for heterogeneous question answering systems. In: IEEE/WIC/ACM International Conference on Web Intelligence, WI 2005, 19 - 22 September, Compiegne Cedex, France pp. 610-613.

[img]
Preview
PDF - Published Version
Download (97kB)
Link to Published Version: http://dx.doi.org/10.1109/WI.2005.61
*Subscription may be required

Abstract

The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems.

Item Type: Conference Paper
Murdoch Affiliation: School of Information Technology
Publisher: IEEE
URI: http://researchrepository.murdoch.edu.au/id/eprint/14622
Item Control Page Item Control Page

Downloads

Downloads per month over past year