Catalog Home Page

Evaluation of response quality for heterogeneous question answering systems

Wong, W., Sahib, S. and Goh, O.S. (2005) Evaluation of response quality for heterogeneous question answering systems. In: IEEE/WIC/ACM International Conference on Web Intelligence, WI 2005, 19 - 22 September, Compiegne Cedex, France pp. 610-613.

[img]
Preview
PDF - Published Version
Download (97kB)
Link to Published Version: http://dx.doi.org/10.1109/WI.2005.61
*Subscription may be required

Abstract

The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems.

Publication Type: Conference Paper
Murdoch Affiliation: School of Information Technology
Publisher: IEEE
URI: http://researchrepository.murdoch.edu.au/id/eprint/14622
Item Control Page Item Control Page

Downloads

Downloads per month over past year