Evaluation of response quality for heterogeneous question answering systems
Wong, W., Sahib, S. and Goh, O.S. (2005) Evaluation of response quality for heterogeneous question answering systems. In: IEEE/WIC/ACM International Conference on Web Intelligence, WI 2005, 19 - 22 September, Compiegne Cedex, France pp. 610-613.
*Subscription may be required
The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems.
|Publication Type:||Conference Paper|
|Murdoch Affiliation:||School of Information Technology|
|Item Control Page|
Downloads per month over past year