Murdoch University Research Repository

Welcome to the Murdoch University Research Repository

The Murdoch University Research Repository is an open access digital collection of research
created by Murdoch University staff, researchers and postgraduate students.

Learn more

Automatic concept recognition using the Human Phenotype Ontology reference and test suite corpora

Groza, T., Kohler, S., Doelken, S., Collier, N., Oellrich, A., Smedley, D., Couto, F.M., Baynam, G., Zankl, A. and Robinson, P.N. (2015) Automatic concept recognition using the Human Phenotype Ontology reference and test suite corpora. Database, 2015 . pp. 1-13.

PDF - Published Version
Download (886kB)
Free to read:
*No subscription required


Concept recognition tools rely on the availability of textual corpora to assess their performance and enable the identification of areas for improvement. Typically, corpora are developed for specific purposes, such as gene name recognition. Gene and protein name identification are longstanding goals of biomedical text mining, and therefore a number of different corpora exist. However, phenotypes only recently became an entity of interest for specialized concept recognition systems, and hardly any annotated text is available for performance testing and training. Here, we present a unique corpus, capturing text spans from 228 abstracts manually annotated with Human Phenotype Ontology (HPO) concepts and harmonized by three curators, which can be used as a reference standard for free text annotation of human phenotypes. Furthermore, we developed a test suite for standardized concept recognition error analysis, incorporating 32 different types of test cases corresponding to 2164 HPO concepts. Finally, three established phenotype concept recognizers (NCBO Annotator, OBO Annotator and Bio-LarK CR) were comprehensively evaluated, and results are reported against both the text corpus and the test suites. The gold standard and test suites corpora are available from

Item Type: Journal Article
Murdoch Affiliation(s): Institute for Immunology and Infectious Diseases
Publisher: Oxford University Press
Copyright: © 2015 The Author(s)
Item Control Page Item Control Page


Downloads per month over past year