BEAUFORD: A Benchmark for Evaluation of Formalisation of Definitions in OWL

摘要: In this paper we present BEAUFORD, a benchmark for methods which aim to provide formal expressions of concepts using the natural language (NL) definition these concepts. Adding given ontology allows reasoners infer more useful pieces information or detect inconsistencies in ontology. To best our knowledge, BEAUFORD is first tackle enrichment problem. breaking down formalisation approach by identifying its key features. addition, provides strong mechanisms evaluate efficiently an even case ambiguity major challenge NL resources. Indeed, takes into account fact that phrase can be formalised many ways. Hence, it proposes suitable specification represent multiple formalisations. Taking advantage specification, redefines classical precision and recall introduces other metrics take there not only one unique way formalise definition. Finally, comprises well-suited dataset concretely judge efficiency formalisation. Using current approaches definitions compared accurately gold standard.