Can LLMs generate competency questions?

Rebboud, Youssra; Tailhardat, Lionel; Lisena, Pasquale; Troncy, Raphaël
ESWC 2024, Extended Semantic Web Conference, Special Track on Large Language Models for Knowledge Engineering, 26-30 May 2024, Hersonissos, Greece

Large Language Models have shown high performances in a large number of tasks, being recently applied also to support Knowledge Graphs construction. An important step for data modeling consists in the definition of a set of competency questions, which are often used as a guide for the development of an ontology and as a mean to evaluate the resulting schema. In this work, we investigate the suitability of LLMs for the automatic generation of competency questions given an existing ontology. We compare different large language models under various set-tings in order to give a comprehensive overview of what LLMs can do to support the knowledge engineer. 


HAL
Type:
Conférence
City:
Hersonissos
Date:
2024-05-26
Department:
Data Science
Eurecom Ref:
7699
Copyright:
© Springer. Personal use of this material is permitted. The definitive version of this paper was published in ESWC 2024, Extended Semantic Web Conference, Special Track on Large Language Models for Knowledge Engineering, 26-30 May 2024, Hersonissos, Greece and is available at :

PERMALINK : https://www.eurecom.fr/publication/7699