Concept placement using BERT trained by transforming and summarizing biomedical ontology structure

Research output: Contribution to journalArticlepeer-review

Abstract

The comprehensive modeling and hierarchical positioning of a new concept in an ontology heavily relies on its set of proper subsumption relationships (IS-As) to other concepts. Identifying a concept's IS-A relationships is a laborious task requiring curators to have both domain knowledge and terminology skills. In this work, we propose a method to automatically predict the presence of IS-A relationships between a new concept and pre-existing concepts based on the language representation model BERT. This method converts the neighborhood network of a concept into “sentences” and harnesses BERT's Next Sentence Prediction (NSP) capability of predicting the adjacency of two sentences. To augment our method's performance, we refined the training data by employing an ontology summarization technique. We trained our model with the two largest hierarchies of the SNOMED CT 2017 July release and applied it to predicting the parents of new concepts added in the SNOMED CT 2018 January release. The results showed that our method achieved an average F1 score of 0.88, and the average Recall score improves slightly from 0.94 to 0.96 by using the ontology summarization technique.

Original languageEnglish (US)
Article number103607
JournalJournal of Biomedical Informatics
Volume112
DOIs
StatePublished - Dec 2020

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Health Informatics

Keywords

  • BERT
  • Machine learning
  • Natural language processing
  • Ontology placement
  • Ontology summarization
  • SNOMED CT

Fingerprint

Dive into the research topics of 'Concept placement using BERT trained by transforming and summarizing biomedical ontology structure'. Together they form a unique fingerprint.

Cite this