Concept placement using BERT trained by transforming and summarizing biomedical ontology structure

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


The comprehensive modeling and hierarchical positioning of a new concept in an ontology heavily relies on its set of proper subsumption relationships (IS-As) to other concepts. Identifying a concept's IS-A relationships is a laborious task requiring curators to have both domain knowledge and terminology skills. In this work, we propose a method to automatically predict the presence of IS-A relationships between a new concept and pre-existing concepts based on the language representation model BERT. This method converts the neighborhood network of a concept into “sentences” and harnesses BERT's Next Sentence Prediction (NSP) capability of predicting the adjacency of two sentences. To augment our method's performance, we refined the training data by employing an ontology summarization technique. We trained our model with the two largest hierarchies of the SNOMED CT 2017 July release and applied it to predicting the parents of new concepts added in the SNOMED CT 2018 January release. The results showed that our method achieved an average F1 score of 0.88, and the average Recall score improves slightly from 0.94 to 0.96 by using the ontology summarization technique.

Original languageEnglish (US)
Article number103607
JournalJournal of Biomedical Informatics
StatePublished - Dec 2020

All Science Journal Classification (ASJC) codes

  • Health Informatics
  • Computer Science Applications


  • BERT
  • Machine learning
  • Natural language processing
  • Ontology placement
  • Ontology summarization


Dive into the research topics of 'Concept placement using BERT trained by transforming and summarizing biomedical ontology structure'. Together they form a unique fingerprint.

Cite this