Tailoring Large Language Models to Radiology: A Preliminary Approach to LLM Adaptation for a Highly Specialized Domain

  • Zhengliang Liu
  • , Aoxiao Zhong
  • , Yiwei Li
  • , Longtao Yang
  • , Chao Ju
  • , Zihao Wu
  • , Chong Ma
  • , Peng Shu
  • , Cheng Chen
  • , Sekeun Kim
  • , Haixing Dai
  • , Lin Zhao
  • , Dajiang Zhu
  • , Jun Liu
  • , Wei Liu
  • , Dinggang Shen
  • , Quanzheng Li
  • , Tianming Liu
  • , Xiang Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this preliminary work, we present a domain fine-tuned LLM model for radiology, an experimental large language model adapted for radiology. This model, created through an exploratory application of instruction tuning on a comprehensive dataset of radiological information, demonstrates promising performance when compared with broader language models such as StableLM, Dolly, and LLaMA. This model exhibits initial versatility in applications related to radiological diagnosis, research, and communication. Our work contributes an early but encouraging step towards the evolution of clinical NLP by implementing a large language model that is local and domain-specific, conforming to stringent privacy norms like HIPAA. The hypothesis of creating customized, large-scale language models catering to distinct requirements of various medical specialties, presents a thought-provoking direction. The blending of conversational prowess and specific domain knowledge in these models kindles hope for future enhancements in healthcare AI. While it is still in its early stages, the potential of generative large language models is intriguing and worthy of further exploration. The demonstration code of our domain fine-tuned LLM model for radiology can be accessed at https://anonymous.4open.science/r/radiology-llm-demo-C3E2/.

Original languageEnglish (US)
Title of host publicationMachine Learning in Medical Imaging - 14th International Workshop, MLMI 2023, Held in Conjunction with MICCAI 2023, Proceedings
EditorsXiaohuan Cao, Xi Ouyang, Xuanang Xu, Islem Rekik, Zhiming Cui
PublisherSpringer Science and Business Media Deutschland GmbH
Pages464-473
Number of pages10
ISBN (Print)9783031456725
DOIs
StatePublished - 2024
Externally publishedYes
Event14th International Workshop on Machine Learning in Medical Imaging, MLMI 2023 - Vancouver, Canada
Duration: Oct 8 2023Oct 8 2023

Publication series

NameLecture Notes in Computer Science
Volume14348 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Workshop on Machine Learning in Medical Imaging, MLMI 2023
Country/TerritoryCanada
CityVancouver
Period10/8/2310/8/23

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Large Language Models
  • Natural Language Processing
  • Radiology

Fingerprint

Dive into the research topics of 'Tailoring Large Language Models to Radiology: A Preliminary Approach to LLM Adaptation for a Highly Specialized Domain'. Together they form a unique fingerprint.

Cite this