AugGPT: Leveraging ChatGPT for Text Data Augmentation

  • Haixing Dai
  • , Zhengliang Liu
  • , Wenxiong Liao
  • , Xiaoke Huang
  • , Yihan Cao
  • , Zihao Wu
  • , Lin Zhao
  • , Shaochen Xu
  • , Fang Zeng
  • , Wei Liu
  • , Ninghao Liu
  • , Sheng Li
  • , Dajiang Zhu
  • , Hongmin Cai
  • , Lichao Sun
  • , Quanzheng Li
  • , Dinggang Shen
  • , Tianming Liu
  • , Xiang Li

Research output: Contribution to journalArticlepeer-review

47 Scopus citations

Abstract

Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks. This challenge is especially prominent in the few-shot learning (FSL) scenario, where the data in the target domain is generally much scarcer and of lowered quality. A natural and widely used strategy to mitigate such challenges is to perform data augmentation to better capture data invariance and increase the sample size. However, current text data augmentation methods either can’t ensure the correct labeling of the generated data (lacking faithfulness), or can’t ensure sufficient diversity in the generated data (lacking compactness), or both. Inspired by the recent success of large language models (LLM), especially the development of ChatGPT, we propose a text data augmentation approach based on ChatGPT (named ”AugGPT”). AugGPT rephrases each sentence in the training samples into multiple conceptually similar but semantically different samples. The augmented samples can then be used in downstream model training. Experiment results on multiple few-shot learning text classification tasks show the superior performance of the proposed AugGPT approach over state-of-the-art text data augmentation methods in terms of testing accuracy and distribution of the augmented samples.

Original languageEnglish (US)
Pages (from-to)907-918
Number of pages12
JournalIEEE Transactions on Big Data
Volume11
Issue number3
DOIs
StatePublished - 2025
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Information Systems and Management

Keywords

  • Large language model
  • data augmentation
  • few-shot learning
  • natural language processing

Fingerprint

Dive into the research topics of 'AugGPT: Leveraging ChatGPT for Text Data Augmentation'. Together they form a unique fingerprint.

Cite this