Discriminative Manifold Distribution Alignment for Domain Adaptation

Si Ya Yao, Qi Kang, Meng Chu Zhou, Muhyaddin J. Rawa, Aiiad Albeshri

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Domain adaptation (DA) aims to accomplish tasks on unlabeled target data by learning and transferring knowledge from related source domains. In order to learn a discriminative and domain-invariant model, a critical step is to align source and target data well and thus reduce their distribution divergence. But existing DA methods mainly align the global feature distributions in distorted original space, which neglects their fine-grained local information and intrinsic geometrical structures. Moreover, some methods rely heavily on pseudo-labels to align features, which may undermine adaptation performance and lead to negative transfer. We propose an efficient discriminative manifold distribution alignment (DMDA) approach, which improves feature transferability by aligning both global and local distributions and refines a discriminative model by learning geometrical structures in manifold space. In addition, when learning geometrical structures, DMDA is exempt from the uncertainty and error brought by pseudo-labels of a target domain. It is very concise and efficient to be implemented by integrating learning steps and obtaining solutions directly. Extensive experiments on 68 DA tasks from seven benchmarks and subsequent analyses show that DMDA outperforms the compared methods in both classification accuracy and time efficiency, thus representing a significant advance in the DA field.

Original languageEnglish (US)
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Systems, Man, and Cybernetics: Systems
DOIs
StateAccepted/In press - 2022
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

Keywords

  • Adaptation models
  • Data models
  • Distribution alignment
  • domain adaptation (DA)
  • Generative adversarial networks
  • image classification
  • manifold learning
  • Manifolds
  • Task analysis
  • Training
  • transfer learning (TL)
  • Uncertainty

Fingerprint

Dive into the research topics of 'Discriminative Manifold Distribution Alignment for Domain Adaptation'. Together they form a unique fingerprint.

Cite this