Hierarchical Particle Swarm Optimization-incorporated Latent Factor Analysis for Large-Scale Incomplete Matrices

Jia Chen, Xin Luo, Mengchu Zhou

Research output: Contribution to journalArticlepeer-review

Abstract

A Stochastic Gradient Descent (SGD)-based Latent Factor Analysis (LFA) model is highly efficient in representative learning on a High-Dimensional and Sparse (HiDS) matrix, where the learning rate adaptation is vital in its efficiency and practicability. The learning rate adaptation of an SGD-based LFA model can be achieved efficiently by learning rate evolution with an evolutionary computing algorithm. However, a resultant model commonly suffers from twofold premature convergence issues, i.e., a) the premature convergence of the learning rate swarm relying on an evolution algorithm, and b) the premature convergence of an LFA model relying on the compound effects of evolution-based learning rate adaptation and adopted optimization algorithm. Aiming at addressed such issues, this work proposes an Hierarchical Particle swarm optimization-incorporated Latent factor analysis (HPL) model with a two-layered structure. The first layer pre-trains desired latent factors with a position-transitional particle swarm optimization-based LFA model with learning rate adaptation; while the second layer performs latent factor refinement with a newly-proposed mini-batch particle swarm optimization algorithm. Experimental results on four HiDS matrices generated by industrial applications demonstrate that an HPL model can well handle the mentioned premature convergence issues, thereby achieving highly-accurate representation to HiDS matrices.

Original languageEnglish (US)
JournalIEEE Transactions on Big Data
DOIs
StateAccepted/In press - 2021

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Information Systems and Management

Keywords

  • Adaptation models
  • Big Data
  • Big Data
  • Computational modeling
  • Convergence
  • High-dimensional and Sparse Matrix
  • Industrial Application
  • Large-Scale Incomplete Data
  • Latent Factor Analysis
  • Missing Data Estimation
  • Optimization
  • Particle Swarm Optimization
  • Particle swarm optimization
  • Sparse matrices

Fingerprint

Dive into the research topics of 'Hierarchical Particle Swarm Optimization-incorporated Latent Factor Analysis for Large-Scale Incomplete Matrices'. Together they form a unique fingerprint.

Cite this