Generalized Nesterov's Acceleration-incorporated Non-negative and Adaptive Latent Factor Analysis

Xin Luo, Yue Zhou, Zhigang Liu, Lun Hu, Mengchu Zhou

Research output: Contribution to journalArticlepeer-review

Abstract

A non-negative latent factor (NLF) model with a single latent factor-dependent, non-negative and multiplicative update (SLF-NMU) algorithm is frequently adopted to extract useful knowledge from non-negative data represented by high-dimensional and sparse (HiDS) matrices arising from various service applications. However, its convergence rate is rather slow. To address this issue, this study proposes a Generalized Nesterov's acceleration-incorporated, Non-negative and Adaptive Latent Factor (GNALF) model. It results from a) incorporating a generalized Nesterov's accelerated gradient (NAG) method into an SLF-NMU algorithm, thereby achieving an NAG-incorporated and element-oriented non-negative (NEN) algorithm to perform efficient parameter update; and b) making its regularization and acceleration hyper-parameters self-adaptive via incorporating the principle of a particle swarm optimization algorithm into the training process, thereby implementing a highly adaptive and practical model. Empirical studies on six large sparse matrices from different recommendation service applications show that a GNALF model achieves very high convergence rate without the need of hyper-parameter tuning, making its computational efficiency significantly higher than state-of-the-art models. Meanwhile, such efficiency gain does not result in accuracy loss, since its prediction accuracy is comparable with its peers. Hence, it can better serve practical service applications with real-time demands.

Original languageEnglish (US)
JournalIEEE Transactions on Services Computing
DOIs
StateAccepted/In press - 2021

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications
  • Information Systems and Management

Keywords

  • Acceleration
  • Adaptation models
  • Big Data
  • Computational modeling
  • Convergence
  • Data models
  • Highdimensional and Sparse Matrix
  • Latent Factor Analysis
  • Missing Data
  • Non-negative Latent Factor Model
  • Recommender System
  • Service Application
  • Services Computing
  • Sparse matrices
  • Training

Fingerprint

Dive into the research topics of 'Generalized Nesterov's Acceleration-incorporated Non-negative and Adaptive Latent Factor Analysis'. Together they form a unique fingerprint.

Cite this