Non-Negativity Constrained Missing Data Estimation for High-Dimensional and Sparse Matrices from Industrial Applications

Xin Luo, Mengchu Zhou, Shuai Li, Lun Hu, Mingsheng Shang

Research output: Contribution to journalArticlepeer-review

32 Scopus citations

Abstract

High-dimensional and sparse (HiDS) matrices are commonly seen in big-data-related industrial applications like recommender systems. Latent factor (LF) models have proven to be accurate and efficient in extracting hidden knowledge from them. However, they mostly fail to fulfill the non-negativity constraints that describe the non-negative nature of many industrial data. Moreover, existing models suffer from slow convergence rate. An alternating-direction-method of multipliers-based non-negative LF (AMNLF) model decomposes the task of non-negative LF analysis on an HiDS matrix into small subtasks, where each task is solved based on the latest solutions to the previously solved ones, thereby achieving fast convergence and high prediction accuracy for its missing data. This paper theoretically analyzes the characteristics of an AMNLF model, and presents detailed empirical studies regarding its performance on nine HiDS matrices from industrial applications currently in use. Therefore, its capability of addressing HiDS matrices is justified in both theory and practice.

Original languageEnglish (US)
Article number8654191
Pages (from-to)1844-1855
Number of pages12
JournalIEEE Transactions on Cybernetics
Volume50
Issue number5
DOIs
StatePublished - May 1 2020
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

Keywords

  • Alternating-direction-method of multipliers
  • high-dimensional and sparse matrix
  • industrial application
  • non-negative latent factor analysis
  • recommender system

Fingerprint Dive into the research topics of 'Non-Negativity Constrained Missing Data Estimation for High-Dimensional and Sparse Matrices from Industrial Applications'. Together they form a unique fingerprint.

Cite this