Abstract
High-dimensional and incomplete (HDI) matrices are primarily generated in all kinds of big-data-related practical applications. A latent factor analysis (LFA) model is capable of conducting efficient representation learning to an HDI matrix, whose hyper-parameter adaptation can be implemented through a particle swarm optimizer (PSO) to meet scalable requirements. However, conventional PSO is limited by its premature issues, which leads to the accuracy loss of a resultant LFA model. To address this thorny issue, this study merges the information of each particle's state migration into its evolution process following the principle of a generalized momentum method for improving its search ability, thereby building a state-migration particle swarm optimizer (SPSO), whose theoretical convergence is rigorously proved in this study. It is then incorporated into an LFA model for implementing efficient hyper-parameter adaptation without accuracy loss. Experiments on six HDI matrices indicate that an SPSO-incorporated LFA model outperforms state-of-the-art LFA models in terms of prediction accuracy for missing data of an HDI matrix with competitive computational efficiency. Hence, SPSO's use ensures efficient and reliable hyper-parameter adaptation in an LFA model, thus ensuring practicality and accurate representation learning for HDI matrices.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 2220-2235 |
| Number of pages | 16 |
| Journal | IEEE/CAA Journal of Automatica Sinica |
| Volume | 11 |
| Issue number | 11 |
| DOIs | |
| State | Published - 2024 |
All Science Journal Classification (ASJC) codes
- Control and Systems Engineering
- Information Systems
- Control and Optimization
- Artificial Intelligence
Keywords
- Data science
- generalized momentum
- high-dimensional and incomplete (HDI) data
- hyper-parameter adaptation
- latent factor analysis (LFA)
- particle swarm optimization (PSO)