Autoencoders are popular among neural-networkbasedmatrix completion models due to their ability to retrievepotential latent factors from the partially observed matrices.Nevertheless, when training data is scarce their performance issignificantly degraded due to overfitting. In this paper, we mitigateoverfitting with a data-dependent regularization techniquethat relies on the principles of multi-task learning. Specifically,we propose an autoencoder-based matrix completion model thatperforms prediction of the unknown matrix values as a maintask, and manifold learning as an auxiliary task. The latter actsas an inductive bias, leading to solutions that generalize better.The proposed model outperforms the existing autoencoder-basedmodels designed for matrix completion, achieving high reconstructionaccuracy in well-known datasets.
Nguyen, MD, Tsiligianni, E, Calderbank, R & Deligiannis, N 2018, Regularizing autoencoder-based matrix completion models via manifold learning. in 2018 26th European Signal Processing Conference, EUSIPCO 2018: EUSIPCO. vol. 2018-September, 8553528, pp. 1880-1884. https://doi.org/10.23919/EUSIPCO.2018.8553528
Nguyen, M. D., Tsiligianni, E., Calderbank, R., & Deligiannis, N. (2018). Regularizing autoencoder-based matrix completion models via manifold learning. In 2018 26th European Signal Processing Conference, EUSIPCO 2018: EUSIPCO (Vol. 2018-September, pp. 1880-1884). Article 8553528 https://doi.org/10.23919/EUSIPCO.2018.8553528
@inproceedings{d2bd18a17c3a46848a28b689de32ba90,
title = "Regularizing autoencoder-based matrix completion models via manifold learning",
abstract = "Autoencoders are popular among neural-networkbasedmatrix completion models due to their ability to retrievepotential latent factors from the partially observed matrices.Nevertheless, when training data is scarce their performance issignificantly degraded due to overfitting. In this paper, we mitigateoverfitting with a data-dependent regularization techniquethat relies on the principles of multi-task learning. Specifically,we propose an autoencoder-based matrix completion model thatperforms prediction of the unknown matrix values as a maintask, and manifold learning as an auxiliary task. The latter actsas an inductive bias, leading to solutions that generalize better.The proposed model outperforms the existing autoencoder-basedmodels designed for matrix completion, achieving high reconstructionaccuracy in well-known datasets.",
keywords = "Autoencoder, Deep neural network, Matrix completion, Multi-task learning, Regularization",
author = "Nguyen, {Minh Duc} and Evangelia Tsiligianni and Robert Calderbank and Nikolaos Deligiannis",
year = "2018",
month = nov,
day = "29",
doi = "10.23919/EUSIPCO.2018.8553528",
language = "English",
volume = "2018-September",
pages = "1880--1884",
booktitle = "2018 26th European Signal Processing Conference, EUSIPCO 2018",
}