The present disclosure relates to a computer implemented method for training a learning model by means of a distributed learning system comprising computing nodes, the computing nodes respectively implementing the learning model and deriving a gradient information for updating the learning model based on training data, the method comprising: encoding, by the computing nodes, the gradient information by exploiting a correlation across the gradient information from the respective computing nodes; exchanging, by the computing nodes, the encoded gradient information within the distributed learning system; determining an aggregate gradient information based on the encoded gradient information from the computing nodes; and updating the learning model of the computing nodes with the aggregate gradient information, thereby training the learning model.
Abrahamyan, L & Deligiannis, N, A method for a distributed learning, Patent No. EP4162403.
Abrahamyan, L., & Deligiannis, N. (2023). A method for a distributed learning. (Patent No. EP4162403).
@misc{a7530a37f2354016ace2f25f98a4d1cd,
title = "A method for a distributed learning",
abstract = "The present disclosure relates to a computer implemented method for training a learning model by means of a distributed learning system comprising computing nodes, the computing nodes respectively implementing the learning model and deriving a gradient information for updating the learning model based on training data, the method comprising: encoding, by the computing nodes, the gradient information by exploiting a correlation across the gradient information from the respective computing nodes; exchanging, by the computing nodes, the encoded gradient information within the distributed learning system; determining an aggregate gradient information based on the encoded gradient information from the computing nodes; and updating the learning model of the computing nodes with the aggregate gradient information, thereby training the learning model.",
author = "Lusine Abrahamyan and Nikos Deligiannis",
year = "2023",
language = "English",
type = "Patent",
note = "EP4162403",
}