We report on the improvements that can be achieved by applying machine learning techniques, in particular reinforcementlearning, for the dynamic load balancing of parallel applications. The applications being considered in this paper are coarsegrain data intensive applications. Such applications put high pressure on the interconnect of the hardware. Synchronization andload balancing in complex, heterogeneous networks need fast, flexible, adaptive load balancing algorithms. Viewing a parallelapplication as a one-state coordination game in the framework of multi-agent reinforcement learning, and by using a recentlyintroduced multi-agent exploration technique, we are able to improve upon the classic job farming approach. The improvementsare achieved with limited computation and communication overhead.
Parent, J, Verbeeck, K, Lemeire, J, Dirkx, E, Nowe, A & Steenhaut, K 2004, 'Adaptive Load Balancing of Parallel Applications with Multi-Agent Reinforcement Learning on Heterogeneous Systems', Scientific Programming, vol. 12, pp. 71-79.
Parent, J., Verbeeck, K., Lemeire, J., Dirkx, E., Nowe, A., & Steenhaut, K. (2004). Adaptive Load Balancing of Parallel Applications with Multi-Agent Reinforcement Learning on Heterogeneous Systems. Scientific Programming, 12, 71-79.
@article{4602403687d240588412d21c5bc788b7,
title = "Adaptive Load Balancing of Parallel Applications with Multi-Agent Reinforcement Learning on Heterogeneous Systems",
abstract = "We report on the improvements that can be achieved by applying machine learning techniques, in particular reinforcementlearning, for the dynamic load balancing of parallel applications. The applications being considered in this paper are coarsegrain data intensive applications. Such applications put high pressure on the interconnect of the hardware. Synchronization andload balancing in complex, heterogeneous networks need fast, flexible, adaptive load balancing algorithms. Viewing a parallelapplication as a one-state coordination game in the framework of multi-agent reinforcement learning, and by using a recentlyintroduced multi-agent exploration technique, we are able to improve upon the classic job farming approach. The improvementsare achieved with limited computation and communication overhead.",
keywords = "game theory, optimization",
author = "Johan Parent and Katja Verbeeck and Jan Lemeire and E. Dirkx and Ann Nowe and Kris Steenhaut",
year = "2004",
language = "English",
volume = "12",
pages = "71--79",
journal = "Scientific Programming",
issn = "1058-9244",
publisher = "IOS Press",
}