Conor F. Hayes, Roxana Radulescu, Eugenio Bargiacchi, Johan KÀllström, Matthew Macfarlane, Mathieu Reymond, Timothy Verstraeten, Luisa Zintgraf, Richard Dazeley, Fredrik Heintz, Enda Howley, Athirai A. Irissappane, Patrick Mannion, Ann Nowe, Gabriel De Oliveira Ramos, Marcello Restelli, Peter Vamplew, Diederik M. Roijers
Real-world sequential decision-making tasks are usually complex, and require trade-offs between multiple -- often conflicting -- objectives. However, the majority of research in reinforcement learning (RL) and decision-theoretic planning assumes a single objective, or that multiple objectives can be handled via a predefined weighted sum over the objectives. Such approaches may oversimplify the underlying problem, and produce suboptimal results. This extended abstract outlines the limitations of using a semi-blind iterative process to solve multi-objective decision making problems. Our extended paper serves as a guide for the application of explicitly multi-objective methods to difficult problems.
Hayes, CF, Radulescu, R, Bargiacchi, E, KÀllström, J, Macfarlane, M, Reymond, M, Verstraeten, T, Zintgraf, L, Dazeley, R, Heintz, F, Howley, E, Irissappane, AA, Mannion, P, Nowe, A, De Oliveira Ramos, G, Restelli, M, Vamplew, P & Roijers, DM 2023, A Brief Guide to Multi-Objective Reinforcement Learning and Planning: JAAMAS Track. in The 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023). vol. 2023-May, Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), pp. 1988-1990, The 22nd International Conference on Autonomous Agents and Multiagent Systems, London, United Kingdom, 29/05/23. <https://www.southampton.ac.uk/~eg/AAMAS2023/pdfs/p1988.pdf>
Hayes, C. F., Radulescu, R., Bargiacchi, E., KÀllström, J., Macfarlane, M., Reymond, M., Verstraeten, T., Zintgraf, L., Dazeley, R., Heintz, F., Howley, E., Irissappane, A. A., Mannion, P., Nowe, A., De Oliveira Ramos, G., Restelli, M., Vamplew, P., & Roijers, D. M. (2023). A Brief Guide to Multi-Objective Reinforcement Learning and Planning: JAAMAS Track. In The 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023) (Vol. 2023-May, pp. 1988-1990). (Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS). https://www.southampton.ac.uk/~eg/AAMAS2023/pdfs/p1988.pdf
@inproceedings{6f906192628547bd894428f171bf01ce,
title = "A Brief Guide to Multi-Objective Reinforcement Learning and Planning: JAAMAS Track",
abstract = "Real-world sequential decision-making tasks are usually complex, and require trade-offs between multiple -- often conflicting -- objectives. However, the majority of research in reinforcement learning (RL) and decision-theoretic planning assumes a single objective, or that multiple objectives can be handled via a predefined weighted sum over the objectives. Such approaches may oversimplify the underlying problem, and produce suboptimal results. This extended abstract outlines the limitations of using a semi-blind iterative process to solve multi-objective decision making problems. Our extended paper serves as a guide for the application of explicitly multi-objective methods to difficult problems.",
author = "Hayes, {Conor F.} and Roxana Radulescu and Eugenio Bargiacchi and Johan K{\"a}llstr{\"o}m and Matthew Macfarlane and Mathieu Reymond and Timothy Verstraeten and Luisa Zintgraf and Richard Dazeley and Fredrik Heintz and Enda Howley and Irissappane, {Athirai A.} and Patrick Mannion and Ann Nowe and {De Oliveira Ramos}, Gabriel and Marcello Restelli and Peter Vamplew and Roijers, {Diederik M.}",
note = "Funding Information: Conor F. Hayes is funded by the University of Galway Hardiman Scholarship. This research was supported by funding from the Flemish Government under the âOnderzoeksprogramma Artifici{\"e}le Intelligentie (AI) Vlaanderenâ program. Roxana R{\u a}dulescu is supported by the Research Foundation Flanders (FWO postdoctoral fellowship 1286223N). Johan K{\"a}llstr{\"o}m and Fredrik Heintz were partially supported by the Swedish Governmental Agency for Innovation Systems (grant NFFP7/2017-04885), and the Wallenberg Artificial Intelligence, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation. Luisa Zintgraf was supported by the 2017 Microsoft Research PhD Scholarship Program, and the 2020 Microsoft Research EMEA PhD Award. Publisher Copyright: {\textcopyright} 2023 International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org). All rights reserved.; The 22nd International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2023 ; Conference date: 29-05-2023 Through 02-06-2023",
year = "2023",
month = may,
language = "English",
volume = "2023-May",
series = "Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS",
publisher = "International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)",
pages = "1988--1990",
booktitle = "The 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023)",
url = "https://aamas2023.soton.ac.uk",
}