Joris De Winter, Ilias El Makrini, Greet Van de Perre, Ann Nowe, Tom Verstraten, Bram Vanderborght
Industrial robots used to assemble customized products in small batches require a lot of reprogramming. With this work we aim to reduce the programming complexity by autonomously finding the fastest assembly plans without any collisions with the environment. First, a digital twin of the robot uses a gym in simulation to learn which assembly skills (programmed by demonstration) are physically possible (i.e. no collisions with the environment). Only from this reduced solution space will the physical twin look for the fastest assembly plans. Experiments show that the system indeed converges to the fastest assembly plans. Moreover, pre-training in simulation drastically reduces the number of interactions before convergence compared to directly learning on the physical robot. This two-step procedure allows for the robot to autonomously find correct and fast assembly sequences, without any additional human input or mismanufactured products.
De Winter, J, El Makrini, I, Van de Perre, G, Nowe, A, Verstraten, T & Vanderborght, B 2021, 'Autonomous Assembly Planning of Demonstrated Skills with Reinforcement Learning in Simulation', Autonomous Robots, vol. 45, no. 8, pp. 1097-1110. https://doi.org/10.1007/s10514-021-10020-x
De Winter, J., El Makrini, I., Van de Perre, G., Nowe, A., Verstraten, T., & Vanderborght, B. (2021). Autonomous Assembly Planning of Demonstrated Skills with Reinforcement Learning in Simulation. Autonomous Robots, 45(8), 1097-1110. https://doi.org/10.1007/s10514-021-10020-x
@article{83052ed6f7e74fa3a93e91efd1a9448e,
title = "Autonomous Assembly Planning of Demonstrated Skills with Reinforcement Learning in Simulation",
abstract = "Industrial robots used to assemble customized products in small batches require a lot of reprogramming. With this work we aim to reduce the programming complexity by autonomously finding the fastest assembly plans without any collisions with the environment. First, a digital twin of the robot uses a gym in simulation to learn which assembly skills (programmed by demonstration) are physically possible (i.e. no collisions with the environment). Only from this reduced solution space will the physical twin look for the fastest assembly plans. Experiments show that the system indeed converges to the fastest assembly plans. Moreover, pre-training in simulation drastically reduces the number of interactions before convergence compared to directly learning on the physical robot. This two-step procedure allows for the robot to autonomously find correct and fast assembly sequences, without any additional human input or mismanufactured products.",
author = "{De Winter}, Joris and {El Makrini}, Ilias and {Van de Perre}, Greet and Ann Nowe and Tom Verstraten and Bram Vanderborght",
year = "2021",
month = oct,
day = "16",
doi = "10.1007/s10514-021-10020-x",
language = "English",
volume = "45",
pages = "1097--1110",
journal = "Autonomous Robots",
issn = "0929-5593",
publisher = "Springer Netherlands",
number = "8",
}