Grounded action transformation for sim-to-real reinforcement learning
نویسندگان
چکیده
Abstract Reinforcement learning in simulation is a promising alternative to the prohibitive sample cost of reinforcement physical world. Unfortunately, policies learned often perform worse than hand-coded when applied on target, system. Grounded ( gsl ) general framework that promises address this issue by altering simulator better match real world (Farchy et al. 2013 Proceedings 12th international conference autonomous agents and multiagent systems (AAMAS)). This article introduces new algorithm for —Grounded Action Transformation (GAT)—and applies it control humanoid robot. We evaluate our controlled experiments where we show allow transfer then apply fast bipedal walk robot demonstrate 43.27% improvement forward velocity compared state-of-the art walk. striking empirical success notwithstanding, further analysis shows gat may struggle has stochastic state transitions. To limitation generalize sgat empirically leads successful situations fail find good policy. Our results contribute deeper understanding grounded its effectiveness applying learn entirely simulation.
منابع مشابه
Grounded Action Transformation for Robot Learning in Simulation
Robot learning in simulation is a promising alternative to the prohibitive sample cost of learning in the physical world. Unfortunately, policies learned in simulation often perform worse than hand-coded policies when applied on the physical robot. This paper proposes a new algorithm for learning in simulation – Grounded Action Transformation – and applies it to learning of humanoid bipedal loc...
متن کاملGrounded Action Transformation for Robot Learning in Simulation
Robot learning in simulation is a promising alternative to the prohibitive sample cost of learning in the physical world. Unfortunately, policies learned in simulation often perform worse than hand-coded policies when applied on the physical robot. Grounded simulation learning (GSL) promises to address this issue by altering the simulator to better match the real world. This paper proposes a ne...
متن کاملFlexible Robotic Grasping with Sim-to-Real Transfer based Reinforcement Learning
Robotic manipulation requires a highly flexible and compliant system. Task-specific heuristics are usually not able to cope with the diversity of the world outside of specific assembly lines and cannot generalize well. Reinforcement learning methods provide a way to cope with uncertainty and allow robots to explore their action space to solve specific tasks. However, this comes at a cost of hig...
متن کاملLearning Behaviorally Grounded State Representations for Reinforcement Learning Agents
The learning and reasoning capabilities of biological systems by far exceed those of robots and artificial agents. Part of this stems from their ability to efficiently learn behavioral skills and increasingly complex, symbolic representations that capture the important aspects of their environment. This paper presents an autonomous learning approach by which artificial reinforcement learning ag...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine Learning
سال: 2021
ISSN: ['0885-6125', '1573-0565']
DOI: https://doi.org/10.1007/s10994-021-05982-z