High Performance on Atari Games Using Perceptual Control Architecture Without Training
نویسندگان
چکیده
Abstract Deep reinforcement learning (DRL) requires large samples and a long training time to operate optimally. Yet humans rarely require periods of perform well on novel tasks, such as computer games, once they are provided with an accurate program instructions. We used perceptual control theory (PCT) construct simple closed-loop model which no within video game study using the Arcade Learning Environment (ALE). The was programmed parse inputs from environment into hierarchically organised signals, it computed dynamic error signal by subtracting incoming for each variable reference drive output signals reduce this error. tested same across three different Atari games Breakout, Pong Video Pinball achieve performance at least high DRL paradigms, close good human performance. Our shows that models, based assumptions, can without learning. conclude specifying parsimonious role may be more similar psychological functioning.
منابع مشابه
Investigating Contingency Awareness Using Atari 2600 Games
Contingency awareness is the recognition that some aspects of a future observation are under an agent’s control while others are solely determined by the environment. This paper explores the idea of contingency awareness in reinforcement learning using the platform of Atari 2600 games. We introduce a technique for accurately identifying contingent regions and describe how to exploit this knowle...
متن کاملLearning to Play Atari Games
Teaching computers to play video games is a complex learning problem that has recently seen increased attention. In this paper, we develop a system that, using constant model and hyperparameter settings, learns to play a variety of Atari games. In order to accomplish this task, we extract object features from the game screen, and provide these features as input into reinforcement learning algor...
متن کاملAtari Games and Intel Processors
The asynchronous nature of the state-of-the-art reinforcement learning algorithms such as the Asynchronous Advantage ActorCritic algorithm, makes them exceptionally suitable for CPU computations. However, given the fact that deep reinforcement learning often deals with interpreting visual information, a large part of the train and inference time is spent performing convolutions. In this work we...
متن کاملAction-Conditional Video Prediction using Deep Networks in Atari Games
Motivated by vision-based reinforcement learning (RL) problems, in particular Atari games from the recent benchmark Aracade Learning Environment (ALE), we consider spatio-temporal prediction problems where future image-frames depend on control variables or actions as well as previous frames. While not composed of natural scenes, frames in Atari games are high-dimensional in size, can involve te...
متن کاملState of the Art Control of Atari Games Using Shallow Reinforcement Learning
The recently introduced Deep Q-Networks (DQN) algorithm has gained attention as one of the first successful combinations of deep neural networks and reinforcement learning. Its promise was demonstrated in the Arcade Learning Environment (ALE), a challenging framework composed of dozens of Atari 2600 games used to evaluate general competency in AI. It achieved dramatically better results than ea...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Intelligent and Robotic Systems
سال: 2022
ISSN: ['1573-0409', '0921-0296']
DOI: https://doi.org/10.1007/s10846-022-01747-5