Autonomous urban driving navigation is still an open problem and has ample room for improvement in unknown complex environments. This paper proposes end-to-end autonomous approach that combines Conditional Imitation Learning (CIL), Mask R-CNN with DDPG. In the first stage, data acquisition performed by using CARLA, a high-fidelity simulation software. Data collected CARLA used to train network,...

We introduce the problem of generating musical leadsheets, i.e. a melody with chord labels, in the style of an arbitrary composer, that satisfy arbitrary user constraints. The problem is justified by the very nature of musical creativity, as many composers create music precisely by imitating a given style to which they add their own constraints. We propose a solution of this problem by formulat...

In this paper, we apply Reinforcement Learning (RL) to a real-world task. While complex problems have been solved by RL in simulated worlds, the costs of obtaining enough training examples often prohibits the use of plain RL in real-world scenarios. We propose three approaches to reduce training expenses for real-world RL. Firstly, we replace the random exploration of the huge search space, whi...

Indirect reciprocity, a key concept in behavioral experiments and evolutionary game theory, provides a mechanism that allows reciprocal altruism to emerge in a population of self-regarding individuals even when repeated interactions between pairs of actors are unlikely. Recent empirical evidence show that humans typically follow complex assessment strategies involving both reciprocity and socia...

The reinforcement framework is a principled approach for agents learning to act in an environment. In the long run, reinforcement learning finds optimal policies. However, a physical agent, such as a humanoid robot, acting in the real world can perform only a limited number of trails, and consequently has only access to limited experience. With such limitations, the exhaustive exploration of hi...

Experimental studies of the imitative interactions (Ito & Tani, 2004) between robots and humans were conducted by using the Sony humanoid robot QRIO SDR-4XII (see Figure 1). As the first step, adaptation of the robot was examined in the context of imitation by synchronization. The later experiment examines the case of mutual interactions. In this experiment, the robot learns multiple movement p...

The number of subway suicides in Vienna increased dramatically between 1984 and mid-1987. In the second-half of 1987 there was a decrease of 75% which has been sustained for 5 yr. This reduction in subway suicides began when a working group of the Austrian Association for Suicide Prevention developed media guidelines and initiated discussions with the media which culminated with an agreement to...

Research on the secondary arc has long been important in development of ultrahigh-voltage (UHV) transmission technology. Predicting arcing time is for single-phase automatic reclosing circuit breaker to protect power system. In response this problem, study uses a multifactor variance model select factors that significantly influence and verifies its validity through residual analysis. The resul...