Hierarchical reinforcement learning (RL) is a general framework which studies how to exploit the structure of actions and tasks to accelerate policy learning in large domains. Prior work in hierarchical RL, such as the MAXQ method, has been limited to the discrete-time discounted reward semiMarkov decision process (SMDP) model. This paper generalizes the MAXQ method to continuous-time discounte...

This paper focuses on the design of a highly efficient Automated Guided Vehicle (AGV) transportation system. Therefore, we attempt to construct detailed system management models that include agent cooperation, container storage scheduling, and container transportation planning. We then optimally design systems that are constructed with the use of these management models. The systems are compare...

AGV systems are now becoming widely used in automatic material handling systems. One of the issues arising in applications is routing. This paper presents a bi-directional path layout and an algorithm for routing AGVs without conflicts. Mathematical relationships among certain key parameters of path and vehicle are derived to minimize the space requirements of the layout. The routing efficiency...

In this paper, we present the design and performance analysis of an innovative system for tracking Automated Guided Vehicles (AGVs) in indoor industrial scenarios. An on-board odometer provides information about the dynamic state of the AGV, allowing to predict its pose (i.e., its position and orientation). At the same time, an external Ultra-Wide Band (UWB) wireless network provides the inform...

We compare two approaches for a Markovian model in flexible manufacturing systems (FMSs) using Monte Carlo simulation. The model which is a development of Fazlollahtabar and Saidi-Mehrabad (2013), considers two features of automated flexible manufacturing systems equipped with automated guided vehicle (AGV) namely, the reliability of machines and the reliability of AGVs in a multiple AGV jobsho...

A nonlinear model predictive control algorithm is developed for obstacle avoidance in high-speed, large-size autonomous ground vehicles (AGVs) that perceive the environment only through information provided by on-board sensors. The mission of the AGV is to move from its initial configuration to the goal configuration safely. The resulting trajectory should be collision-free and the AGV should b...

purpose: to compare the efficacy and safety of ahmed glaucoma valve (agv) implantation in the superior versus inferior quadrants. methods: this prospective parallel cohort study was performed on 106 eyes of 106 patients with refractory glaucoma. main outcome measures included intraocular pressure (iop) and rate of complications. other outcome measures included best-corrected visual acuity (bcva...