Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...

We consider the exploration of a simple polygon P by a robot that moves from vertex to vertex along edges of the visibility graph of P. The visibility graph has a vertex for every vertex of P and an edge between two vertices if they see each other, i.e. if the line segment connecting them lies inside P entirely. While located at a vertex, the robot is capable of ordering the vertices it sees in...

Graphs can be used to represent and reason about systems a variety of metrics have been devised quantify their global characteristics. However, little is currently known how construct graph or improve an existing one given target objective. In this work, we formulate the construction as decision-making process in which central agent creates topologies by trial error receives rewards proportiona...

The horizontal visibility algorithm was recently introduced as a mapping between time series and networks. The challenge lies in characterizing the structure of time series (and the processes that generated those series) using the powerful tools of graph theory. Recent works have shown that the visibility graphs inherit several degrees of correlations from their associated series, and therefore...

Self-reconfiguration of robotic manipulators under joint failure can be achieved via fault-tolerance strategies. Faulttolerant manipulators are required to continue their endeffector motion with a minimum velocity jump, when failures occur to their joints. Optimal fault tolerance of the manipulators requires a framework that can map the velocity jump of the end-effector to the compensating join...

Matroids are important combinatorial structures and connect close-lywith graphs. Matroids and graphs were all generalized to fuzzysetting respectively. This paper tries to study  connections betweenfuzzy matroids and fuzzy graphs. For a given fuzzy graph, we firstinduce a sequence of matroids  from a sequence of crisp graph, i.e.,cuts of the fuzzy graph. A fuzzy matroid, named graph fuzzy matro...

In this paper, a new online robot motion planner is developed for systematically exploring unknown environ¬ments by intelligent mobile robots in real-time applications. The algorithm takes advantage of sensory data to find an obstacle-free start-to-goal path. It does so by online calculation of the Generalized Voronoi Graph (GVG) of the free space, and utilizing a combination of depth-first an...