We present a new hybrid approach to performance management, combining disparate strengths of Reinforcment Learning (RL) with model-based (e.g. queuing-theoretic) approaches. Our method trains nonlinear function approximators using offline RL on data collected while a model-based policy controls the system. By training offline we avoid potentially poor performance in live online training, while ...

The objective of this work is to establish the basic setup and methodology for analyzing the effect of common disturbances on the residential power line channel response regarding time and network topology. Such information is necessary in the process of developing a method of real-time channel sensing used in a multi-carrier communication system that performs dynamical sub-channel bandwidth al...

In data networking and queuing theory, network congestion occurs when a link or node is carrying so much data that its quality of service deteriorates. Typical effects include queuing delay, packet loss or the blocking of new connections. A consequence of these latter two is that incremental increases in offered load lead either only to small increases in network throughput, or to an actual red...

Purpose – The purpose of this paper is to provide a framework and prototype software to use IDEF3 descriptions as a knowledge base from which a queuing network (QN) analysis is performed to compute system performance measures as part of quick response manufacturing. This intends to help domain experts obtain informative quantitative performance measures such as resource utilization, waiting tim...

Advance Reservation is one possible way to enable resource co-allocation on the Grid. This method requires all the resources to have advance reservation capability as well as coordination protocol support. We employed 2-phased commit protocol as a coordination protocol, which is common in the distributed transaction area, and implemented an Advance Reservation Manager called PluS. PluS works wi...

since the 1990’s, network reliability has been considered as a new index for evaluating transportation networks under uncertainty. a large number of studies have been revealed in the literature in this field, which are mostly dedicated to developing relevant measures that can be utilized for the evaluation of vulnerable networks under different sources of uncertainty, such as daily traffic flow...

the paper discusses the current state of research concerning railway network timetabling and traffic management. timetable effectiveness is governed by frequency, regularity, accurate running, recovery and layover times, as well as minimal headway, buffer times and waiting times. analytic (queuing) models and stochastic microsimulation are predominantly used for estimation of waiting times and ...

Queuing theory is the formal study of waiting in line and is an entire discipline in operations management. This article will give the reader a general background into queuing theory, its associated terminology, and its relationship to patient satisfaction. Queuing theory has been used in the past to assess such things as staff schedules, working environment, productivity, customer waiting time...

Commodity wireless routers have become widely deployed, providing a new opportunity to provide inexpensive Internet connectivity in broad areas. We present a software architecture to promote sharing connectivity, using easily upgraded wireless routers and unmodified client devices. We focus primarily on aspects of security and resource allocation, addressing several issues specific to our domai...