ویراساینس.
سند علمی

A hierarchical approach to improve job scheduling and data replication in data grid

Somayeh Abdi, Sayyed Hashemi

چکیده

In dynamic environment of data grid effective job scheduling methods consider location of required data in dispatching jobs to resources. Also, job scheduling methods are combined with data replication mechanisms to reduce remote data access as well as save network bandwidth. In this paper, we combine job scheduling method and dynamic data replication to reduce data access delay and job execution time. Also, we expand our work by applying bloom filter in job scheduling decision. In data grid, appropriate mechanisms for recording, deleting and inquiring information about data files are required for implementing proper job scheduling method. Therefore, we apply counting bloom filter for recording/deleting and inquiring information about data files in Replica Catalogue (RC). Result of simulation indicates that proposed job scheduling and data replication methods reduce job execution time, also using bloom filter saves network bandwidth and reduces time of gathering information for selecting appropriate resources in job scheduling.

اسناد مشابه

  • Improving Job Scheduling Performance with Dynamic Replication Strategy in Data Grids

    سند علمی۲۰۰۷PaCTNguyen Dang Nhan, Soonwook Hwang, Sang Boem Lim

    Dealing with a large amount of data in Data Grids makes the requirement for efficient data access more critical. In this paper, we proposed a new approach to replication problem by organizing the data into several data categories that it belongs to. This organizing will help impr

  • Using the black-box approach with machine learning methods in order to improve job scheduling in GRID environments

    سند علمی۲۰۰۹DANIEL VLADUŠIČ

    This article focuses on mapping jobs to resources with use of off-the-shelf machine learning methods. The machine learning methods are used in the black-box manner, having a wide variety of parameters for internal cross validation. In the article we focus on two sets of experimen

  • An Effective Approach to Job Scheduling in Decentralized Grid Environment

    سند علمی۲۰۱۲G. K. Kamalam

    Scheduling of jobs and resource management are the important challenging work in a grid environment. Processing time minimization of the jobs arriving at any computer site in a grid system is one of the major objectives in the research area of computing. In this paper, we propose

  • A novel multi-agent reinforcement learning approach for job scheduling in Grid computing

    سند علمی۲۰۱۱Future Generation Comp. Syst.Jun Wu, Xin Xu, Pengcheng Zhang, Chunming Liu

    Grid computing utilizes distributed heterogeneous resources to support large-scale or complicated computing tasks, and an appropriate resource scheduling algorithm is fundamentally important for the success of Grid applications. Due to the complex and dynamic properties of Grid e

  • Grouping Based User Demand Aware Job Scheduling Approach for Computational Grid

    سند علمی۲۰۱۲P. SURESH, P. BALASUBRAMANIE

    Grid Computing is a high performance computing that solves complicated tasks and provides powerful computing abilities. Scheduler is very much responsible for effective utilization of resources and less processing time. Most of the scheduling algorithms failed to consider user sa

  • A Complex Network-Based Approach for Job Scheduling in Grid Environments

    سند علمی۲۰۰۷HPCCRenato Porfirio Ishii, Rodrigo Fernandes de Mello, Laurence T. Yang

    Many optimization techniques have been adopted for efficient job scheduling in grid computing, such as: genetic algorithms, simulated annealing and stochastic methods. Such techniques present common problems related to the use of inaccurate and out-of-date information, which degr