Management of Real-Time Streaming Data Grid Services

نویسندگان

  • Geoffrey C. Fox
  • Galip Aydin
  • Harshawardhan Gadgil
  • Shrideep Pallickara
  • Marlon E. Pierce
  • Wenjun Wu
چکیده

We discuss the architectural and management support of real time data streams, both in terms of lower level messaging and higher level service, filter and session structure. Our messaging system acts as a substrate that can be used to provide qualities of service to various streaming applications ranging from audio-video collaboration systems to sensor grids. The messaging substrates are composed of distributed, hierarchically arranged message broker networks. We discuss the role of management systems for both broker networks and filters: broker network topologies must be created and maintained, and distributed filters must be arranged in appropriate sequences. These managed broker networks may be applied to a wide range of problems. We discuss applications to audio/video collaboration in some detail and also describe applications to streaming Global Positioning System data streams. These provide specific application filters that can transform and republish message streams to

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Grids for Real Time Data Applications

We describe our work in building support for streaming data services for Geographical Information System Grid services. We examine how streaming approaches may be used to increase data service performance for transporting XML messages. Similarly, streaming versions of traditional static map services may be combined with general audio/video session management capabilities to build collaborative,...

متن کامل

Design and Test of the Real-time Text mining dashboard for Twitter

One of today's major research trends in the field of information systems is the discovery of implicit knowledge hidden in dataset that is currently being produced at high speed, large volumes and with a wide variety of formats. Data with such features is called big data. Extracting, processing, and visualizing the huge amount of data, today has become one of the concerns of data science scholar...

متن کامل

Grid Resource Management and Scheduling for Data Streaming Applications 1001 GRID RESOURCE MANAGEMENT AND SCHEDULING FOR DATA STREAMING APPLICATIONS

Data streaming applications bring new challenges to resource management and scheduling for grid computing. Since real-time data streaming is required as data processing is going on, integrated grid resource management becomes essential among processing, storage and networking resources. Traditional scheduling approaches may not be sufficient for such applications, since usually only one aspect ...

متن کامل

The Solid Earth Research Virtual Observatory: Web Services for Managing Geophysical Data and Applications

We describe our distributed systems research efforts to build the “cyberinfrastructure” components that constitute a geophysical Grid, or more accurately, a Grid of Grids. Service-oriented computing principles are used to build a distributed infrastructure of Web accessible components for accessing data and scientific applications. Our data services fall into two major categories: archival, dat...

متن کامل

Grid Resource Management and Scheduling for Data Streaming Applications

Data streaming applications bring new challenges to resource management and scheduling for grid computing. Since real-time data streaming is required as data processing is going on, integrated grid resource management becomes essential among processing, storage and networking resources. Traditional scheduling approaches may not be sufficient for such applications, since usually only one aspect ...

متن کامل

Management of Data Streams for a Real Time Flood Simulation

We examine the challenge of coupling applications to real-time data sources in a Grid environment. Such problems are important to the emerging field of Grid-based emergency planning and crisis response, in which realtime data sources must be coupled to modeling applications to provide timely forecasting to emergency planners and responders. In this paper we present a Grid-based scripting workfl...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Concurrency and Computation: Practice and Experience

دوره 19  شماره 

صفحات  -

تاریخ انتشار 2005