Scalable Storage Systems
نویسنده
چکیده
Petabyte and Exabyte storage systems are a reality. These systems introduce unique challenges to the systems architect because of their size and unique requirements. In this thesis, I suggest that access patterns to very large storage systems are long-tailed distributions. I explore three live systems and show that each of them has a very strong long-tailed access distribution. Based on this finding, I prove there is no operational benefit to be gained by applying a directed placement policy allocating items to storage units. I conclude this thesis with a discussion of impacts and future research opportunities based on these findings, including large scale caches, backup techniques and distributed databases.
منابع مشابه
An Efficient Secret Sharing-based Storage System for Cloud-based Internet of Things
Internet of things (IoTs) is the newfound information architecture based on the internet that develops interactions between objects and services in a secure and reliable environment. As the availability of many smart devices rises, secure and scalable mass storage systems for aggregate data is required in IoTs applications. In this paper, we propose a new method for storing aggregate data in Io...
متن کاملHighly-Available, Scalable Network Storage
The ideal storage system is always available, is incrementally expandable, scales in performance as new components are added, and requires no management. Existing storage systems are far from this ideal. The recent introduction of low-cost, scalable, high-performance networks allows us to re-examine the way we build storage systems and to investigate storage architectures that bring us closer t...
متن کاملEfficient, scalable consistency for highly fault-tolerant storage
Fault-tolerant storage systems spread data redundantly across a set of storage-nodes in an effort to preserve and provide access to data despite failures. One difficulty created by this architecture is the need for a consistent view, across storage-nodes, of the most recent update. Such consistency is made difficult by concurrent updates, partial updates made by clients that fail, and failures ...
متن کاملSecure Access Mechanism for Cloud Storage
Emerging storage cloud systems provide continuously available and highly scalable storage services to millions of geographically distributed clients. A secure access control mechanism is a crucial prerequisite for allowing clients to entrust their data to such cloud services. The seamlessly unlimited scale of the cloud and the new usage scenarios that accompany it pose new challenges in the des...
متن کاملSimulation Studies of the Cassette Migration Activities in a Scalable Tape Archiver
With the prolifemtion of multimedia applications, even secondary storage systems do not have sufficient storage capacity to meet the demand, only tertiary storage systems can provide the necessary storage economically. We have been examining the feasibility of “‘scalable tape archiver” where any number of commodity 8mm based robotics can be connected to allow the development of arbitrary sized ...
متن کاملDistributed NoSQL Storage for Extreme-Scale System Services
Today with the rapidly accumulated data, datadriven applications are emerging in science and commercial areas. On both HPC systems and clouds the continuously widening performance gap between storage and computing resource prevents us from building scalable data-intensive systems. Distributed NoSQL storage systems are known for their ease of use and attractive performance and are increasingly u...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010