ویراساینس.
سند علمی

Analysis of Disk Access Patterns on File Systems for Content Addressable Storage

Kuniyasu Suzaki, Kengo Iijima, Toshiki Yagi

چکیده

CAS (Content Addressable Storage) is virtual disk with deduplication, which merges same-content chunks and reduces the consumption of physical storage. The performance of CAS depends on the allocation strategy of the individual file system and its access patterns (size, frequency, and locality of reference) since the effect of merging depends on the size of a chunk (access unit) used in deduplication. We propose a method to evaluate the affinity between file system and CAS, which compares the degree of deduplication by storing many same-contents files throughout a file system. The results show the affinity and semantic gap between the file systems (ext3, ext4, XFS, JFS, ReiserFS (they are bootable file systems), NILFS, btrfs, FAT32 and NTFS, and CAS. We also measured disk accesses through five bootable file systems at installation (Ubuntu 10.10) and at boot time, and found a variety of access patterns, even if same contents were installed. The results indicate that the five file systems allocate data scattered from a macroscopic view, but keep block contiguity for data from a microscopic view.

اسناد مشابه

  • HydraFS: A High-Throughput File System for the HYDRAstor Content-Addressable Storage System

    سند علمی۲۰۱۰FASTCristian Ungureanu, Benjamin Atkin, Akshat Aranya, Salil Gokhale

    A content-addressable storage (CAS) system is a valuable tool for building storage solutions, providing efficiency by automatically detecting and eliminating duplicate blocks; it can also be capable of high throughput, at least for streaming access. However, the absence of a stan

  • Opportunistic Use of Content Addressable Storage for Distributed File Systems

    سند علمی۲۰۰۳USENIX Annual Technical Conference, General TrackNiraj Tolia, Michael A. Kozuch, Mahadev Satyanarayanan, Brad Karp

    Motivated by the prospect of readily available Content Addressable Storage (CAS), we introduce the concept of file recipes. A file’s recipe is a first-class file system object listing content hashes that describe the data blocks composing the file. File recipes provide applicatio

  • Experiences with Content Addressable Storage and Virtual Disks

    سند علمی۲۰۰۸Workshop on I/O VirtualizationAnthony Liguori, Eric Van Hensbergen

    Efficiently managing storage is important for virtualized computing environments. Its importance is magnified by developments such as cloud computing which consolidate many thousands of virtual machines (and their associated storage). The nature of this storage is such that there

  • Concurrent deletion in a distributed content-addressable storage system with global deduplication

    سند علمی۲۰۱۳FASTPrzemyslaw Strzelczak, Elzbieta Adamczyk, Urszula Herman-Izycka, Jakub Sakowicz

    Scalable, highly reliable distributed systems supporting data deduplication have recently become popular for storing backup and archival data. One of the important requirements for backup storage is the ability to delete data selectively. Unlike in traditional storage systems, da

  • HighLight: Using a Log-structured File System for Tertiary Storage Management

    سند علمی۱۹۹۳USENIX WinterJohn T. Kohl, Carl Staelin, Michael Stonebraker

    Log-structured file systems (LFSs) were developed to eliminate latencies involved in accessing disk devices, but their sequential write patterns also match well with tertiary storage characteristics. Unfortunately, existing versions only manage memory caches and disks, and do not

  • Design Tradeoffs in Applying Content Addressable Storage to Enterprise-scale Systems Based on Virtual Machines

    سند علمی۲۰۰۶USENIX Annual Technical Conference, General TrackPartho Nath, Michael A. Kozuch, David R. O'Hallaron, Jan Harkes

    This paper analyzes the usage data from a live deployment of an enterprise client management system based on virtual machine (VM) technology. Over a period of seven months, twenty-three volunteers used VM-based computing environments hosted by the system and created over 800 chec