Swarm scalable storage system

John H. Hartman, Ian Murdock, Tammo Spalink

Research output: Chapter in Book/Report/Conference proceedingConference contribution

40 Scopus citations

Abstract

Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

Original languageEnglish (US)
Title of host publicationProceedings - International Conference on Distributed Computing Systems
PublisherIEEE
Pages74-81
Number of pages8
ISBN (Print)0769502229
StatePublished - Jan 1 1999
EventProceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99) - Austin, TX, USA
Duration: May 31 1999Jun 4 1999

Publication series

NameProceedings - International Conference on Distributed Computing Systems

Other

OtherProceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99)
CityAustin, TX, USA
Period5/31/996/4/99

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Swarm scalable storage system'. Together they form a unique fingerprint.

  • Cite this

    Hartman, J. H., Murdock, I., & Spalink, T. (1999). Swarm scalable storage system. In Proceedings - International Conference on Distributed Computing Systems (pp. 74-81). (Proceedings - International Conference on Distributed Computing Systems). IEEE.