Swarm scalable storage system

John H Hartman, Ian Murdock, Tammo Spalink

Research output: Chapter in Book/Report/Conference proceedingChapter

39 Citations (Scopus)

Abstract

Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

Original languageEnglish (US)
Title of host publicationProceedings - International Conference on Distributed Computing Systems
PublisherIEEE
Pages74-81
Number of pages8
ISBN (Print)0769502229
StatePublished - 1999
EventProceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99) - Austin, TX, USA
Duration: May 31 1999Jun 4 1999

Other

OtherProceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99)
CityAustin, TX, USA
Period5/31/996/4/99

Fingerprint

Servers
Storage allocation (computer)
Fault tolerance
Personal computers
Redundancy
Costs
Data storage equipment
Recovery

ASJC Scopus subject areas

  • Hardware and Architecture

Cite this

Hartman, J. H., Murdock, I., & Spalink, T. (1999). Swarm scalable storage system. In Proceedings - International Conference on Distributed Computing Systems (pp. 74-81). IEEE.

Swarm scalable storage system. / Hartman, John H; Murdock, Ian; Spalink, Tammo.

Proceedings - International Conference on Distributed Computing Systems. IEEE, 1999. p. 74-81.

Research output: Chapter in Book/Report/Conference proceedingChapter

Hartman, JH, Murdock, I & Spalink, T 1999, Swarm scalable storage system. in Proceedings - International Conference on Distributed Computing Systems. IEEE, pp. 74-81, Proceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99), Austin, TX, USA, 5/31/99.
Hartman JH, Murdock I, Spalink T. Swarm scalable storage system. In Proceedings - International Conference on Distributed Computing Systems. IEEE. 1999. p. 74-81
Hartman, John H ; Murdock, Ian ; Spalink, Tammo. / Swarm scalable storage system. Proceedings - International Conference on Distributed Computing Systems. IEEE, 1999. pp. 74-81
@inbook{c787f8b7db1d4540942bfb408d116170,
title = "Swarm scalable storage system",
abstract = "Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.",
author = "Hartman, {John H} and Ian Murdock and Tammo Spalink",
year = "1999",
language = "English (US)",
isbn = "0769502229",
pages = "74--81",
booktitle = "Proceedings - International Conference on Distributed Computing Systems",
publisher = "IEEE",

}

TY - CHAP

T1 - Swarm scalable storage system

AU - Hartman, John H

AU - Murdock, Ian

AU - Spalink, Tammo

PY - 1999

Y1 - 1999

N2 - Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

AB - Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

UR - http://www.scopus.com/inward/record.url?scp=0032639183&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032639183&partnerID=8YFLogxK

M3 - Chapter

SN - 0769502229

SP - 74

EP - 81

BT - Proceedings - International Conference on Distributed Computing Systems

PB - IEEE

ER -