Customizing the swarm storage system using agents

John H Hartman, Scott Baker, Ian Murdock

Research output: Contribution to journalArticle

Abstract

Swarm is a scalable, modular storage system that uses agents to customize low-level storage functions to meet the needs of high-level services. Agents influence low-level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so.

Original languageEnglish (US)
Pages (from-to)117-137
Number of pages21
JournalSoftware - Practice and Experience
Volume36
Issue number2
DOIs
StatePublished - Feb 2006

Fingerprint

Metadata
Recovery

Keywords

  • Agents
  • File system
  • LFS
  • Log structured
  • Storage system

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Customizing the swarm storage system using agents. / Hartman, John H; Baker, Scott; Murdock, Ian.

In: Software - Practice and Experience, Vol. 36, No. 2, 02.2006, p. 117-137.

Research output: Contribution to journalArticle

Hartman, John H ; Baker, Scott ; Murdock, Ian. / Customizing the swarm storage system using agents. In: Software - Practice and Experience. 2006 ; Vol. 36, No. 2. pp. 117-137.
@article{89c2151b8c3044c3b9a5a56e71d86bec,
title = "Customizing the swarm storage system using agents",
abstract = "Swarm is a scalable, modular storage system that uses agents to customize low-level storage functions to meet the needs of high-level services. Agents influence low-level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so.",
keywords = "Agents, File system, LFS, Log structured, Storage system",
author = "Hartman, {John H} and Scott Baker and Ian Murdock",
year = "2006",
month = "2",
doi = "10.1002/spe.685",
language = "English (US)",
volume = "36",
pages = "117--137",
journal = "Software - Practice and Experience",
issn = "0038-0644",
publisher = "John Wiley and Sons Ltd",
number = "2",

}

TY - JOUR

T1 - Customizing the swarm storage system using agents

AU - Hartman, John H

AU - Baker, Scott

AU - Murdock, Ian

PY - 2006/2

Y1 - 2006/2

N2 - Swarm is a scalable, modular storage system that uses agents to customize low-level storage functions to meet the needs of high-level services. Agents influence low-level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so.

AB - Swarm is a scalable, modular storage system that uses agents to customize low-level storage functions to meet the needs of high-level services. Agents influence low-level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so.

KW - Agents

KW - File system

KW - LFS

KW - Log structured

KW - Storage system

UR - http://www.scopus.com/inward/record.url?scp=32144444342&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=32144444342&partnerID=8YFLogxK

U2 - 10.1002/spe.685

DO - 10.1002/spe.685

M3 - Article

AN - SCOPUS:32144444342

VL - 36

SP - 117

EP - 137

JO - Software - Practice and Experience

JF - Software - Practice and Experience

SN - 0038-0644

IS - 2

ER -