Challenges in Building an End-to-End System for Acquisition, Management, and Integration of Diverse Data from Sensor Networks in Watersheds: Lessons from a Mountainous Community Observatory in East River, Colorado

Charuleka Varadharajan, Boris Faybishenko, Amanda Henderson, Matthew Henderson, Valerie C. Hendrix, Susan S. Hubbard, Zarine Kakalia, Alexander Newman, Benjamin Potter, Heidi Steltzer, Roelof Versteeg, Deborah A. Agarwal, Kenneth H. Williams, Chelsea Wilmer, Yuxin Wu, Wendy Brown, Madison Burrus, Rosemary W.H. Carroll, Danielle S. Christianson, Baptiste DafflonDipankar Dwivedi, Brian J. Enquist

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

The U.S. Department of Energy's Watershed Function Scientific Focus Area (SFA), centered in the East River, Colorado, generates diverse datasets including hydrological, geological, geochemical, geophysical, ecological, microbiological and remote sensing data. The project has deployed extensive field infrastructure involving hundreds of sensors that measure highly diverse phenomena (e.g. stream and groundwater hydrology, water quality, soil moisture, weather) across the watershed. Data from the sensor network are telemetered and automatically ingested into a queryable database. The data are subsequently quality checked, integrated with the United States Geological Survey's stream monitoring network using a custom data integration broker, and published to a portal with interactive visualizations. The resulting data products are used in a variety of scientific modeling and analytical efforts. This paper describes the SFA's end-to-end infrastructure and services that support the generation of integrated datasets from a watershed sensor network. The development and maintenance of this infrastructure, presents a suite of challenges from practical field logistics to complex data processing, which are addressed through various solutions. In particular, the SFA adopts a holistic view for data collection, assessment and integration, which dramatically improves the products generated, and enables a co-design approach wherein data collection is informed by model results and vice-versa.

Original languageEnglish (US)
Article number8924700
Pages (from-to)182796-182813
Number of pages18
JournalIEEE Access
Volume7
DOIs
StatePublished - 2019
Externally publishedYes

Keywords

  • Sensor systems and applications
  • co-design
  • data integration
  • data management
  • data processing
  • geoscience
  • sensors
  • water resources
  • watershed

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint

Dive into the research topics of 'Challenges in Building an End-to-End System for Acquisition, Management, and Integration of Diverse Data from Sensor Networks in Watersheds: Lessons from a Mountainous Community Observatory in East River, Colorado'. Together they form a unique fingerprint.

Cite this