A DDDAMS-based planning and control framework for surveillance and crowd control via UAVs and UGVs

Amirreza M. Khaleghi, Dong Xu, Zhenrui Wang, Mingyang Li, Alfonso Lobos, Jian Liu, Young-Jun Son

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

A dynamic data driven adaptive multi-scale simulation (DDDAMS) based planning and control framework is proposed for effective and efficient surveillance and crowd control via UAVs and UGVs. The framework is mainly composed of integrated planner, integrated controller, and decision module for DDDAMS. The integrated planner, which is designed in an agent-based simulation (ABS) environment, devises best control strategies for each function of (1) crowd detection (vision algorithm), (2) crowd tracking (filtering), and (3) UAV/UGV motion planning (graph search algorithm). The integrated controller then controls real UAVs/UGVs for surveillance tasks via (1) sensory data collection and processing, (2) control command generation based on strategies provided by the decision planner for crowd detection, tracking, and motion planning, and (3) control command transmission via radio to the real system. The decision module for DDDAMS enhances computational efficiency of the proposed framework via dynamic switching of fidelity of simulation and information gathering based on the proposed fidelity selection and assignment algorithms. In the experiment, the proposed framework (involving fast-running simulation as well as real-time simulation) is illustrated and demonstrated for a real system represented by hardware-in-the-loop (HIL) real-time simulation integrating real UAVs, simulated UGVs and crowd, and simulated environment (e.g. terrain). Finally, the preliminary results successfully demonstrate the benefit of the proposed dynamic fidelity switching concerning the crowd coverage percentage and computational resource usage (i.e. CPU usage) under cases with two different simulation fidelities.

Original languageEnglish (US)
Pages (from-to)7168-7183
Number of pages16
JournalExpert Systems with Applications
Volume40
Issue number18
DOIs
StatePublished - 2013

Fingerprint

Unmanned aerial vehicles (UAV)
Planning
Motion planning
Controllers
Computational efficiency
Program processors
Hardware
Processing
Experiments

Keywords

  • Agent-based simulation
  • DDDAMS
  • Fidelity
  • Surveillance
  • UAV
  • UGV

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Engineering(all)

Cite this

A DDDAMS-based planning and control framework for surveillance and crowd control via UAVs and UGVs. / Khaleghi, Amirreza M.; Xu, Dong; Wang, Zhenrui; Li, Mingyang; Lobos, Alfonso; Liu, Jian; Son, Young-Jun.

In: Expert Systems with Applications, Vol. 40, No. 18, 2013, p. 7168-7183.

Research output: Contribution to journalArticle

Khaleghi, Amirreza M. ; Xu, Dong ; Wang, Zhenrui ; Li, Mingyang ; Lobos, Alfonso ; Liu, Jian ; Son, Young-Jun. / A DDDAMS-based planning and control framework for surveillance and crowd control via UAVs and UGVs. In: Expert Systems with Applications. 2013 ; Vol. 40, No. 18. pp. 7168-7183.
@article{f56730fdd03e4729b1e3ac4d6b65aa42,
title = "A DDDAMS-based planning and control framework for surveillance and crowd control via UAVs and UGVs",
abstract = "A dynamic data driven adaptive multi-scale simulation (DDDAMS) based planning and control framework is proposed for effective and efficient surveillance and crowd control via UAVs and UGVs. The framework is mainly composed of integrated planner, integrated controller, and decision module for DDDAMS. The integrated planner, which is designed in an agent-based simulation (ABS) environment, devises best control strategies for each function of (1) crowd detection (vision algorithm), (2) crowd tracking (filtering), and (3) UAV/UGV motion planning (graph search algorithm). The integrated controller then controls real UAVs/UGVs for surveillance tasks via (1) sensory data collection and processing, (2) control command generation based on strategies provided by the decision planner for crowd detection, tracking, and motion planning, and (3) control command transmission via radio to the real system. The decision module for DDDAMS enhances computational efficiency of the proposed framework via dynamic switching of fidelity of simulation and information gathering based on the proposed fidelity selection and assignment algorithms. In the experiment, the proposed framework (involving fast-running simulation as well as real-time simulation) is illustrated and demonstrated for a real system represented by hardware-in-the-loop (HIL) real-time simulation integrating real UAVs, simulated UGVs and crowd, and simulated environment (e.g. terrain). Finally, the preliminary results successfully demonstrate the benefit of the proposed dynamic fidelity switching concerning the crowd coverage percentage and computational resource usage (i.e. CPU usage) under cases with two different simulation fidelities.",
keywords = "Agent-based simulation, DDDAMS, Fidelity, Surveillance, UAV, UGV",
author = "Khaleghi, {Amirreza M.} and Dong Xu and Zhenrui Wang and Mingyang Li and Alfonso Lobos and Jian Liu and Young-Jun Son",
year = "2013",
doi = "10.1016/j.eswa.2013.07.039",
language = "English (US)",
volume = "40",
pages = "7168--7183",
journal = "Expert Systems with Applications",
issn = "0957-4174",
publisher = "Elsevier Limited",
number = "18",

}

TY - JOUR

T1 - A DDDAMS-based planning and control framework for surveillance and crowd control via UAVs and UGVs

AU - Khaleghi, Amirreza M.

AU - Xu, Dong

AU - Wang, Zhenrui

AU - Li, Mingyang

AU - Lobos, Alfonso

AU - Liu, Jian

AU - Son, Young-Jun

PY - 2013

Y1 - 2013

N2 - A dynamic data driven adaptive multi-scale simulation (DDDAMS) based planning and control framework is proposed for effective and efficient surveillance and crowd control via UAVs and UGVs. The framework is mainly composed of integrated planner, integrated controller, and decision module for DDDAMS. The integrated planner, which is designed in an agent-based simulation (ABS) environment, devises best control strategies for each function of (1) crowd detection (vision algorithm), (2) crowd tracking (filtering), and (3) UAV/UGV motion planning (graph search algorithm). The integrated controller then controls real UAVs/UGVs for surveillance tasks via (1) sensory data collection and processing, (2) control command generation based on strategies provided by the decision planner for crowd detection, tracking, and motion planning, and (3) control command transmission via radio to the real system. The decision module for DDDAMS enhances computational efficiency of the proposed framework via dynamic switching of fidelity of simulation and information gathering based on the proposed fidelity selection and assignment algorithms. In the experiment, the proposed framework (involving fast-running simulation as well as real-time simulation) is illustrated and demonstrated for a real system represented by hardware-in-the-loop (HIL) real-time simulation integrating real UAVs, simulated UGVs and crowd, and simulated environment (e.g. terrain). Finally, the preliminary results successfully demonstrate the benefit of the proposed dynamic fidelity switching concerning the crowd coverage percentage and computational resource usage (i.e. CPU usage) under cases with two different simulation fidelities.

AB - A dynamic data driven adaptive multi-scale simulation (DDDAMS) based planning and control framework is proposed for effective and efficient surveillance and crowd control via UAVs and UGVs. The framework is mainly composed of integrated planner, integrated controller, and decision module for DDDAMS. The integrated planner, which is designed in an agent-based simulation (ABS) environment, devises best control strategies for each function of (1) crowd detection (vision algorithm), (2) crowd tracking (filtering), and (3) UAV/UGV motion planning (graph search algorithm). The integrated controller then controls real UAVs/UGVs for surveillance tasks via (1) sensory data collection and processing, (2) control command generation based on strategies provided by the decision planner for crowd detection, tracking, and motion planning, and (3) control command transmission via radio to the real system. The decision module for DDDAMS enhances computational efficiency of the proposed framework via dynamic switching of fidelity of simulation and information gathering based on the proposed fidelity selection and assignment algorithms. In the experiment, the proposed framework (involving fast-running simulation as well as real-time simulation) is illustrated and demonstrated for a real system represented by hardware-in-the-loop (HIL) real-time simulation integrating real UAVs, simulated UGVs and crowd, and simulated environment (e.g. terrain). Finally, the preliminary results successfully demonstrate the benefit of the proposed dynamic fidelity switching concerning the crowd coverage percentage and computational resource usage (i.e. CPU usage) under cases with two different simulation fidelities.

KW - Agent-based simulation

KW - DDDAMS

KW - Fidelity

KW - Surveillance

KW - UAV

KW - UGV

UR - http://www.scopus.com/inward/record.url?scp=84881421138&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881421138&partnerID=8YFLogxK

U2 - 10.1016/j.eswa.2013.07.039

DO - 10.1016/j.eswa.2013.07.039

M3 - Article

VL - 40

SP - 7168

EP - 7183

JO - Expert Systems with Applications

JF - Expert Systems with Applications

SN - 0957-4174

IS - 18

ER -