Integrated guidance for Mars entry and powered descent using reinforcement learning and pseudospectral method

Xiuqiang Jiang, Shuang Li, Roberto Furfaro

Research output: Contribution to journalArticle

Abstract

Traditional studies on Mars entry, descent, and landing usually take a divide-and-conquer approach where each phase is investigated separately. This paper proposed a new approach to achieve optimal integrated guidance for mid-lift high-mass Mars entry and powered descent. First, optimal Mars atmospheric entry and optimal powered descent are respectively modeled. Second, optimal handover problem is formulated to integrate the optimal Mars entry and powered descent problems in a collaborative optimization manner. Third, hp-adaptive pseudospectral method is employed to capture optimal entry guidance and propellant-optimal powered descent guidance. Reinforcement learning methodology is adopted to obtain the optimal handover, according to a large amount of trial results obtained from solving optimal Mars entry and powered descent problems. Finally, numerical simulations verified the optimality, robustness, and accuracy of the proposed technique through comparing with successive convexification approach under the nominal conditions and uncertainties, and the comparison results demonstrated the significant benefit of the integrated optimal guidance.

Original languageEnglish (US)
JournalActa Astronautica
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Reinforcement learning
Propellants
Landing
Computer simulation
Uncertainty

Keywords

  • Integrated guidance
  • Mars entry
  • Powered descent
  • Pseudospectral method
  • Reinforcement learning

ASJC Scopus subject areas

  • Aerospace Engineering

Cite this

Integrated guidance for Mars entry and powered descent using reinforcement learning and pseudospectral method. / Jiang, Xiuqiang; Li, Shuang; Furfaro, Roberto.

In: Acta Astronautica, 01.01.2019.

Research output: Contribution to journalArticle

@article{8482016996e645cab6a0ad963789bb60,
title = "Integrated guidance for Mars entry and powered descent using reinforcement learning and pseudospectral method",
abstract = "Traditional studies on Mars entry, descent, and landing usually take a divide-and-conquer approach where each phase is investigated separately. This paper proposed a new approach to achieve optimal integrated guidance for mid-lift high-mass Mars entry and powered descent. First, optimal Mars atmospheric entry and optimal powered descent are respectively modeled. Second, optimal handover problem is formulated to integrate the optimal Mars entry and powered descent problems in a collaborative optimization manner. Third, hp-adaptive pseudospectral method is employed to capture optimal entry guidance and propellant-optimal powered descent guidance. Reinforcement learning methodology is adopted to obtain the optimal handover, according to a large amount of trial results obtained from solving optimal Mars entry and powered descent problems. Finally, numerical simulations verified the optimality, robustness, and accuracy of the proposed technique through comparing with successive convexification approach under the nominal conditions and uncertainties, and the comparison results demonstrated the significant benefit of the integrated optimal guidance.",
keywords = "Integrated guidance, Mars entry, Powered descent, Pseudospectral method, Reinforcement learning",
author = "Xiuqiang Jiang and Shuang Li and Roberto Furfaro",
year = "2019",
month = "1",
day = "1",
doi = "10.1016/j.actaastro.2018.12.033",
language = "English (US)",
journal = "Acta Astronautica",
issn = "0094-5765",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Integrated guidance for Mars entry and powered descent using reinforcement learning and pseudospectral method

AU - Jiang, Xiuqiang

AU - Li, Shuang

AU - Furfaro, Roberto

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Traditional studies on Mars entry, descent, and landing usually take a divide-and-conquer approach where each phase is investigated separately. This paper proposed a new approach to achieve optimal integrated guidance for mid-lift high-mass Mars entry and powered descent. First, optimal Mars atmospheric entry and optimal powered descent are respectively modeled. Second, optimal handover problem is formulated to integrate the optimal Mars entry and powered descent problems in a collaborative optimization manner. Third, hp-adaptive pseudospectral method is employed to capture optimal entry guidance and propellant-optimal powered descent guidance. Reinforcement learning methodology is adopted to obtain the optimal handover, according to a large amount of trial results obtained from solving optimal Mars entry and powered descent problems. Finally, numerical simulations verified the optimality, robustness, and accuracy of the proposed technique through comparing with successive convexification approach under the nominal conditions and uncertainties, and the comparison results demonstrated the significant benefit of the integrated optimal guidance.

AB - Traditional studies on Mars entry, descent, and landing usually take a divide-and-conquer approach where each phase is investigated separately. This paper proposed a new approach to achieve optimal integrated guidance for mid-lift high-mass Mars entry and powered descent. First, optimal Mars atmospheric entry and optimal powered descent are respectively modeled. Second, optimal handover problem is formulated to integrate the optimal Mars entry and powered descent problems in a collaborative optimization manner. Third, hp-adaptive pseudospectral method is employed to capture optimal entry guidance and propellant-optimal powered descent guidance. Reinforcement learning methodology is adopted to obtain the optimal handover, according to a large amount of trial results obtained from solving optimal Mars entry and powered descent problems. Finally, numerical simulations verified the optimality, robustness, and accuracy of the proposed technique through comparing with successive convexification approach under the nominal conditions and uncertainties, and the comparison results demonstrated the significant benefit of the integrated optimal guidance.

KW - Integrated guidance

KW - Mars entry

KW - Powered descent

KW - Pseudospectral method

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=85059677106&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059677106&partnerID=8YFLogxK

U2 - 10.1016/j.actaastro.2018.12.033

DO - 10.1016/j.actaastro.2018.12.033

M3 - Article

AN - SCOPUS:85059677106

JO - Acta Astronautica

JF - Acta Astronautica

SN - 0094-5765

ER -