Integrated guidance and control for pinpoint mars landing using reinforcement learning

Brian Gaudet, Richard Linares, Roberto Furfaro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Future Mars missions will require advanced guidance, navigation, and control algorithms for the powered descent phase in order to target specific surface locations and achieve pinpoint accuracy (landing error ellipse < 5m radius). This requires both a navigation system capable of estimating the lander’s state in real-time and a guidance and control system that can map the estimated lander state to body-frame actuator commands. In this paper we present a novel integrated guidance and control algorithm designed by applying the principles of reinforcement learning theory. The key innovation is the use of reinforcement learning to learn a policy mapping the lander’s estimated state directly to actuator commands, with the policy resulting in accurate and fuel efficient trajectories. Specifically, we use proximal policy optimization, a policy gradient method, to learn the policy. We present simulation results demonstrating the guidance and control system’s performance in a 6-DOF simulation environment, and demonstrate robustness to noise and system parameter uncertainty.

Original languageEnglish (US)
Title of host publicationAAS/AIAA Astrodynamics Specialist Conference, 2018
EditorsBelinda G. Marchand, Ryan M. Weisman, Brandon A. Jones, Puneet Singla
PublisherUnivelt Inc.
Pages3135-3154
Number of pages20
ISBN (Print)9780877036579
StatePublished - Jan 1 2018
EventAAS/AIAA Astrodynamics Specialist Conference, 2018 - Montreal, Canada
Duration: Aug 19 2018Aug 23 2018

Publication series

NameAdvances in the Astronautical Sciences
Volume167
ISSN (Print)0065-3438

Conference

ConferenceAAS/AIAA Astrodynamics Specialist Conference, 2018
CountryCanada
CityMontreal
Period8/19/188/23/18

ASJC Scopus subject areas

  • Aerospace Engineering
  • Space and Planetary Science

Fingerprint Dive into the research topics of 'Integrated guidance and control for pinpoint mars landing using reinforcement learning'. Together they form a unique fingerprint.

  • Cite this

    Gaudet, B., Linares, R., & Furfaro, R. (2018). Integrated guidance and control for pinpoint mars landing using reinforcement learning. In B. G. Marchand, R. M. Weisman, B. A. Jones, & P. Singla (Eds.), AAS/AIAA Astrodynamics Specialist Conference, 2018 (pp. 3135-3154). (Advances in the Astronautical Sciences; Vol. 167). Univelt Inc..