Adaptive pinpoint and fuel efficient Mars landing using Reinforcement Learning

Brian Gaudet, Roberto Furfaro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Future unconstrained and science-driven missions to Mars will require advanced guidance algorithms that are able to adapt to more demanding mission requirements, e.g. landing on selected locales with pinpoint accuracy while autonomously flying fuel-efficient trajectories. In this paper, we will present a novel guidance algorithm designed by applying the principles of Reinforcement Learning (RL) theory. The goal is to devise an adaptive guidance algorithm that enables robust, fuel efficient, and accurate landing without the need for off-line trajectory generation. Results from a Monte Carlo simulation campaign show that the algorithm is capable of autonomously flying trajectories that are close to the optimal minimum-fuel solutions with an accuracy that surpasses conventional Apollo-like guidance algorithms. The proposed RL-based guidance algorithm exhibits a high degree of flexibility and can easily accommodate autonomous retargeting while maintaining accuracy and fuel efficiency. Although reinforcement learning and other similar machine learning techniques have been previously applied to aerospace guidance and control problems (e.g., autonomous helicopter control), this appears, to the best of our knowledge, to be the first application of reinforcement learning to the problem of autonomous planetary landing.

Original languageEnglish (US)
Title of host publicationSpaceflight Mechanics 2012 - Advances in the Astronautical Sciences
Subtitle of host publicationProceedings of the 22nd AAS/AIAA Space Flight Mechanics Meeting
Pages1309-1328
Number of pages20
StatePublished - Dec 1 2012
Event22nd AAS/AIAA Space Flight Mechanics Meeting - Charleston, SC, United States
Duration: Feb 2 2012Feb 2 2012

Publication series

NameAdvances in the Astronautical Sciences
Volume143
ISSN (Print)0065-3438

Other

Other22nd AAS/AIAA Space Flight Mechanics Meeting
CountryUnited States
CityCharleston, SC
Period2/2/122/2/12

ASJC Scopus subject areas

  • Aerospace Engineering
  • Space and Planetary Science

Fingerprint Dive into the research topics of 'Adaptive pinpoint and fuel efficient Mars landing using Reinforcement Learning'. Together they form a unique fingerprint.

  • Cite this

    Gaudet, B., & Furfaro, R. (2012). Adaptive pinpoint and fuel efficient Mars landing using Reinforcement Learning. In Spaceflight Mechanics 2012 - Advances in the Astronautical Sciences: Proceedings of the 22nd AAS/AIAA Space Flight Mechanics Meeting (pp. 1309-1328). (Advances in the Astronautical Sciences; Vol. 143).