Actor-critic reinforcement learning approach to relative motion guidance in near-rectilinear orbit

Andrea Scorsoglio, Roberto Furfaro, Richard Linares, Mauro Massari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper aims a developing a new feedback guidance algorithm for docking maneuvers in the cislunar environment. In particular, the goal is to create an algorithm that is lightweight, closed-loop and capable of taking path constraints into account. The problem has been solved starting from the well know Zero-Effort-Miss/Zero-Effort-Velocity (ZEM/ZEV) guidance using machine learning to improve its capabilities and widen its field of application. The algorithm has been developed in the circular restricted three body problem (CRTBP) framework for Near Rectilinear Orbits (NRO) in the Earth-Moon system but the results can be easily generalized to many more guidance problems. The results are satisfactory and show that reinforcement learning can be effectively used to solve constrained relative spacecraft guidance problems.

Original languageEnglish (US)
Title of host publicationSpaceflight Mechanics 2019
EditorsFrancesco Topputo, Andrew J. Sinclair, Matthew P. Wilkins, Renato Zanetti
PublisherUnivelt Inc.
Pages1737-1756
Number of pages20
ISBN (Print)9780877036593
Publication statusPublished - Jan 1 2019
Event29th AAS/AIAA Space Flight Mechanics Meeting, 2019 - Maui, United States
Duration: Jan 13 2019Jan 17 2019

Publication series

NameAdvances in the Astronautical Sciences
Volume168
ISSN (Print)0065-3438

Conference

Conference29th AAS/AIAA Space Flight Mechanics Meeting, 2019
CountryUnited States
CityMaui
Period1/13/191/17/19

    Fingerprint

ASJC Scopus subject areas

  • Aerospace Engineering
  • Space and Planetary Science

Cite this

Scorsoglio, A., Furfaro, R., Linares, R., & Massari, M. (2019). Actor-critic reinforcement learning approach to relative motion guidance in near-rectilinear orbit. In F. Topputo, A. J. Sinclair, M. P. Wilkins, & R. Zanetti (Eds.), Spaceflight Mechanics 2019 (pp. 1737-1756). [AAS 19-441] (Advances in the Astronautical Sciences; Vol. 168). Univelt Inc..