A Reinforcement Learning Approach to Spacecraft Trajectory Optimization
Author | : Daniel S. Kolosa |
Publisher | : |
Total Pages | : 69 |
Release | : 2019 |
ISBN-10 | : OCLC:1176349845 |
ISBN-13 | : |
Rating | : 4/5 (45 Downloads) |
Download or read book A Reinforcement Learning Approach to Spacecraft Trajectory Optimization written by Daniel S. Kolosa and published by . This book was released on 2019 with total page 69 pages. Available in PDF, EPUB and Kindle. Book excerpt: This dissertation explores a novel method of solving low-thrust spacecraft targeting problems using reinforcement learning. A reinforcement learning algorithm based on Deep Deterministic Policy Gradients was developed to solve low-thrust trajectory optimization problems. The algorithm consists of two neural networks, an actor network and a critic network. The actor approximates a thrust magnitude given the current spacecraft state expressed as a set of orbital elements. The critic network evaluates the action taken by the actor based on the state and action taken. Three different types of trajectory problems were solved, a generalized orbit change maneuver, a semimajor axis change maneuver, and an inclination change maneuver. When training the algorithm in a simulated space environment, it was able to solve both the generalized orbit change and semimajor axis change maneuvers with no prior knowledge of the environment’s dynamics. The robustness of the algorithm was tested on an inclination change maneuver with a randomized set of initial states. After training, the algorithm was able to successfully generalize and solve new inclination changes that it has not seen before. This method has potential future applications in developing more complex low-thrust maneuvers or real-time autonomous spaceflight control.