Loading...
Please wait, while we are loading the content...
Similar Documents
Intelligent Smart Marine Autonomous Surface Ship Decision System Based on Improved PPO Algorithm
| Content Provider | MDPI |
|---|---|
| Author | Guan, Wei Cui, Zhewen Zhang, Xianku |
| Copyright Year | 2022 |
| Description | With the development of artificial intelligence technology, the behavior decision-making of an intelligent smart marine autonomous surface ship (SMASS) has become particularly important. This research proposed local path planning and a behavior decision-making approach based on improved Proximal Policy Optimization (PPO), which could drive an unmanned SMASS to the target without requiring any human experiences. In addition, a generalized advantage estimation was added to the loss function of the PPO algorithm, which allowed baselines in PPO algorithms to be self-adjusted. At first, the SMASS was modeled with the Nomoto model in a simulation waterway. Then, distances, obstacles, and prohibited areas were regularized as rewards or punishments, which were used to judge the performance and manipulation decisions of the vessel Subsequently, improved PPO was introduced to learn the action–reward model, and the neural network model after training was used to manipulate the SMASS’s movement. To achieve higher reward values, the SMASS could find an appropriate path or navigation strategy by itself. After a sufficient number of rounds of training, a convincing path and manipulation strategies would likely be produced. Compared with the proposed approach of the existing methods, this approach is more effective in self-learning and continuous optimization and thus closer to human manipulation. |
| Starting Page | 5732 |
| e-ISSN | 14248220 |
| DOI | 10.3390/s22155732 |
| Journal | Sensors |
| Issue Number | 15 |
| Volume Number | 22 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2022-07-31 |
| Access Restriction | Open |
| Subject Keyword | Sensors Marine Engineering Decision-making Deep Reinforcement Learning Nomoto Ppo Smass |
| Content Type | Text |
| Resource Type | Article |
