Loading...
Please wait, while we are loading the content...
Similar Documents
Autonomous Penetration Testing Based on Improved Deep Q-Network
| Content Provider | MDPI |
|---|---|
| Author | Zhou, Shicheng Liu, Jingju Hou, Dongdong Zhong, Xiaofeng Zhang, Yue |
| Copyright Year | 2021 |
| Description | Penetration testing is an effective way to test and evaluate cybersecurity by simulating a cyberattack. However, the traditional methods deeply rely on domain expert knowledge, which requires prohibitive labor and time costs. Autonomous penetration testing is a more efficient and intelligent way to solve this problem. In this paper, we model penetration testing as a Markov decision process problem and use reinforcement learning technology for autonomous penetration testing in large scale networks. We propose an improved deep Q-network (DQN) named NDSPI-DQN to address the sparse reward problem and large action space problem in large-scale scenarios. First, we reasonably integrate five extensions to DQN, including noisy nets, soft Q-learning, dueling architectures, prioritized experience replay, and intrinsic curiosity model to improve the exploration efficiency. Second, we decouple the action and split the estimators of the neural network to calculate two elements of action separately, so as to decrease the action space. Finally, the performance of algorithms is investigated in a range of scenarios. The experiment results demonstrate that our methods have better convergence and scaling performance. |
| Starting Page | 8823 |
| e-ISSN | 20763417 |
| DOI | 10.3390/app11198823 |
| Journal | Applied Sciences |
| Issue Number | 19 |
| Volume Number | 11 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2021-09-23 |
| Access Restriction | Open |
| Subject Keyword | Applied Sciences Industrial Engineering Penetration Testing Reinforcement Learning Cybersecurity Dqn Algorithm |
| Content Type | Text |
| Resource Type | Article |
