NDLI: Lane-changing decision method based Nash Q-learning with considering the interaction of surrounding vehicles

Content Provider	IET Digital Library
Author	Zhou, Xiaochuan Kuang, Dengming Zhao, Wanzhong Xu, Can Feng, Jian Wang, Chunyan
Abstract	In order to ensure a safer and more reliable trajectory during the lane change process, the motion decision algorithm needs to predict the possibility of different interaction behaviours with surrounding vehicles and then makes an advantageous decision. For this purpose, a motion decision method of considering the interaction of surrounding vehicles is proposed. Firstly, this study builds the payoff functions to determine the driving revenue of autonomous driving vehicles. Then, an interactive motion prediction method based on game theory is established to predict the interaction behaviours possibility and future local trajectories of surrounding vehicles. Based on this, a motion decision algorithm based on Nash Q-learning for an autonomous driving vehicle is established. With externalising the main behaviours predicted by the interactive game and the greedy optimisation method, the autonomous vehicle can determine the optimal sequence of actions and take into account the interaction of the surrounding vehicles. Finally, the motion decision in this study is validated by MATLAB in the merging lane scene, and compared with the existing rule-based lane change decision algorithm. The results show that the decision method in this study not only has superiority in safety and efficiency but also can effectively predict the interaction of surrounding vehicles.
Starting Page	2064
Ending Page	2072
Page Count	9
ISSN	1751956X
Volume Number	14
e-ISSN	17519578
Issue Number	Issue 14, Dec (2020)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/iet-its.2020.0427
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/iet-its/14/14
Journal	IET Intelligent Transport Systems
Publisher Date	2021-01-18
Access Restriction	Open
Rights Holder	© The Institution of Engineering and Technology
Subject Keyword	Advantageous Decision Autonomous Driving Vehicle Autonomous Vehicle Combinatorial Mathematics Computer Vision And Image Processing Technique Control Engineering Computing Decision Making Different Interaction Driver Information System Existing Rule-based Lane Change Decision Algorithm Game Theory Interactive Game Interactive Motion Prediction Method Lane Change Process Lane-changing Decision Method Motion Decision Algorithm Motion Decision Method Nash Q-learning Object Detection Optimisation Road Traffic Road Vehicle Traffic Engineering Computing
Content Type	Text
Resource Type	Article
Subject	Law Transportation Environmental Science Mechanical Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Coordinated decisions of discretionary lane change between connected and automated vehicles on freeways: a game theory-based lane change strategy

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

Gauss mixture hidden Markov model to characterise and model discretionary lane-change behaviours for autonomous vehicles

Cooperative bypassing algorithm for connected and autonomous vehicles in mixed traffic

Dynamic motion planner with trajectory optimisation for automated highway lane-changing driving

Lane detection method based on lane structural analysis and CNNs

Analysing driving efficiency of mandatory lane change decision for autonomous vehicles

Interaction-Aware Tracking and Lane Change Detection in Highway Scenarios Using Realistic Driver Models

Driving policies of V2X autonomous vehicles based on reinforcement learning methods

Lane-changing decision method based Nash Q-learning with considering the interaction of surrounding vehicles

Similar Documents

Coordinated decisions of discretionary lane change between connected and automated vehicles on freeways: a game theory-based lane change strategy

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

Gauss mixture hidden Markov model to characterise and model discretionary lane-change behaviours for autonomous vehicles

Cooperative bypassing algorithm for connected and autonomous vehicles in mixed traffic

Dynamic motion planner with trajectory optimisation for automated highway lane-changing driving

Lane detection method based on lane structural analysis and CNNs

Analysing driving efficiency of mandatory lane change decision for autonomous vehicles

Interaction-Aware Tracking and Lane Change Detection in Highway Scenarios Using Realistic Driver Models

Driving policies of V2X autonomous vehicles based on reinforcement learning methods

Lane-changing decision method based Nash Q-learning with considering the interaction of surrounding vehicles