NDLI: Prioritised experience replay based on sample optimisation

Please wait, while we are loading the content...

Biosurface and Biotribology

CAAI Transactions on Intelligence Technology

CIRED - Open Access Proceedings Journal

Chinese Journal of Electronics

Cognitive Computation and Systems

Electronics Letters

Energy Conversion and Economics

Engineering & Technology

Engineering Biology

Healthcare Technology Letters

IET Circuits, Devices & Systems

IET Collaborative Intelligent Manufacturing

IET Communications

IET Computer Vision

IET Computers & Digital Techniques

IET Control Theory & Applications

IET Cyber-Physical Systems: Theory & Applications

IET Cyber-Systems and Robotics

IET Electric Power Applications

IET Electrical Systems in Transportation

IET Energy Systems Integration

IET Generation, Transmission & Distribution

IET Image Processing

IET Information Security

IET Intelligent Transport Systems

IET Microwaves, Antennas & Propagation

IET Nanobiotechnology

IET Nanodielectrics

IET Optoelectronics

IET Power Electronics

IET Quantum Communication

IET Radar, Sonar & Navigation

IET Renewable Power Generation

IET Science, Measurement & Technology

IET Signal Processing

IET Smart Cities

IET Systems Biology

IET Wireless Sensor Systems

Micro & Nano Letters

The Journal of Engineering

Volume 2020 : Issue 14, Nov

Volume 2020 : Issue 13, Jul

Adversarial semi-supervised learning method for printed circuit board unknown defect detection

Analysis of partial discharge signals from generator propagation in excitation transformer by EMTP

Attribute reduction based on improving DIT in interval-valued ordered information system

Balancing large margin nearest neighbours for imbalanced data

Bitcoin price forecasting method based on CNN-LSTM hybrid neural network model

Breast mass classification method based on convolutional neural networks

Chinese cursive character detection method

Collaborative representation-based locality preserving projections for image classification

Construction of knowledge graph of maritime dangerous goods based on IMDG code

Deep and CNN fusion method for binaural sound source localisation

Deep learning method for rain streaks removal from single image

Deep learning-based household electric energy consumption forecasting

Design and evaluation of a large-scale magnetically navigated robot scheduling system

Design and implementation of real-time monitoring system for atmospheric particles based on a cloud platform

Design and implementation path of intelligent transportation information system based on artificial intelligence technology

Design and improvement of the pruning algorithm of the Chinese chess in the computer games

Design of a collaborative monitoring system for hydroelectric generating sets and its application

Digital filter based on chaos theory used for removing narrow-frequency-band noise in PD signals

Discriminative sparsity preserving projection via global constraint for unconstrained face recognition

Double threshold construction method for attribute-induced three-way concept lattice in incomplete fuzzy formal context

EXplainable AI (XAI) approach to image captioning

Effectiveness analysis of ship formation air defence based on deep belief network

Effects of environmental feature selection on end-to-end vehicle steering controller

Efficient generative model for motion deblurring

Fast pedestrian detection method based on BING

Fault diagnosis method for attached lifting scaffold based on support vector machine

Feature selection in deterministic policy gradient

Graph embedded incomplete multi-view clustering method with proximity relation estimation

Grid cell field reconstruction based on rat hippocampal cognitive mechanism and hebbian plasticity

HRIPCB: a challenging dataset for PCB defects detection and classification

Human body posture recognition algorithm for still images

Improved grey wolf optimisation algorithms

L1-norm based discriminant manifold learning for multi-label image classification

LeNet-5 improvement based on FPGA acceleration

Learning a unified tracking-and-detection framework with distractor-aware constraint for visual object tracking

Making up the shortages of the Bayes classifier by the maximum mutual information classifier

Method of social network analysis and visualisation based on reviews

Micro-blog sentiment classification using Doc2vec + SVM model with data purification

Natural scene text detection based on multiscale connectionist text proposal network

Necklace: a novel long text detection model

Object detection method on station logo with single shot multi-box detector

Observer-based iterative learning control for linear time-varying systems using LMI

One intelligent framework for screening and intervention of Mild Cognitive Impairment (MCI)

Parameter analysis on multi-factorial evolutionary algorithm

Personalised recommendation algorithm based on covariance

Prioritised experience replay based on sample optimisation

Recommendation method of smart TV programs reflecting content consumption concentration calculation

Recurrent spatial transformer network for high-accuracy image registration in moving PCB defect detection

Research of interval reduction in variable precision rough set

Research on 3D printing service model for innovation, entrepreneurship, and universal applications

Research on CNN + LSTM user intention classification based on multi-granularity features of texts

Research on image feature matching algorithm based on feature optical flow and corner feature

Research on integrated computer game algorithm for dots and boxes

Research on wire rope wear detection based on computer vision

SOC estimation algorithm of power lithium battery based on AFSA-BP neural network

Scene recognition under special traffic conditions based on deep multi-task learning

Semi-supervised long short-term memory for human action recognition

Shift, rotation and scale invariant optical fingerprint verification system with double random phase encoding

Single-shot detector with enriched semantics for PCB tiny defect detection

Study on intelligent control of yaw stability of electric vehicle with in-wheel motors

Synchronous multi-kernel iterative dual heuristic programming with ℓ2-regularisation

Three IQs of AI systems and their testing methods

Three-dimensional obstacle avoidance for UAV based on reinforcement learning and RealSense

Three-way decision of target threat decision making based on adaptive threshold algorithms

Traffic light and moving object detection for a guide-dog robot

Unknown defect detection for printed circuit board based on multi-scale deep similarity measure method

Updating knowledge in multigranulation decision-theoretic rough set model based on decision support degree

Using PCAand one-stage detectors for real-time forest fire detection

Using convolutional neural network for diabetes mellitus diagnosis based on tongue images

Using normal dictionaries to extract multiple semantic relationships

VR-based dataset for autonomous-driving system

Vision-based map building and path planning method in unmanned air/ground vehicle cooperative systems

Visual information classification technique of Chinese tourism government portals

Visual saliency mechanism-based object recognition with high-resolution remote-sensing images

Volume 2020 : Issue 12, Dec

Volume 2020 : Issue 11, Nov

Volume 2020 : Issue 10, Oct

Volume 2020 : Issue 9, Sep

Volume 2020 : Issue 8, Aug

Volume 2020 : Issue 7, Jul

Volume 2020 : Issue 6, Jun

Volume 2020 : Issue 5, May

Volume 2020 : Issue 4, Apr

Volume 2020 : Issue 3, Mar

Volume 2020 : Issue 2, Feb

Volume 2020 : Issue 1, Jan

Prioritised experience replay based on sample optimisation

Content Provider	IET Digital Library
Author	Wang, Xuesong Xiang, Haopeng Cheng, Yuhu Yu, Qiang
Abstract	The sample-based prioritised experience replay proposed in this study is aimed at how to select samples to the experience replay, which improves the training speed and increases the reward return. In the traditional deep Q-networks (DQNs), it is subjected to random pickup of samples into the experience replay. However, the effect of each sample is different for the training process of agent. A better sampling method will make the agent training more effective. Therefore, when selecting a sample to the experience replay, the authors first allow the agent to learn randomly through the sample optimisation network, and take the average value returned after each study, so that the mean value is used as a threshold for selecting samples to the experience replay. Second, on the basis of sample optimisation, the authors increase the priority update and use the idea of reward-shaping to give additional reward values to the returns of certain samples, which speeds up the agent training. Compared with traditional DQN and the prioritised experience replay DQN, this study uses OpenAI Gym as platform to improve agent learning efficiency.
Starting Page	298
Ending Page	302
Page Count	5
Volume Number	2020
e-ISSN	20513305
Issue Number	Issue 13, Jul (2020)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/joe/2020/13
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/joe.2019.1204
Journal	The Journal of Engineering
Publisher	The Institution of Engineering and Technology
Publisher Date	2020-01-13
Access Restriction	Open
Rights License	Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0/)
Subject Keyword	Agent Training Deep Q-networks DQN Learning in AI Neural Computing Technique Neural Nets Optimisation Optimisation Technique Prioritised Experience Replay Sample Optimisation Network Sample-based Prioritised Experience Replay Sampling Method Statistics
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in