Loading...
Please wait, while we are loading the content...
Similar Documents
Improved Relief Weight Feature Selection Algorithm Based on Relief and Mutual Information
| Content Provider | MDPI |
|---|---|
| Author | Wang, Hong Bin Wang, Pengming Deng, Shengchun Li, Haoran |
| Copyright Year | 2021 |
| Description | As the classic feature selection algorithm, the Relief algorithm has the advantages of simple computation and high efficiency, but the algorithm itself is limited to only dealing with binary classification problems, and the comprehensive distinguishing ability of the feature subsets composed of the former K features selected by the Relief algorithm is often redundant, as the algorithm cannot select the ideal feature subset. When calculating the correlation and redundancy between characteristics by mutual information, the computation speed is slow because of the high computational complexity and the method’s need to calculate the probability density function of the corresponding features. Aiming to solve the above problems, we first improve the weight of the Relief algorithm, so that it can be used to evaluate a set of candidate feature sets. Then we use the improved joint mutual information evaluation function to replace the basic mutual information computation and solve the problem of computation speed and correlation, and redundancy between features. Finally, a compound correlation feature selection algorithm based on Relief and joint mutual information is proposed using the evaluation function and the heuristic sequential forward search strategy. This algorithm can effectively select feature subsets with small redundancy and strong classification characteristics, and has the excellent characteristics of faster calculation speed. |
| Starting Page | 228 |
| e-ISSN | 20782489 |
| DOI | 10.3390/info12060228 |
| Journal | Information |
| Issue Number | 6 |
| Volume Number | 12 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2021-05-27 |
| Access Restriction | Open |
| Subject Keyword | Information Artificial Intelligence Industrial Engineering Feature Selection Relief Mutual Information Mrmr |
| Content Type | Text |
| Resource Type | Article |
