NDLI: New Least Squares Support Vector Machines Based on Matrix Patterns

Content Provider	Springer Nature Link
Author	Wang, Zhe Chen, Songcan
Copyright Year	2007
Abstract	Support vector machine (SVM), as an effective method in classification problems, tries to find the optimal hyperplane that maximizes the margin between two classes and can be obtained by solving a constrained optimization criterion using quadratic programming (QP). This QP leads to higher computational cost. Least squares support vector machine (LS-SVM), as a variant of SVM, tries to avoid the above shortcoming and obtain an analytical solution directly from solving a set of linear equations instead of QP. Both SVM and LS-SVM operate directly on patterns represented by vector, i.e., before applying SVM or LS-SVM to a pattern, any non-vector pattern such as an image has to be first vectorized into a vector pattern by some techniques like concatenation. However, some implicit structural or local contextual information may be lost in this transformation. Moreover, as the dimension d of the weight vector in SVM or LS-SVM with the linear kernel is equal to the dimension d $_{1}$ × d $_{2}$ of the original input pattern, as a result, the higher the dimension of a vector pattern is, the more space is needed for storing it. In this paper, inspired by the method of feature extraction directly based on matrix patterns and the advantages of LS-SVM, we propose a new classifier design method based on matrix patterns, called MatLSSVM, such that the new method can not only directly operate on original matrix patterns, but also efficiently reduce memory for the weight vector (d) from d $_{1}$ × d $_{2}$ to d $_{1}$ + d $_{2}$. However like LS-SVM, MatLSSVM inherits LS-SVM’s existence of unclassifiable regions when extended to multi-class problems. Thus with the fuzzy version of LS-SVM, a corresponding fuzzy version of MatLSSVM (MatFLSSVM) is further proposed to remove unclassifiable regions effectively for multi-class problems. Experimental results on some benchmark datasets show that the proposed method is competitive in classification performance compared to LS-SVM, fuzzy LS-SVM (FLS-SVM), more-recent MatPCA and MatFLDA. In addition, more importantly, the idea used here has a possibility of providing a novel way of constructing learning model.
Starting Page	41
Ending Page	56
Page Count	16
File Format	PDF
ISSN	13704621
Journal	Neural Processing Letters
Volume Number	26
Issue Number	1
e-ISSN	1573773X
Language	English
Publisher	Kluwer Academic Publishers-Plenum Publishers
Publisher Date	2007-06-13
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Support vector machine (SVM) Least squares support vector machine (LS-SVM) Fuzzy least squares support vector machine (FLS-SVM) Vector pattern Matrix pattern Pattern recognition Operations Research/Decision Theory Electronic and Computer Engineering Artificial Intelligence (incl. Robotics) Complexity
Content Type	Text
Resource Type	Article
Subject	Neuroscience Artificial Intelligence Computer Networks and Communications Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Adaptive least squares support vector machines filter for hand tremor canceling in microsurgery

First and Second Order SMO Algorithms for LS-SVM Classifiers

Multiple birth least squares support vector machine for multi-class classification

Semisupervised Least Squares Support Vector Machine

Fast Sparse Approximation for Least Squares Support Vector Machine

Optimal Locality Regularized Least Squares Support Vector Machine via Alternating Optimization

Least Square Transduction Support Vector Machine

Estimation of Lower Limb Periodic Motions from sEMG Using Least Squares Support Vector Regression

An improved conjugate gradient scheme to the solution of least squares SVM

New Least Squares Support Vector Machines Based on Matrix Patterns

Similar Documents

Adaptive least squares support vector machines filter for hand tremor canceling in microsurgery

First and Second Order SMO Algorithms for LS-SVM Classifiers

Multiple birth least squares support vector machine for multi-class classification

Semisupervised Least Squares Support Vector Machine

Fast Sparse Approximation for Least Squares Support Vector Machine

Optimal Locality Regularized Least Squares Support Vector Machine via Alternating Optimization

Least Square Transduction Support Vector Machine

Estimation of Lower Limb Periodic Motions from sEMG Using Least Squares Support Vector Regression

An improved conjugate gradient scheme to the solution of least squares SVM

New Least Squares Support Vector Machines Based on Matrix Patterns