NDLI: Model selection in multivariate adaptive regression splines (MARS) using information complexity as the fitness function

Content Provider	Springer Nature Link
Author	Kartal Koc, Elcin Bozdogan, Hamparsum
Copyright Year	2014
Abstract	This paper introduces information-theoretic measure of complexity (ICOMP) criterion for model selection in multivariate adaptive regression splines (MARS) to tradeoff efficiently between how well the model fits the data and the model complexity. As is well known, MARS is a popular nonparametric regression technique used to study the nonlinear relationship between a response variable and the set of predictors with the help of piecewise linear or cubic splines as basis functions. A critical aspect in determining the form of the nonparametric regression model during the MARS strategy is the evaluation of portfolio of submodels to select the best submodel with the appropriate number of knots over subset of predictors. In the usual regression modeling, when a large number of predictor variables are present in the model, and there is no precise information about the exact functional relationships among the variables, many model selection criteria still overfit the model. In this paper, to find the simplest model that balances the overfitting and underfitting for the model, ICOMP is proposed as a powerful model selection criterion for MARS modeling. Here, the model complexity is treated with respect to the interdependency of parameter estimates, as well as the number of free parameters in the model. We develop and study the performance of ICOMP along with several most popular model selection criteria such as Akaike’s information criterion, Schwarz’s Bayesian information criterion and generalized cross-validation in MARS modeling to select the best subset models. We provide two Monte Carlo simulation examples and a real benchmark example to demonstrate the utility and versatility of the proposed model selection approach to determine best functional form of the predictive model. Our numerical examples show that ICOMP provides a general model selection criterion with an insight to the interdependencies and/or correlational structure between parameter estimates in the selected model. This new approach can also be applicable to many complex statistical modeling problems.
Starting Page	35
Ending Page	58
Page Count	24
File Format	PDF
ISSN	08856125
Journal	Machine Learning
Volume Number	101
Issue Number	1-3
e-ISSN	15730565
Language	English
Publisher	Springer US
Publisher Date	2014-06-27
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Model selection Multivariate adaptive regression Splines (MARS) Nonparametric regression Information complexity Artificial Intelligence (incl. Robotics) Control, Robotics, Mechatronics Computing Methodologies Simulation and Modeling Language Translation and Linguistics
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A computational approach to nonparametric regression: bootstrapping CMARS method

Boosted multivariate trees for longitudinal data

Mass estimation

Using causal discovery for feature selection in multivariate numerical time series

Guest editorial: model selection and optimization in machine learning

Model selection in reinforcement learning

Tree-structured model diagnostics for linear regression

Consensus hashing

Regression conformal prediction with random forests

Model selection in multivariate adaptive regression splines (MARS) using information complexity as the fitness function

Similar Documents

A computational approach to nonparametric regression: bootstrapping CMARS method

Boosted multivariate trees for longitudinal data

Mass estimation

Using causal discovery for feature selection in multivariate numerical time series

Guest editorial: model selection and optimization in machine learning

Model selection in reinforcement learning

Tree-structured model diagnostics for linear regression

Consensus hashing

Regression conformal prediction with random forests

Model selection in multivariate adaptive regression splines (MARS) using information complexity as the fitness function