NDLI: Generalized derivatives and nonsmooth optimization, a finite dimensional tour

Please wait, while we are loading the content...

Generalized derivatives and nonsmooth optimization, a finite dimensional tour

Content Provider	Springer Nature Link
Author	Dutta, Joydeep
Copyright Year	2005
Abstract	During the early 1960’s there was a growing realization that a large number of optimization problems which appeared in applications involved minimization of non-differentiable functions. One of the important areas where such problems appeared was optimal control. The subject of nonsmooth analysis arose out of the need to develop a theory to deal with the minimization of nonsmooth functions. The first impetus in this direction came with the publication of Rockafellar’s seminal work titledConvex Analysis which was published by the Princeton University Press in 1970. It would be impossible to overstate the impact of this book on the development of the theory and methods of optimization. It is also important to note that a large part of convex analysis was already developed by Werner Fenchel nearly twenty years earlier and was circulated through his mimeographed lecture notes titledConvex Cones, Sets and Functions, Princeton University, 1951. In this article we trace the dramatic development of nonsmooth analysis and its applications to optimization in finite dimensions. Beginning with the fundamentals of convex optimization we quickly move over to the path breaking work of Clarke which extends the domain of nonsmooth analysis from convex to locally Lipschitz functions. Clarke was the second doctoral student of R.T. Rockafellar. We discuss the notions of Clarke directional derivative and the Clarke generalized gradient and also the relevant calculus rules and applications to optimization. While discussing locally Lipschitz optimization we also try to blend in the computational aspects of the theory wherever possible. This is followed by a discussion of the geometry of sets with nonsmooth boundaries. The approach to develop the notion of the normal cone to an arbitrary set is sequential in nature. This approach does not rely on the standard techniques of convex analysis. The move away from convexity was pioneered by Mordukhovich and later culminated in the monographVariational Analysis by Rockafellar and Wets. The approach of Mordukhovich relied on a nonconvex separation principle called theextremal principle while that of Rockafellar and Wets relied on various convergence notions developed to suit the needs of optimization. We then move on to a parallel development in nonsmooth optimization due to Demyanov and Rubinov called Quasidifferentiable optimization. They study the class of directionally differentiable functions whose directional derivatives can be represented as a difference of two sublinear functions. On other hand the directional derivative of a convex function and also the Clarke directional derivatives are sublinear functions of the directions.Thus it was thought that the most useful generalizations of directional derivatives must be a sublinear function of the directions. Thus Demyanov and Rubinov made a major conceptual change in nonsmooth optimization. In this section we define the notion of a quasidifferential which is a pair of convex compact sets. We study some calculus rules and their applications to optimality conditions. We also study the interesting notion of Demyanov difference between two sets and their applications to optimization. In the last section of this paper we study some second-order tools used in nonsmooth analysis and try to see their relevance in optimization. In fact it is important to note that unlike the classical case, the second-order theory of nonsmoothness is quite complicated in the sense that there are many approaches to it. However we have chosen to describe those approaches which can be developed from the first order nonsmooth tools discussed here. We shall present three different approaches, highlight the second order calculus rules and their applications to optimization.
Starting Page	185
Ending Page	279
Page Count	95
File Format	PDF
ISSN	11345764
Journal	Top
Volume Number	13
Issue Number	2
e-ISSN	18638279
Language	English
Publisher	Springer-Verlag
Publisher Date	2005-01-01
Publisher Institution	Spanish Society of Statistics and Operations Research
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Convex optimization nonsmooth analysis nonsmooth optimization set-valued maps variational analysis mathematical programming nonconvex programming nonlinear programming optimality conditions second order conditions tangent cones normal cones generalized derivatives subdifferentials Nonsmooth analysis Set-valued and variational analysis Convex programming Nonconvex programming, global optimization Nonlinear programming Optimality conditions, duality Optimization and variational techniques Set-valued functions Optimization Statistics for Business/Economics/Mathematical Finance/Insurance Industrial and Production Engineering Game Theory/Mathematical Methods Operations Research/Decision Theory
Content Type	Text
Resource Type	Article
Subject	Statistics and Probability Discrete Mathematics and Combinatorics Management Science and Operations Research Information Systems and Management Modeling and Simulation

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Subdifferentials at infinity and applications in optimization

Clarke's tangent cones, subgradients, optimality conditions and the Lipschitzness at infinity

Epi-convergent Smoothing with Applications to Convex Composite Functions

Higher-Order Optimality Conditions and Higher-Order Tangent Sets

ɛ-Subdifferentials of Set-valued Maps and ɛ-Weak Pareto Optimality for Multiobjective Optimization

The Boosted Double-Proximal Subgradient Algorithm for Nonconvex Optimization

On Weak Subdifferentials, Directional Derivatives, and Radial Epiderivatives for Nonconvex Functions

First-order optimality conditions in set-valued optimization

The Lipschitzianity of convex vector and set-valued functions

Generalized derivatives and nonsmooth optimization, a finite dimensional tour

Similar Documents

Subdifferentials at infinity and applications in optimization

Clarke's tangent cones, subgradients, optimality conditions and the Lipschitzness at infinity

Epi-convergent Smoothing with Applications to Convex Composite Functions

Higher-Order Optimality Conditions and Higher-Order Tangent Sets

ɛ-Subdifferentials of Set-valued Maps and ɛ-Weak Pareto Optimality for Multiobjective Optimization

The Boosted Double-Proximal Subgradient Algorithm for Nonconvex Optimization

On Weak Subdifferentials, Directional Derivatives, and Radial Epiderivatives for Nonconvex Functions

First-order optimality conditions in set-valued optimization

The Lipschitzianity of convex vector and set-valued functions

Generalized derivatives and nonsmooth optimization, a finite dimensional tour