Nonmonotone Enhanced Proximal DC Algorithms for a Class of Structured Nonsmooth DC Programming

Zhaosong Lu, Zirui Zhou

Research output: Contribution to journalJournal articlepeer-review

19 Citations (Scopus)
88 Downloads (Pure)

Abstract

In this paper we consider a class of structured nonsmooth difference-of-convex (DC) minimization in which the first convex component is the sum of a smooth and a nonsmooth function while the second convex component is the supremum of finitely many convex smooth functions. The existing methods for this problem usually have weak convergence guarantees or exhibit slow convergence. Due to this, we propose two nonmonotone enhanced proximal DC algorithms for solving this problem. For possible acceleration, one uses a nonmonotone line-search scheme in which the associated Lipschitz constant is adaptively approximated by some local curvature information of the smooth function in the first convex component, and the other employs an extrapolation scheme. It is shown that every accumulation point of the solution sequence generated by them is a D-stationary point of the problem. These methods may, however, become inefficient when the number of convex smooth functions in defining the second convex component is large. To remedy this issue, we propose randomized counterparts for them and show that every accumulation point of the generated solution sequence is a D-stationary point of the problem almost surely. Some preliminary numerical experiments are conducted to demonstrate the efficiency of the proposed algorithms.

Original languageEnglish
Pages (from-to)2725-2752
Number of pages28
JournalSIAM Journal on Optimization
Volume29
Issue number4
DOIs
Publication statusPublished - 31 Oct 2019

Scopus Subject Areas

  • Software
  • Theoretical Computer Science

User-Defined Keywords

  • D-stationary point
  • Extrapolation
  • Nonmonotone line search
  • Nonsmooth DC programming
  • Proximal DCA

Fingerprint

Dive into the research topics of 'Nonmonotone Enhanced Proximal DC Algorithms for a Class of Structured Nonsmooth DC Programming'. Together they form a unique fingerprint.

Cite this