Nonconvex and Nonsmooth Optimization with Generalized Orthogonality Constraints: An Approximate Augmented Lagrangian Method

Hong Zhu, Xiaowei Zhang, Delin Chu, Lizhi Liao*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)
49 Downloads (Pure)

Abstract

Nonconvex and nonsmooth optimization problems with linear equation and generalized orthogonality constraints have wide applications. These problems are difficult to solve due to nonsmooth objective function and nonconvex constraints. In this paper, by introducing an extended proximal alternating linearized minimization (EPALM) method, we propose a framework based on the augmented Lagrangian scheme (EPALMAL). We also show that the EPALMAL method has global convergence in the sense that every bounded sequence generated by the EPALMAL method has at least one convergent subsequence that converges to the Karush–Kuhn–Tucker point of the original problem. Experiments on a variety of applications, including compressed modes and multivariate data analysis, have demonstrated that the proposed method is noticeably efficient and achieves comparable performance with existing methods.

Original languageEnglish
Pages (from-to)331-372
Number of pages42
JournalJournal of Scientific Computing
Volume72
Issue number1
Early online date20 Jan 2017
DOIs
Publication statusPublished - Jul 2017

Scopus Subject Areas

  • Software
  • Theoretical Computer Science
  • Numerical Analysis
  • Engineering(all)
  • Computational Theory and Mathematics
  • Computational Mathematics
  • Applied Mathematics

User-Defined Keywords

  • Augmented Lagrangian scheme
  • Generalized orthogonality constraints
  • Linearization
  • Proximal alternating minimization method

Fingerprint

Dive into the research topics of 'Nonconvex and Nonsmooth Optimization with Generalized Orthogonality Constraints: An Approximate Augmented Lagrangian Method'. Together they form a unique fingerprint.

Cite this