A Unified Framework for Uniform Signal Recovery in Nonlinear Generative Compressed Sensing

Junren Chen*, Jonathan Scarlett, Michael K. Ng, Zhaoqiang Liu*

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

6 Citations (Scopus)

Abstract

In generative compressed sensing (GCS), we want to recover a signal x ∈ Rn from m measurements (m ≪ n) using a generative prior x ∈ G(Bk2(r)), where G is typically an L-Lipschitz continuous generative model and Bk2(r) represents the radius-r ℓ2-ball in Rk. Under nonlinear measurements, most prior results are non-uniform, i.e., they hold with high probability for a fixed x rather than for all x simultaneously. In this paper, we build a unified framework to derive uniform recovery guarantees for nonlinear GCS where the observation model is nonlinear and possibly discontinuous or unknown. Our framework accommodates GCS with 1-bit/uniformly quantized observations and single index models as canonical examples. Specifically, using a single realization of the sensing ensemble and generalized Lasso, all x ∈ G(Bk2(r)) can be recovered up to an ℓ2-error at most ϵ using roughly Õ(k/ϵ2) samples, with omitted logarithmic factors typically being dominated by log L. Notably, this almost coincides with existing non-uniform guarantees up to logarithmic factors, hence the uniformity costs very little. As part of our technical contributions, we introduce the Lipschitz approximation to handle discontinuous observation models. We also develop a concentration inequality that produces tighter bounds for product processes whose index sets have low metric entropy. Experimental results are presented to corroborate our theory.

Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 36 (NeurIPS 2023)
EditorsA. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine
PublisherNeural Information Processing Systems Foundation
Pages1-29
Number of pages29
ISBN (Print)9781713899921
Publication statusPublished - Dec 2023
Event37th Conference on Neural Information Processing Systems, NeurIPS 2023 - Ernest N. Morial Convention Center, New Orleans, United States
Duration: 10 Dec 202316 Dec 2023
https://proceedings.neurips.cc/paper_files/paper/2023 (Conference Paper Search)
https://openreview.net/group?id=NeurIPS.cc/2023/Conference#tab-accept-oral (Conference Paper Search)
https://neurips.cc/Conferences/2023 (Conference Website)

Publication series

NameAdvances in Neural Information Processing Systems
Volume36
ISSN (Print)1049-5258

Conference

Conference37th Conference on Neural Information Processing Systems, NeurIPS 2023
Country/TerritoryUnited States
CityNew Orleans
Period10/12/2316/12/23
Internet address

Fingerprint

Dive into the research topics of 'A Unified Framework for Uniform Signal Recovery in Nonlinear Generative Compressed Sensing'. Together they form a unique fingerprint.

Cite this