Abstract
In generative compressed sensing (GCS), we want to recover a signal x∗ ∈ Rn from m measurements (m ≪ n) using a generative prior x∗ ∈ G(Bk2(r)), where G is typically an L-Lipschitz continuous generative model and Bk2(r) represents the radius-r ℓ2-ball in Rk. Under nonlinear measurements, most prior results are non-uniform, i.e., they hold with high probability for a fixed x∗ rather than for all x∗ simultaneously. In this paper, we build a unified framework to derive uniform recovery guarantees for nonlinear GCS where the observation model is nonlinear and possibly discontinuous or unknown. Our framework accommodates GCS with 1-bit/uniformly quantized observations and single index models as canonical examples. Specifically, using a single realization of the sensing ensemble and generalized Lasso, all x∗ ∈ G(Bk2(r)) can be recovered up to an ℓ2-error at most ϵ using roughly Õ(k/ϵ2) samples, with omitted logarithmic factors typically being dominated by log L. Notably, this almost coincides with existing non-uniform guarantees up to logarithmic factors, hence the uniformity costs very little. As part of our technical contributions, we introduce the Lipschitz approximation to handle discontinuous observation models. We also develop a concentration inequality that produces tighter bounds for product processes whose index sets have low metric entropy. Experimental results are presented to corroborate our theory.
Original language | English |
---|---|
Title of host publication | Advances in Neural Information Processing Systems 36 (NeurIPS 2023) |
Editors | A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine |
Publisher | Neural Information Processing Systems Foundation |
Pages | 1-29 |
Number of pages | 29 |
ISBN (Print) | 9781713899921 |
Publication status | Published - Dec 2023 |
Event | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 - Ernest N. Morial Convention Center, New Orleans, United States Duration: 10 Dec 2023 → 16 Dec 2023 https://proceedings.neurips.cc/paper_files/paper/2023 (Conference Paper Search) https://openreview.net/group?id=NeurIPS.cc/2023/Conference#tab-accept-oral (Conference Paper Search) https://neurips.cc/Conferences/2023 (Conference Website) |
Publication series
Name | Advances in Neural Information Processing Systems |
---|---|
Volume | 36 |
ISSN (Print) | 1049-5258 |
Conference
Conference | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 |
---|---|
Country/Territory | United States |
City | New Orleans |
Period | 10/12/23 → 16/12/23 |
Internet address |
|