Abstract
In generative compressed sensing (GCS), we want to recover a signal x∗ ∈ Rn from m measurements (m ≪ n) using a generative prior x∗ ∈ G(Bk2(r)), where G is typically an L-Lipschitz continuous generative model and Bk2(r) represents the radius-r ℓ2-ball in Rk. Under nonlinear measurements, most prior results are non-uniform, i.e., they hold with high probability for a fixed x∗ rather than for all x∗ simultaneously. In this paper, we build a unified framework to derive uniform recovery guarantees for nonlinear GCS where the observation model is nonlinear and possibly discontinuous or unknown. Our framework accommodates GCS with 1-bit/uniformly quantized observations and single index models as canonical examples. Specifically, using a single realization of the sensing ensemble and generalized Lasso, all x∗ ∈ G(Bk2(r)) can be recovered up to an ℓ2-error at most ϵ using roughly Õ(k/ϵ2) samples, with omitted logarithmic factors typically being dominated by log L. Notably, this almost coincides with existing non-uniform guarantees up to logarithmic factors, hence the uniformity costs very little. As part of our technical contributions, we introduce the Lipschitz approximation to handle discontinuous observation models. We also develop a concentration inequality that produces tighter bounds for product processes whose index sets have low metric entropy. Experimental results are presented to corroborate our theory.
| Original language | English |
|---|---|
| Title of host publication | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 |
| Editors | A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine |
| Publisher | Neural Information Processing Systems Foundation |
| Pages | 1-29 |
| Number of pages | 29 |
| ISBN (Print) | 9781713899921 |
| Publication status | Published - Dec 2023 |
| Event | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 - Ernest N. Morial Convention Center, New Orleans, United States Duration: 10 Dec 2023 → 16 Dec 2023 https://proceedings.neurips.cc/paper_files/paper/2023 (Conference Paper Search) https://openreview.net/group?id=NeurIPS.cc/2023/Conference#tab-accept-oral (Conference Paper Search) https://neurips.cc/Conferences/2023 (Conference Website) |
Publication series
| Name | Advances in Neural Information Processing Systems |
|---|---|
| Volume | 36 |
| ISSN (Print) | 1049-5258 |
| Name | NeurIPS Proceedings |
|---|
Conference
| Conference | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 |
|---|---|
| Country/Territory | United States |
| City | New Orleans |
| Period | 10/12/23 → 16/12/23 |
| Internet address |
|
Fingerprint
Dive into the research topics of 'A Unified Framework for Uniform Signal Recovery in Nonlinear Generative Compressed Sensing'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver