Abstract
Although link prediction on graphs has achieved great success with the development of graph neural networks (GNNs), the potential robustness under the edge noise is still less investigated. To close this gap, we first conduct an empirical study to disclose that the edge noise bilaterally perturbs both input topology and target label, yielding severe performance degradation and representation collapse. To address this dilemma, we propose an information-theory-guided principle, Robust Graph Information Bottleneck (RGIB), to extract reliable supervision signals and avoid representation collapse. Different from the basic information bottleneck, RGIB further decouples and balances the mutual dependence among graph topology, target labels, and representation, building new learning objectives for robust representation against the bilateral noise. Two instantiations, RGIB-SSL and RGIB-REP, are explored to leverage the merits of different methodologies, i.e., self-supervised learning and data reparameterization, for implicit and explicit data denoising, respectively. Extensive experiments on six datasets and three GNNs with diverse noisy scenarios verify the effectiveness of our RGIB instantiations. The code is publicly available at: https://github.com/tmlr-group/RGIB.
| Original language | English |
|---|---|
| Title of host publication | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 |
| Editors | A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine |
| Publisher | Neural Information Processing Systems Foundation |
| Number of pages | 47 |
| ISBN (Print) | 9781713899921 |
| Publication status | Published - 10 Dec 2023 |
| Event | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 - Ernest N. Morial Convention Center, New Orleans, United States Duration: 10 Dec 2023 → 16 Dec 2023 https://proceedings.neurips.cc/paper_files/paper/2023 (Conference Paper Search) https://openreview.net/group?id=NeurIPS.cc/2023/Conference#tab-accept-oral (Conference Paper Search) https://neurips.cc/Conferences/2023 (Conference Website) |
Publication series
| Name | Advances in Neural Information Processing Systems |
|---|---|
| Volume | 36 |
| ISSN (Print) | 1049-5258 |
| Name | NeurIPS Proceedings |
|---|
Conference
| Conference | 37th Conference on Neural Information Processing Systems, NeurIPS 2023 |
|---|---|
| Country/Territory | United States |
| City | New Orleans |
| Period | 10/12/23 → 16/12/23 |
| Internet address |
|
User-Defined Keywords
- Robust link prediction
- Edge noise
Fingerprint
Dive into the research topics of 'Combating Bilateral Edge Noise for Robust Link Prediction'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver