Estimates on learning rates for multi-penalty distribution regression

Zhan Yu*, Daniel W.C. Ho

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

This paper is concerned with functional learning by utilizing two-stage sampled distribution regression. We study a multi-penalty regularization algorithm for distribution regression in the framework of learning theory. The algorithm aims at regressing to real-valued outputs from probability measures. The theoretical analysis of distribution regression is far from maturity and quite challenging since only second-stage samples are observable in practical settings. In our algorithm, to transform information of distribution samples, we embed the distributions to a reproducing kernel Hilbert space HK associated with Mercer kernel K via mean embedding technique. One of the primary contributions of this work is the introduction of a novel multi-penalty regularization algorithm, which is able to capture more potential features of distribution regression. Optimal learning rates of the algorithm are obtained under mild conditions. The work also derives learning rates for distribution regression in the hard learning scenario fρ∉HK, which has not been explored in the existing literature. Moreover, we propose a new distribution-regression-based distributed learning algorithm to face large-scale data or information challenges arising from distribution data. The optimal learning rates are derived for the distributed learning algorithm. By providing new algorithms and showing their learning rates, the work improves the existing literature in various aspects.

Original languageEnglish
Article number101609
JournalApplied and Computational Harmonic Analysis
Volume69
DOIs
Publication statusPublished - Mar 2024

Scopus Subject Areas

  • Applied Mathematics

User-Defined Keywords

  • Distributed learning
  • Distribution regression
  • Integral operator
  • Learning rate
  • Learning theory
  • Multi-penalty regularization

Fingerprint

Dive into the research topics of 'Estimates on learning rates for multi-penalty distribution regression'. Together they form a unique fingerprint.

Cite this