POSFed: Tackling Non-IID Challenges in One-Shot Federated Learning via Personalization

Federated Learning (FL) enables collaborative model training across distributed clients without requiring the exchange of raw data. However, existing One-Shot FL (OSFL) methods, designed for communication efficiency by reducing fed-erated rounds to one, suffer substantial performance degradation when faced with highly non-IID data across clients, primarily due to critical distribution shifts: label shift, feature shift, and concept shift. In this paper, we introduce POSFed, a new personalized three-stage approach, to systematically address these fundamen-tal limitations: (1) Each client locally generates robust and label-agnostic synthetic datasets via self-supervising learning, ensuring essential knowledge is captured despite local distribution shifts; (2) The server aggregates all synthetic datasets to train a global feature extractor, capturing generalizable and transferable rep-resentations across heterogeneous client data; and (3) Each client efficiently adapts the feature extractor by learning a personalized classification head on its own data, enabling effective local customization and mitigating both feature and concept shifts. Extensive experiments across multiple benchmarks demonstrate that POSFed significantly outperforms state-of-the-art methods, achieving performance comparable to multi-round personalized approaches while using only one communication round. By ensuring both superior personalization and practical communication efficiency, POSFed establishes a feasible paradigm for FL under more realistic and heterogeneous conditions. Code is available at https://github.com/I643204431IPOSFed.