Causality-Inspired Fair Representation Learning for Multimodal Recommendation

Weixin Chen, Li Chen, Yongxin Ni, Yuhan Zhao

Research output: Contribution to journalJournal articlepeer-review

Abstract

Recently, multimodal recommendations (MMR) have gained increasing attention for alleviating the data sparsity problem of traditional recommender systems by incorporating modality-based representations. Although MMR exhibits notable improvement in recommendation accuracy, we empirically validate that an increase in the quantity or variety of modalities leads to a higher degree of users’ sensitive information leakage due to entangled causal relationships, risking fair representation learning. On the other hand, existing fair representation learning approaches are mostly based on the assumption that sensitive information is solely leaked from users’ interaction data and do not explicitly model the causal relationships introduced by multimodal data, which limits their applicability in multimodal scenarios. To address this limitation, we propose a novel fair multimodal recommendation approach (dubbed FMMRec) through causality-inspired fairness-oriented modal disentanglement and relation-aware fairness learning. Particularly, we disentangle biased and filtered modal embeddings inspired by causal inference techniques, enabling the mining of modality-based unfair and fair user-user relations, thereby enhancing the fairness and informativeness of user representations. By addressing the causal effects of sensitive attributes on user preferences, our approach aims to achieve counterfactual fairness in multimodal recommendations. Experiments on two public datasets demonstrate the superiority of our FMMRec relative to the state-of-the-art baselines. Our source code is available at .
Original languageEnglish
Number of pages29
JournalACM Transactions on Information Systems
DOIs
Publication statusE-pub ahead of print - 9 Jun 2025

Fingerprint

Dive into the research topics of 'Causality-Inspired Fair Representation Learning for Multimodal Recommendation'. Together they form a unique fingerprint.

Cite this