Adaptive multi-domain learning for outdoor 3D human pose and shape estimation

Zhaoyang Gui, Shanshan Zhang*, Kangkan Wang, Jian Yang, Pong Chi Yuen

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

Abstract

It is an extremely challenging task to estimate 3D human pose and shape in outdoor scenes for which we can hardly obtain precise ground truth data for training. Previous methods usually use multiple datasets collected at different scenes to train their models, including those collected in laboratories with precise ground truth and those collected at outdoor scenes with estimated or even no ground truth. Since data from different scenes are included in training, it is necessary to handle the domain difference problem, which unfortunately has never been considered by previous works. In this paper, we first point out this problem and then address it via a novel cascade multi-domain learning module (CMDL), where multiple adapters are employed to extract more discriminative features for different domains. We show that our method with CMDL outperforms previous methods in outdoor scenes. In principle, the proposed CMDL module can be easily applied on top of any arbitrary 3D human pose and shape approach.
Original languageEnglish
Title of host publicationICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
EditorsDimitri Androutsos, Kostas Plataniotis, Xiao-Ping (Steven) Zhang
PublisherIEEE
Pages2165-2169
Number of pages5
ISBN (Print)9781728176055
DOIs
Publication statusPublished - 6 Jun 2021
Event2021 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2021 - Virtual, Toronto, ON, Canada
Duration: 6 Jun 202111 Jun 2021
https://www.2021.ieeeicassp.org/2021.ieeeicassp.org/index.html
https://ieeexplore.ieee.org/xpl/conhome/9413349/proceeding

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
PublisherIEEE
ISSN (Print)1520-6149

Conference

Conference2021 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2021
Country/TerritoryCanada
CityVirtual, Toronto, ON
Period6/06/2111/06/21
Internet address

User-Defined Keywords

  • 3D human pose and shape estimation
  • multi-domain learning

Cite this