TY - JOUR
T1 - Joint discriminative learning of deep dynamic textures for 3D mask face anti-spoofing
AU - Shao, Rui
AU - Lan, Xiangyuan
AU - Yuen, Pong Chi
N1 - Funding Information:
Manuscript received November 7, 2017; revised May 14, 2018 and August 1, 2018; accepted August 9, 2018. Date of publication August 31, 2018; date of current version October 30, 2018. This work was supported by the Hong Kong Research Grant Council GRF RGC/HKBU12201215. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. J. Fierrez. (Corresponding author: Pong C. Yuen.) The authors are with the Department of Computer Science, Hong Kong Baptist University, Hong Kong (e-mail: [email protected]; [email protected]; [email protected]).
PY - 2019/4
Y1 - 2019/4
N2 - Three-dimensional mask spoofing attacks have been one of the main challenges in face recognition. Compared with a 3D mask, a real face displays different facial motion patterns that are reflected by different facial dynamic textures. However, a large portion of these facial motion differences is subtle. We find that the subtle facial motion can be fully captured by multiple deep dynamic textures from a convolutional layer of a convolutional neural network, but not all deep dynamic textures from different spatial regions and different channels of a convolutional layer are useful for differentiation of subtle motions between real faces and 3D masks. In this paper, we propose a novel feature learning model to learn discriminative deep dynamic textures for 3D mask face anti-spoofing. A novel joint discriminative learning strategy is further incorporated in the learning model to jointly learn the spatial- and channel-discriminability of the deep dynamic textures. The proposed joint discriminative learning strategy can be used to adaptively weight the discriminability of the learned feature from different spatial regions or channels, which ensures that more discriminative deep dynamic textures play more important roles in face/mask classification. Experiments on several publicly available data sets validate that the proposed method achieves promising results in intra- and cross-data set scenarios.
AB - Three-dimensional mask spoofing attacks have been one of the main challenges in face recognition. Compared with a 3D mask, a real face displays different facial motion patterns that are reflected by different facial dynamic textures. However, a large portion of these facial motion differences is subtle. We find that the subtle facial motion can be fully captured by multiple deep dynamic textures from a convolutional layer of a convolutional neural network, but not all deep dynamic textures from different spatial regions and different channels of a convolutional layer are useful for differentiation of subtle motions between real faces and 3D masks. In this paper, we propose a novel feature learning model to learn discriminative deep dynamic textures for 3D mask face anti-spoofing. A novel joint discriminative learning strategy is further incorporated in the learning model to jointly learn the spatial- and channel-discriminability of the deep dynamic textures. The proposed joint discriminative learning strategy can be used to adaptively weight the discriminability of the learned feature from different spatial regions or channels, which ensures that more discriminative deep dynamic textures play more important roles in face/mask classification. Experiments on several publicly available data sets validate that the proposed method achieves promising results in intra- and cross-data set scenarios.
KW - 3D mask face anti-spoofing
KW - deep dynamic textures
KW - spatial- and channel-discriminability
UR - http://www.scopus.com/inward/record.url?scp=85052843083&partnerID=8YFLogxK
U2 - 10.1109/TIFS.2018.2868230
DO - 10.1109/TIFS.2018.2868230
M3 - Journal article
AN - SCOPUS:85052843083
SN - 1556-6013
VL - 14
SP - 923
EP - 938
JO - IEEE Transactions on Information Forensics and Security
JF - IEEE Transactions on Information Forensics and Security
IS - 4
M1 - 8453011
ER -