Lip password-based speaker verification without a priori knowledge of speech language

Yiu Ming CHEUNG, Yichao Zhou

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

Abstract

Most recently, the lip password that embeds the password content into lip motion has been proposed for visual speaker verification (Liu and Cheung 2014). One merit of lip password is that it provides double security on the speaker verification, where only the target speaker saying the correct password can be accepted. Nevertheless, the previous work of lip password is based on identifying the distinguishing subunits of purely-digit password contents, thus limiting the application domain of lip password. To tackle this problem, we propose a novel visual speaker verification approach based on lip password without a priori knowledge of speech language, i.e. unknown language alphabet. We take advantage of the diagonal structure of sparse representation to preserve the temporal order of lip sequences by employ a diagonal-like mask in pooling stage and build a pyramid spatiotemporal features containing the structural characteristic under lip password. Experiments show the efficacy of the proposed approach comparing with the state-of-the-art ones.

Original languageEnglish
Title of host publicationComputational Intelligence and Intelligent Systems - 9th International Symposium, ISICA 2017, Revised Selected Papers
EditorsZhangxing Chen, Kangshun Li, Wei Li, Yong Liu
PublisherSpringer Verlag
Pages461-472
Number of pages12
ISBN (Print)9789811316500
DOIs
Publication statusPublished - 2018
Event9th International Symposium on Intelligence Computation and Applications, ISICA 2017 - Guangzhou, China
Duration: 18 Nov 201719 Nov 2017

Publication series

NameCommunications in Computer and Information Science
Volume874
ISSN (Print)1865-0929

Conference

Conference9th International Symposium on Intelligence Computation and Applications, ISICA 2017
Country/TerritoryChina
CityGuangzhou
Period18/11/1719/11/17

Scopus Subject Areas

  • Computer Science(all)
  • Mathematics(all)

User-Defined Keywords

  • Double security
  • Language alphabet
  • Lip password
  • Modality
  • Speaker verification

Fingerprint

Dive into the research topics of 'Lip password-based speaker verification without a priori knowledge of speech language'. Together they form a unique fingerprint.

Cite this