Lip segmentation under MAP-MRF framework with automatic selection of local observation scale and number of segments

Yiu Ming CHEUNG, Meng Li, Xiaochun Cao, Xinge You

Research output: Contribution to journalJournal articlepeer-review

16 Citations (Scopus)


This paper addresses the problem of segmenting lip region from frontal human face image. Supposing each pixel of the target image has an optimal local scale from the segmentation viewpoint, we treat the lip segmentation problem as a combination of observation scale selection and observed data classification. Accordingly, we propose a hierarchical multiscale Markov random field (MRF) model to represent the membership map of each input pixel to a specific segment and local-scale map simultaneously. Subsequently, lip segmentation can be formulated as an optimal problem in the maximum a posteriori (MAP)-MRF framework. Then, we present a rival-penalized iterative algorithm to implement the segmentation, which is independent of the number of predefined segments. The proposed method mainly features two aspects: 1) its performance is independent of the predefined number of segments, and 2) it takes into account the local optimal observation scale for each pixel. Finally, we conduct the experiments on four benchmark databases, i.e. AR, CVL, GTAV, and VidTIMIT. Experimental results show that the proposed method is robust to the segment number that changes with a speaker's appearance, and can enhance the segmentation accuracy by taking advantage of the local optimal observation scale information.

Original languageEnglish
Article number6837537
Pages (from-to)3397-3411
Number of pages15
JournalIEEE Transactions on Image Processing
Issue number8
Publication statusPublished - Aug 2014

Scopus Subject Areas

  • Software
  • Computer Graphics and Computer-Aided Design

User-Defined Keywords

  • Lip segmentation
  • local scale selection
  • MAP-MRF framework
  • number of segments


Dive into the research topics of 'Lip segmentation under MAP-MRF framework with automatic selection of local observation scale and number of segments'. Together they form a unique fingerprint.

Cite this