Lip-reading detection and localization based on two stage ellipse fitting

Yong Hui Huang; Bao Chang Pan; Sheng Lin Zheng; Jianjia Pan; Yuanyan Tang

doi:10.1109/ICWAPR.2008.4635770

Lip-reading detection and localization based on two stage ellipse fitting

Yong Hui Huang
, Bao Chang Pan
, Sheng Lin Zheng
, Jianjia Pan
, Yuanyan Tang

Department of Computer Science

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

5 Citations (Scopus)

Abstract

A method of detection and localization in lip- reading system based on least square fitting and two stage ellipse fitting was proposed in this paper. Firstly, color space transformation in simple background facial images was made to simply and fast detect skin regions and get threshold for segmenting lip area; secondly, according to two stage ellipse fitting based on least square, lip image are gained. Results show that this method is more effective in fitting effect than algebraic distance fitting. And the computational efficiency is improved compared with geometric distance fitting, and the goal of recognition in lip-reading system could also be archived. Experimental set was limited in sample space of specific speaker and in image sequence features of 403 speech video files, the recognition rate can get up to 90.9%.

Original language	English
Title of host publication	Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR
Publisher	IEEE
Pages	168-171
Number of pages	4
ISBN (Electronic)	9781424422395
ISBN (Print)	9781424422388
DOIs	https://doi.org/10.1109/ICWAPR.2008.4635770
Publication status	Published - 30 Aug 2008
Event	2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR 2008 - Hong Kong, China Duration: 30 Aug 2008 → 31 Aug 2008

Publication series

Name	Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR
Publisher	IEEE
ISSN (Print)	2158-5695
ISSN (Electronic)	2158-5709

Conference

Conference	2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR 2008
Country/Territory	China
City	Hong Kong
Period	30/08/08 → 31/08/08

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 9 Industry, Innovation, and Infrastructure

User-Defined Keywords

Least square fitting
Lip-reading
Two stage ellipse fitting

Access to Document

10.1109/ICWAPR.2008.4635770

Cite this

Huang, Y. H., Pan, B. C., Zheng, S. L., Pan, J., & Tang, Y. (2008). Lip-reading detection and localization based on two stage ellipse fitting. In Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR (pp. 168-171). (Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR). IEEE. https://doi.org/10.1109/ICWAPR.2008.4635770

@inproceedings{6e1e653afc4b479f939bf23c106fcce8,

title = "Lip-reading detection and localization based on two stage ellipse fitting",

abstract = "A method of detection and localization in lip- reading system based on least square fitting and two stage ellipse fitting was proposed in this paper. Firstly, color space transformation in simple background facial images was made to simply and fast detect skin regions and get threshold for segmenting lip area; secondly, according to two stage ellipse fitting based on least square, lip image are gained. Results show that this method is more effective in fitting effect than algebraic distance fitting. And the computational efficiency is improved compared with geometric distance fitting, and the goal of recognition in lip-reading system could also be archived. Experimental set was limited in sample space of specific speaker and in image sequence features of 403 speech video files, the recognition rate can get up to 90.9\%.",

keywords = "Least square fitting, Lip-reading, Two stage ellipse fitting",

author = "Huang, \{Yong Hui\} and Pan, \{Bao Chang\} and Zheng, \{Sheng Lin\} and Jianjia Pan and Yuanyan Tang",

note = "Publisher copyright: {\textcopyright} 2008 IEEE; 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR 2008 ; Conference date: 30-08-2008 Through 31-08-2008",

year = "2008",

month = aug,

day = "30",

doi = "10.1109/ICWAPR.2008.4635770",

language = "English",

isbn = "9781424422388",

series = "Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR",

publisher = "IEEE",

pages = "168--171",

booktitle = "Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR",

address = "United States",

}

Huang, YH, Pan, BC, Zheng, SL, Pan, J & Tang, Y 2008, Lip-reading detection and localization based on two stage ellipse fitting. in Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR. Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR, IEEE, pp. 168-171, 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR 2008, Hong Kong, China, 30/08/08. https://doi.org/10.1109/ICWAPR.2008.4635770

Lip-reading detection and localization based on two stage ellipse fitting. / Huang, Yong Hui; Pan, Bao Chang; Zheng, Sheng Lin et al.
Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR. IEEE, 2008. p. 168-171 (Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR).

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - Lip-reading detection and localization based on two stage ellipse fitting

AU - Huang, Yong Hui

AU - Pan, Bao Chang

AU - Zheng, Sheng Lin

AU - Pan, Jianjia

AU - Tang, Yuanyan

PY - 2008/8/30

Y1 - 2008/8/30

N2 - A method of detection and localization in lip- reading system based on least square fitting and two stage ellipse fitting was proposed in this paper. Firstly, color space transformation in simple background facial images was made to simply and fast detect skin regions and get threshold for segmenting lip area; secondly, according to two stage ellipse fitting based on least square, lip image are gained. Results show that this method is more effective in fitting effect than algebraic distance fitting. And the computational efficiency is improved compared with geometric distance fitting, and the goal of recognition in lip-reading system could also be archived. Experimental set was limited in sample space of specific speaker and in image sequence features of 403 speech video files, the recognition rate can get up to 90.9%.

AB - A method of detection and localization in lip- reading system based on least square fitting and two stage ellipse fitting was proposed in this paper. Firstly, color space transformation in simple background facial images was made to simply and fast detect skin regions and get threshold for segmenting lip area; secondly, according to two stage ellipse fitting based on least square, lip image are gained. Results show that this method is more effective in fitting effect than algebraic distance fitting. And the computational efficiency is improved compared with geometric distance fitting, and the goal of recognition in lip-reading system could also be archived. Experimental set was limited in sample space of specific speaker and in image sequence features of 403 speech video files, the recognition rate can get up to 90.9%.

KW - Least square fitting

KW - Lip-reading

KW - Two stage ellipse fitting

UR - https://www.scopus.com/pages/publications/56749181699

U2 - 10.1109/ICWAPR.2008.4635770

DO - 10.1109/ICWAPR.2008.4635770

M3 - Conference proceeding

AN - SCOPUS:56749181699

SN - 9781424422388

T3 - Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR

SP - 168

EP - 171

BT - Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR

PB - IEEE

T2 - 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR 2008

Y2 - 30 August 2008 through 31 August 2008

ER -

Huang YH, Pan BC, Zheng SL, Pan J, Tang Y. Lip-reading detection and localization based on two stage ellipse fitting. In Proceedings of the 2008 International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR. IEEE. 2008. p. 168-171. (Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, ICWAPR). doi: 10.1109/ICWAPR.2008.4635770

Lip-reading detection and localization based on two stage ellipse fitting

Abstract

Publication series

Conference

UN SDGs

User-Defined Keywords

Access to Document

Other files and links

Fingerprint

Cite this