| 摘要: |
| 在许多应用于有噪声环境下的语音识别系统中,唇读技术能有效地降低噪声的影响,通过视觉 通道来补充仅取决于听觉通道的信息量,从而提高语音识别系统的识别率.该文提出了一种有 效和稳健的唇定位跟踪方法,以满足不用特殊标识物和规范性照明就能对信息进行有效提取 的应用需求.该方法首先用肤色模型查找脸;然后用迭代算法搜索脸部区域内的眼睛;再根据 眼睛的位置来确定脸的大小和位置,并对脸的下半部分采用彩色坐标变换法将唇从肤色中明 显地区分出来;最后,用可变模板将上下唇的内外轮廓描述出来. |
| 关键词: 唇读,唇动,肤色模型,光流,可变模板. |
| DOI： |
| 分类号: |
| 基金项目:本文研究得到国家自然科学基金(No.69789301)和国家863高科技项目基金(No.863- 306-ZT03-01-2)资助. |
|
| Real-Time Lip Locating Method for Lip-Movement Recognition |
|
YAO Hong-xun,GAO Wen,LI Jing-mei,Lü Ya-juan,WANG Rui
|
| Abstract: |
| For speech recognition systems under noisy environment, lip-reading technique c an effectively reduce the influence of noise and improve the accurate rate o f speech recognition system by adding visual information to acoustic channel. In this paper, an effective and robust approach for lip and mouth locating and tra cking is presented to enable the information extraction under abnormal illumina tion and without special marks. This approach first locates face region with skin-color model, then finds the eyes from the face region with iterative algo rithm, modifies the position and size of face according to the position of eyes, transforms the lower part of face by specific color coordinators to clearly dis tinguish lip color from skin color, and finally describes the outline of upper l ip and lower lip with deformable template. |
| Key words: Lip-reading, lip-movement, skin-color model, optical flow, deformable templat e. |
