Lip Tracking Towards an Automatic Lip Reading Approach
Luca Lombardi, Waqqas ur Rehman Butt, Marco Grecuccio
Journal of Multimedia Processing and Technologies, Vol. 5, No. 1, 2014.
DOI: 
Link: http://www.dline.info/jmpt/fulltext/v5n1/1.pdf
Abstract:
Current era is to make the interaction between humans and their artificial partners (Computers) and make communication easier and more reliable. One of the actual tasks is the use of vocal interaction. Speech recognition may be improved by visual information of human face. In literature, the lip shape and its movement are referred to as lip reading. Lip reading computing plays a vital role in automatic speech recognition and is an important step towards accurate and robust speech recognition. In this paper we proposed method to detect the lips, shape and movement and use towards automatic lip tracking in detail by using Active Appearance Model (AAM). Purposed method shows the how accurate lip detection and tracking which is useful for speech recognition. Appearance-based methods consider the raw image for lip extraction. AAM uses for detection of speakerâ€™s lips features and feature points from faces automatically by appearance parameters of a speakerâ€™s lips. In this paper, we will describe the Lips shape, movement and appearance descriptions for lip detection and detailed information about the automatic lip tracking system. Individual characteristics and efficiency of both approaches towards the Lip reading is also discuss. The efficiency of purposed method will be evaluated individually by characteristics and their performances are then compared. The recognition process of common visual features (i.e. selection of lip, shape and extraction of movement) for an improved lip reading.