Système de suivi du mouvement des lèvres en temps réel par stéréovision
Details
- Supervisors
- Faculty
- Degree label
- Abstract
- Lip motion tracking is interesting for a variety of fields including speech therapy. Quantitatively observe these movements would help to diagnose a patient. This master thesis develops a complete “low-cost” system allowing a real-time monitoring of labial 3D movements primarily for the purpose of research. This is done using image processing. The hardware part of the device is a helmet that is placed on the patient’s head, on which an industrial stereo camera films the mouth. Coloured markers (make-up points or stickers) are applied on interest points of the lip contour. The resulting images are processed in a Windows application named “LMTS Studio 2.0”. Its graphical interface is easy to use and allows to manually initialize the markers to be followed. A colour segmentation by thresholding is performed in the colour space RGB, HSV, Lab or YUV. To achieve real-time operation (minimum 40 images processed per second), image processing is done on regions of interest (ROI) using multithreading. The success rate of marker detection is on average 99.7% over 10 hours of videos made in real conditions with make-up markers. Stereovision depth measurement shows an error of less than 1.0%.