The University of Sheffield
School of Computer Science

Mingqian Shi Undergraduate Dissertation 2017/18

Mouse control by Hand motion

Supervised by Y.Gotoh

Abstract

This project aims to develop a program which let user can interact with computer through hand gesture based on computer vision. The processes are divided into hand segmentation, hand tracking and gesture recognition in order to achieve this goal. For the hand segmentation part, the YCbCr colour space is utilized to extract the skin colour feature, then hand will be segment as foreground object based on skin colour during the Binaryzation processing. Then, CamShift algorithms is used to let system to track the detected hand in real-time. Finally, the gestures are recognised by detecting the number of fingers which user uses

In the end, the system will be evaluated under a set of criteria in order to test the usability of the system in real world.