Daniel Bayley Undergraduate Dissertation 2017/18

Word to lip move mapping

Supervised by Y.Gotoh

Abstract

This project looks at the process of taking words and mapping them to the appropriate lip movements, the goal of the project is to create a system that can automatically perform these mappings. Since the system must work for any piece of text we will be looking at a generalised approach. Specifically the method of taking words and mapping them onto a set of sounds, then mapping these phonemes to a set of visemes. Years of research has taken place to make this approach possible, the system uses outcomes of this research in it's implementation. The research also highlights the limitations of this phoneme driven approach. Due to the abstract nature of phoneme the output of the system is also abstract, potentially putting the system in uncanny valley territory.