Human speech is complex. The main visible articulators, the lips and tongue, are deformable. The muscles which drive speech produce visible secondary effects which convey meaning. Speech is context dependent and is changed by intent and emotion. Incorporating all of this into a computational model for the visual aspects of speech is a challenging task and will be discussed.