Style-Controllable Speech-Driven Gesture Synthesis Using Normalising Flows

Interesting research beneficial to anyone looking to create procedurally automated dialogue systems.

“Automatic synthesis of realistic gestures promises to transform the fields of animation, avatars and communicative agents. In off-line applications, novel tools can alter the role of an animator to that of a director, who provides only high-level input for the desired animation; a learned network then translates these instructions into an appropriate sequence of body poses. In interactive scenarios, systems for generating natural animations on the fly are key to achieving believable and relatable characters. In this paper we address some of the core issues towards these ends.”

Read the paper here.