Research Scientist Intern - Audio to Mouth Synthesis

“The most talked about AI company in Hollywood”
Flawless is shattering the boundaries of traditional filmmaking with its groundbreaking suite of Gen AI film editing tools. Our mission is to empower filmmakers with cutting-edge technology that allows creativity without compromise, expands storytelling possibilities, and delivers unparalleled visual and emotional experiences.
What we are looking for: We are seeking an intern for a 4-6 month internship focusing on audio-visual synthesis, specifically targeting lip motion synthesis and head movement using diffusion-based methods. The ideal candidate will be a PhD student, with a strong preference for those who have worked with models in virtual talking heads or emotion based talking synthesis. Responsibilities include conducting independent research and designing algorithms capable of translating input audio into synchronized visual outputs. Applicants should have experience in training diffusion models, preferably in image synthesis, and familiarity with technologies that animate emotions in videos. While a publication is not necessary, hands-on experience in these areas is crucial.

Requirements

• Synthesize lip motion and head movement from audio input using diffusion-based methods.
• Independently research and develop algorithms that incorporate advancements in audio-visual synthesis.
• Collaborate in a dynamic research environment, contributing to pioneering developments in the field.
• Experience with training diffusion models, specifically in image synthesis.
• Familiarity with emotion animation technologies, such as those used in 'emote video alive' projects.
• PhD candidates are preferred, though all applicants with relevant experience and qualifications are encouraged to apply.
• Research experience with demonstrated publication record at top-tier conferences in computer vision/graphics, and deep learning such as ECCV, ICCV, CVPR, and SIGGRAPH.

Flawless is proud to emphasize an equal opportunity, safe environment for people to do their best work. We are committed to providing equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.