Conversational Modelling Research Engineer

Tavus is a research lab building AI Humans with real-time conversational avatars. They are hiring a research engineer to push the boundaries of foundation multimodal conversational models, focusing on fine-tuning, adaptation, and low-latency avatar behavior. The role involves conducting research, partnering with the applied ML team, and staying ahead of cutting-edge advancements.

• Conduct research on Large Multimodal Models for Conversational Avatars (e.g., Neural Avatars, Talking-Heads).
• Develop methods to model verbal and non-verbal aspects of conversation, adapting avatar behavior in real time with low latency.
• Experiment with fine-tuning, adaptation, and conditioning techniques for AudioVisual Multimodal Models.
• Partner with the Applied ML team to take research from prototype to production.
• Stay up to date with cutting-edge advancements and help define future directions.

• PhD (or near completion) in a relevant field or equivalent research experience.
• Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models.
• Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.
• Solid background in deep learning and foundation models.
• Strong PyTorch skills and comfort building deep learning pipelines.