Senior Machine Learning Engineer, Computer Vision/VLM

Sourced from aihiringboard.com

Waymo is seeking a Senior Machine Learning Engineer to join its Semantics team, focusing on computer vision and vision-language models (VLMs) for autonomous driving. You will develop and train state-of-the-art models to extract semantic information from driving logs, design scalable AI agent frameworks integrating large foundation models, and apply fine-tuning and reinforcement learning to create a data flywheel. This hybrid role involves collaboration with ML Infra, Perception, Behavior, and AI Foundation teams to integrate captioning systems into the ML development lifecycle.

• Develop and train state-of-the-art computer vision / multimodal models (e.g., Gemini) to extract rich semantic information required by the AI agent.
• Design and implement a scalable AI agent framework that integrates large foundation models with perception models and internal knowledge bases.
• Develop and apply fine-tuning and reinforcement learning techniques to create a data flywheel for continuous improvement.
• Develop and prototype novel prompting strategies for Vision-Language Models (VLMs) to elicit complex reasoning about driving scenarios.
• Collaborate with ML Infra, Perception, Behavior, and AI Foundation teams to define data requirements and integrate the captioning system.
• Own the full system lifecycle, from model development and prototyping to production deployment and scaling.