Machine Learning Engineer, Multimodal Perception and Authentication

Sourced from justjobs.com

OpenAI's Future of Computing Research team is hiring a machine learning engineer to develop multimodal perception and authentication systems for future consumer devices. The role combines signals from cameras, microphones, and other sensors, integrating specialized perception models with larger multimodal models. You will partner with hardware, firmware, software, and product teams to bring research into real-world systems. Based in San Francisco with three days per week in office.

• Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals
• Explore how specialized perception models and larger multimodal models can work together
• Design data, training, and evaluation approaches that improve real-world performance
• Study model behavior, robustness, and failure modes across sensing, data, and deployment environments
• Integrate and validate new capabilities in real-time or resource-constrained systems
• Collaborate with hardware, firmware, software, and product teams to turn research into working systems

• Strong background in computer vision, audio/speech ML, multimodal learning, or sensing
• Experience developing specialized ML models, larger multimodal models, or both
• Track record bringing research ideas into practical systems, prototypes, or products
• Ability to design experiments, build evaluations, and investigate model behavior
• Experience with sensing hardware, real-time systems, or deployment constraints
• Proficiency in Python and PyTorch; comfort with C++ or systems integration

• Experience with authentication, biometrics, or privacy-sensitive applications
• Cross-disciplinary collaboration on early-stage research problems