ML Research Engineer, ML Systems

Sourced from diversityjobs.com

Scale AI's ML platform (RLXF) team is hiring an ML Research Engineer to build and optimize the internal distributed framework for large language model training and inference. You will work across ML teams and researchers to accelerate research and development of next-generation LLM training, inference, and data curation. The role focuses on profiling and optimizing large-scale distributed ML systems and integrating state-of-the-art technologies.

• Build, profile, and optimize the training and inference framework
• Collaborate with ML teams to accelerate research and development
• Research and integrate state-of-the-art technologies to optimize the ML system
• Enable next-generation LLM training, inference, and data curation

• Strong excitement about system optimization
• Experience with multi-node LLM training and inference
• Experience developing large-scale distributed ML systems
• Strong software engineering skills with CUDA, PyTorch, transformers, and flash attention
• Strong written and verbal communication and ability to operate cross-functionally

• Expertise in post-training methods such as instruction tuning and RLHF
• Experience with tool use, reasoning, agents, and multimodal LLMs