Research Engineer, Large-Scale Training

Together AI is looking for a Research Engineer to join the Model Shaping team, focusing on large-scale training infrastructure. You will profile and optimize distributed training workloads, integrate new model architectures, and productionize novel training methods from research. This role involves working closely with research scientists to ensure efficient fine-tuning and reliable deployment of open-source foundation models.

• Design, implement, and optimize core components of Together's large-scale training infrastructure.
• Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads.
• Profile distributed training workloads to identify and eliminate bottlenecks across compute, memory, and communication.
• Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods.
• Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases.
• Rapidly enable support for newly released open-source foundation models on the Together platform.
• Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability.

• Demonstrated ability to independently take ambiguous performance or infrastructure problems from investigation through deployment.