Software Engineer, GDC LLM Serving And GPU Performance

Google is seeking a Software Engineer to work on LLM serving and GPU performance optimization. The role involves developing next-generation technologies for large-scale systems, focusing on model deployment, evaluation, and fine-tuning. You will collaborate on projects involving speech/audio, reinforcement learning, and ML infrastructure.

• Design and implement large-scale systems for LLM serving.
• Optimize GPU performance for machine learning models.
• Collaborate on cross-functional projects involving ML infrastructure.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, launching software products, and 3 years with software design and architecture.
• 5 years of experience in ML fields such as speech/audio, reinforcement learning, or ML infrastructure.

• Master's or PhD in Engineering, Computer Science, or related field.
• 8 years of experience with data structures and algorithms.
• 3 years in technical leadership role.
• Experience in matrixed organization involving cross-functional projects.