Sr Software Dev Engineer, Stores Foundational AI -SFAI

Sourced from oceanofjobs.com

Amazon Stores Foundational AI is building a foundational LLM that fuses world knowledge with e-commerce domain knowledge to power new shopping experiences. As a Senior Software Development Engineer, you will architect scalable ML infrastructure for training and deploying large language models and build RL post-training pipelines at cluster scale. You will partner with applied scientists to translate frontier research into production systems and mentor engineers across the organization.

• Architect and build scalable ML infrastructure for training and deploying large language models
• Design and build end-to-end RL post-training pipelines (rollout, reward, optimization) at cluster scale
• Improve RL training stability (PPO / GRPO / RLOO) via monitoring reward, KL divergence, and policy stability
• Optimize RL post-training efficiency including GPU utilization, batching, sequence packing, and async rollouts
• Build observability systems for training dynamics, system health, and experiment tracking
• Mentor engineers, lead code reviews, and contribute to system design and technical roadmap

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language
• 4+ years of leading design or architecture of new and existing systems
• Experience as a mentor, tech lead, or leading an engineering team
• Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
• Knowledge of ML and LLM fundamentals including transformer architecture, training/inference lifecycles, and optimization
• Experience with distributed systems, big data technologies, and machine learning infrastructure

• Demonstrated ability to drive technical direction and influence engineering decisions across teams
• Experience profiling and eliminating bottlenecks across compute, networking, and storage