Search
Go
Software Engineer II - AI/ML, AWS Neuron - Seattle
Summary by AIEngineer.careers
Software Engineer II - AI/ML, AWS Neuron - Seattle is a AI Infrastructure Engineer role (full-time). with Annapurna Labs (U.S.) Inc. in SEATTLE, US. Compensation shown: $144K–$194K. Imported listing (source: educativ.net). Apply on the employer's site (educativ.net).
Imported listing (source: educativ.net) · Apply on educativ.net
SEATTLE · US
$144K–$194K
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from educativ.net
This role focuses on developing and optimizing the AWS Neuron SDK to accelerate deep learning and GenAI workloads on Amazon’s custom Inferentia and Trainium accelerators. Engineers will design distributed inference solutions, build high-performance kernels, and tune large language models like Llama and DeepSeek for maximum throughput and latency efficiency. The position requires close collaboration across compiler, runtime, framework, and hardware teams to deliver scalable AI infrastructure.
Responsibilities
- Design, develop, and optimize machine learning models and frameworks for deployment on custom ML hardware accelerators.
- Build and lead distributed inference support for PyTorch within the Neuron SDK.
- Tune LLM model families to maximize efficiency on AWS Trainium and Inferentia silicon.
- Profile and resolve system-level performance bottlenecks using advanced debugging tools.
- Collaborate across compiler, runtime, and hardware teams to optimize global ML workloads.
- Mentor engineering peers and contribute to architectural decisions for future AI acceleration.
Requirements
- 3+ years of professional software development experience.
- Bachelor's degree in Computer Science or equivalent practical experience.
AL
Annapurna Labs (U.S.) Inc.
Cupertino · US · 234+ employees
Annapurna Labs is a fabless semiconductor subsidiary of Amazon Web Services (AWS) that designs custom silicon and software infrastructure for cloud computing. Its innovations include the AWS Nitro System, Graviton processors, and machine learning accelerators like Trainium and Inferentia.
