Search
Go
Senior Staff Engineer, AI Software
Summary by AIEngineer.careers
Senior Staff Engineer, AI Software is a AI Engineer role (full-time). with Samsung Semiconductor. in SAN JOSE, US. Compensation shown: $189K–$301K. Imported listing (source: jobs-radar.com). Apply on the employer's site (jobs-radar.com).
Imported listing (source: jobs-radar.com) · Apply on jobs-radar.com
SAN JOSE · US
$189K–$301K
Full-time
STAFF
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from jobs-radar.com
Samsung Semiconductor's AGI Computing Lab is seeking a Senior Staff Engineer to lead co-design of software and hardware solutions that optimize AI model inference performance, focusing on overcoming memory bottlenecks. The role involves analyzing LLM and agentic AI workloads, profiling model execution, and collaborating with hardware teams on memory architecture and acceleration strategies. Requires expertise in PyTorch, vLLM, and memory-centric computing.
Responsibilities
- Lead co-design of software and hardware solutions optimizing AI model inference performance, focusing on memory bottlenecks.
- Analyze and optimize LLM and agentic AI workloads across the full software stack.
- Profile and characterize model execution to expose memory wall limitations and guide architectural decisions for HBM and memory-centric compute.
- Collaborate with hardware teams to influence memory architecture, acceleration strategies, and compute placement.
- Develop, optimize, and benchmark inference and serving solutions using PyTorch and vLLM.
- Define best practices and provide technical mentorship across software–hardware co-design efforts.
Requirements
- Bachelor's with 15+ years, Master's with 13+ years, or PhD with 10+ years of industry experience.
Samsung Semiconductor
San Jose · US · 8218+ employees
Samsung Semiconductor is a prominent global manufacturer of semiconductor solutions, including memory, processors, and image sensors, used across mobile, automotive, and data center sectors. It operates as a subsidiary of Samsung Electronics, with a strong focus on high-performance chip technology.
