Senior Staff Engineer, AI Software

Samsung Semiconductor's AGI Computing Lab is seeking a Senior Staff Engineer to lead co-design of software and hardware solutions that optimize AI model inference performance, focusing on overcoming memory bottlenecks. The role involves analyzing LLM and agentic AI workloads, profiling model execution, and collaborating with hardware teams on memory architecture and acceleration strategies. Requires expertise in PyTorch, vLLM, and memory-centric computing.

• Lead co-design of software and hardware solutions optimizing AI model inference performance, focusing on memory bottlenecks.
• Analyze and optimize LLM and agentic AI workloads across the full software stack.
• Profile and characterize model execution to expose memory wall limitations and guide architectural decisions for HBM and memory-centric compute.
• Collaborate with hardware teams to influence memory architecture, acceleration strategies, and compute placement.
• Develop, optimize, and benchmark inference and serving solutions using PyTorch and vLLM.
• Define best practices and provide technical mentorship across software–hardware co-design efforts.

• Bachelor's with 15+ years, Master's with 13+ years, or PhD with 10+ years of industry experience.
• Strong experience in high-performance AI framework software development for GPUs or other accelerators.
• End-to-end understanding of AI infrastructure and software stack from model definition through deployment.