Search
Go
Principal Engineer, AI Serving Framework Architect (Software)
Summary by AIEngineer.careers
Principal Engineer, AI Serving Framework Architect (Software) is a AI System Architect role (full-time). with Samsung Semiconductor. in SAN JOSE, US. Compensation shown: $219K–$351K. Imported listing (source: jobs-radar.com). Apply on the employer's site (jobs-radar.com).
Imported listing (source: jobs-radar.com) · Apply on jobs-radar.com
SAN JOSE · US
$219K–$351K
Full-time
PRINCIPAL
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from jobs-radar.com
Samsung Semiconductor is seeking a Principal AI System Architect to lead research on dynamic scheduling and optimization for AI inference at scale. The role involves working on memory-centric systems, RAG vector DB acceleration, and KVCache placement strategies.
Responsibilities
- Lead research teams in Korea and propose technical direction.
- Research dynamic scheduling methodologies for maximizing AI inference performance in multi-rack scale memory-centric systems.
- Investigate methods to accelerate search operations in RAG's vector DB and AI Agent's knowledge-graph using compute-capable memory.
- Study strategies for optimally placing KVCache and vector DB in hierarchical memory to minimize SSD accesses.
- Propose software designs for implementing optimization algorithms on platforms like vLLM.
Requirements
- PhD in Computer Science or related field with 10+ years experience in AI Serving Framework.
- Led a project to build and optimize LLM Inference Software Stack on multi-rack scale system.
- Extensive experience in designing AI Inference Software Stacks for heterogeneous devices.
- In-depth understanding of vLLM internal architecture and operation.
Samsung Semiconductor
San Jose · US · 8218+ employees
Samsung Semiconductor is a prominent global manufacturer of semiconductor solutions, including memory, processors, and image sensors, used across mobile, automotive, and data center sectors. It operates as a subsidiary of Samsung Electronics, with a strong focus on high-performance chip technology.
