Search
Go
Senior AI Platform / LLM Infrastructure Engineer
Summary by AIEngineer.careers
Senior AI Platform / LLM Infrastructure Engineer is a AI Infrastructure Engineer role (full-time). with PeopleNTech LLC. in SANTA CLARA, US. Compensation shown: $142K+ (est.). Imported listing (source: jobs-in.us). Apply on the employer's site (jobs-in.us).
Imported listing (source: jobs-in.us) · Apply on jobs-in.us
SANTA CLARA · US
$142K+ (est.)
Full-time
SENIOR
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from jobs-in.us
This role focuses on designing and deploying on-premise large language model inference platforms. Engineers will optimize high-performance GPU workloads and build scalable machine learning infrastructure leveraging Kubernetes. The position requires strong expertise in distributed systems and modern AI deployment pipelines.
Responsibilities
- Build and optimize on-prem LLM inference platforms
- Manage high-performance GPU workloads and model serving
- Design scalable ML infrastructure using Kubernetes
- Monitor and improve system performance and reliability
Requirements
- Strong experience with Kubernetes and container orchestration
- Proficiency in managing GPU-accelerated computing environments
- Background in deploying and scaling large language models
- Solid understanding of distributed systems and cloud/on-prem infrastructure
Nice to Have
- Experience with Triton Inference Server or vLLM
- Familiarity with CI/CD pipelines for ML models
- Knowledge of networking optimization for high-throughput inference
PL
PeopleNTech LLC
Alexandria · US · 214+ employees
PeopleNTech LLC is an IT services and consulting company providing workforce solutions including staff augmentation, direct hire, and payroll services. It also offers software development and technology consulting.
