Search
Go
This job is no longer accepting applications
This listing was closed on Jul 19, 2026.
Browse Open JobsSoftware Engineer - LLM Inference
Summary by AIEngineer.careers
Software Engineer - LLM Inference is a AI Engineer role (full-time). with Nutanix. in VANCOUVER, CA. Compensation shown: $94K–$141K (est.). Imported listing (source: ca.linkedin.com). Apply on the employer's site (ca.linkedin.com).
Imported listing (source: ca.linkedin.com) · Apply on ca.linkedin.com
VANCOUVER · CA
$94K–$141K (est.)
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from ca.linkedin.com
Nutanix is seeking a Software Engineer to join the LLM Inference team, focusing on architecting and developing scalable, containerized services on Kubernetes. The role involves optimizing low-level systems for low-latency, high-throughput performance and contributing to open-source cloud native projects.
Responsibilities
- Architect, design, and develop horizontally scalable, containerized, fault-tolerant services on Kubernetes.
- Improve system performance for low-latency and high-throughput use cases.
- Optimize any part of the stack, including low-level systems.
- Develop scalable observability architectures for metrics collection and analysis.
- Collaborate with globally distributed product and backend teams.
Requirements
- 2-5 years experience in product development with maintainable code.
- Strong programming fundamentals, data structures, and algorithms.
- Strong experience with Docker, Kubernetes, and cloud native technologies.
- Experience building applications with Go and Python.
- Experience building and managing CI/CD pipelines.
- Understanding of datacenter design, distributed computing, and OS internals.
Nutanix
San Jose · US · 8222+ employees
Nutanix is an American cloud computing company that sells software for datacenters and hybrid multi-cloud deployments. It helps organizations simplify their IT infrastructure with a platform that integrates infrastructure and management capabilities to run apps, data, and AI anywhere.
