Search
Go
This job is no longer accepting applications
This listing was closed on Jul 19, 2026.
Browse Open JobsSoftware Engineer 2 - LLM Inference
Summary by AIEngineer.careers
Software Engineer 2 - LLM Inference is a AI Engineer role (full-time). with Nutanix. in VANCOUVER, CA. Imported listing (source: adzuna.ca). Apply on the employer's site (adzuna.ca).
Imported listing (source: adzuna.ca) · Apply on adzuna.ca
VANCOUVER · CA
—
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from adzuna.ca
Nutanix is seeking a Software Engineer 2 to join their Enterprise AI team, focusing on LLM Inference and the AI Gateway. The role involves architecting scalable services on Kubernetes, optimizing system performance, and contributing to open-source cloud native projects. The team builds foundational AI infrastructure to simplify AI deployment, showcased at NVIDIA GTC.
Responsibilities
- Architect, design, and develop horizontally scalable, containerized, fault-tolerant services on Kubernetes.
- Improve system performance for low-latency and high-throughput use cases.
- Optimize any part of the stack, including low-level systems.
- Leverage and contribute to relevant open-source cloud native projects.
- Develop scalable, efficient, and fault-tolerant observability architectures.
- Collaborate globally with product management and backend teams.
- Contribute to all stages of product development: design, development, test, experimentation, analysis, and launch.
- Review code and design docs, give feedback on product specs and mocks.
- Participate in technology selection and process definition.
- Continuously learn and improve technical and non-technical abilities.
Requirements
Nutanix
San Jose · US · 8222+ employees
Nutanix is an American cloud computing company that sells software for datacenters and hybrid multi-cloud deployments. It helps organizations simplify their IT infrastructure with a platform that integrates infrastructure and management capabilities to run apps, data, and AI anywhere.
