Software Engineer 2 - LLM Inference

Nutanix is seeking a Software Engineer 2 to join their Enterprise AI team, focusing on LLM Inference and the AI Gateway. The role involves architecting scalable services on Kubernetes, optimizing system performance, and contributing to open-source cloud native projects. The team builds foundational AI infrastructure to simplify AI deployment, showcased at NVIDIA GTC.

• Architect, design, and develop horizontally scalable, containerized, fault-tolerant services on Kubernetes.
• Improve system performance for low-latency and high-throughput use cases.
• Optimize any part of the stack, including low-level systems.
• Leverage and contribute to relevant open-source cloud native projects.
• Develop scalable, efficient, and fault-tolerant observability architectures.
• Collaborate globally with product management and backend teams.
• Contribute to all stages of product development: design, development, test, experimentation, analysis, and launch.
• Review code and design docs, give feedback on product specs and mocks.
• Participate in technology selection and process definition.
• Continuously learn and improve technical and non-technical abilities.

• 2-5 years experience developing maintainable, modular, resilient code from a Product Development company.