LLM Inference Engineer

Join the NEAR AI team to build decentralized and confidential machine learning infrastructure for user-owned AI. This role focuses on high-performance LLM serving systems, optimizing throughput, latency, and cost for open-source LLMs. You will architect and maintain production-scale inference systems at global scale.

• Architect and maintain production high-traffic LLM serving systems
• Optimize throughput, latency, and cost for leading open-source LLMs

• Strong hands-on experience in LLM inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT
• Deep knowledge of state-of-the-art GPU architectures and ability to exploit them using PyTorch, Triton, CuTe, CUDA, etc.
• Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems
• Strong problem-solving skills and ability to communicate technical ideas clearly

• Experience with Trusted Execution Environments (TEE)
• Active contributor to open-source LLM inference engines