Search
Go
This job is no longer accepting applications
This listing was closed on Sep 22, 2026.
Browse Open JobsSoftware Engineer, Inference (AI Data Engineering)
Summary by AIEngineer.careers
Software Engineer, Inference (AI Data Engineering) is a AI Infrastructure Engineer role (full-time). with SpaceX. in PALO ALTO, US. Compensation shown: $135K–$210K. Imported listing (source: zerogtalent.com). Apply on the employer's site (zerogtalent.com).
Imported listing (source: zerogtalent.com) · Apply on zerogtalent.com
PALO ALTO · US
$135K–$210K
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from zerogtalent.com
SpaceX is looking for a Software Engineer to design and optimize large-scale AI inference serving systems end-to-end, from distributed infrastructure to low-level GPU optimizations. The role involves building reliable, high-throughput inference platforms that serve internal AI models, with ownership of request routing, rate limiting, and inference engine acceleration. This is an on-site role in Palo Alto, supporting mission-critical applications and training workloads.
Responsibilities
- Develop highly reliable, high-throughput inference systems. Architect scalable distributed infrastructure for model serving (load balancing, auto-scaling, batch scheduling, global KV cache, continuous batching). Optimize latency and throughput with GPU kernel work, quantization, and speculative decoding. Build high-concurrency serving systems with low tail latency and observability. Own components such as request routing, SDK development, and rate limiting. Benchmark and accelerate inference engines (SGLang, vLLM, TensorRT-LLM). Create CI/CD infrastructure for endpoint deployment and engine updates.
Requirements
- Bachelor's degree in computer science, engineering, math, or scientific discipline; OR 2+ years of professional experience building software. Experience designing, implementing, and maintaining reliable, horizontally scalable distributed systems. 1+ years of experience in full stack or backend development with production systems. 1+ years of experience with Rust or C++.
SpaceX
Hawthorne · US · 20844+ employees
SpaceX designs, manufactures, and launches advanced rockets and spacecraft, with the long-term goal of making humanity multiplanetary. Its activities include reusable launch systems, human spaceflight, satellite broadband through Starlink, and emerging orbital AI-compute infrastructure.
