Senior Machine Learning Engineer

Rubrik is building SAGE, an AI governance engine for monitoring and remediating autonomous AI agents. As a Senior Machine Learning Engineer on the SAGE team, you'll work end-to-end on the model lifecycle: curating data, training small language models, serving them at production latency, and closing the feedback loop with real customer signals. You'll push the frontier of accuracy, latency, and cost for governance-specific tasks using techniques like DPO, distillation, and quantization.

• Training, fine-tuning, and distilling production small language models and classifiers
• Engineering high-performance model serving and inference infrastructure (vLLM, SGLang, TensorRT-LLM)
• Building synthetic data pipelines and online/offline evaluation frameworks
• Mining insights, diagnosing failures, and driving adaptive model improvement
• Cross-functional collaboration and translating customer requirements into modeling problems

• Bachelor's degree in Computer Science, Machine Learning, or related field
• 2+ years of professional ML experience with end-to-end production ownership
• Proficiency in Python and PyTorch for production-grade training
• Hands-on experience training, fine-tuning, or distilling language models (SFT, DPO, RLAIF)
• Production experience with serving frameworks (vLLM, SGLang, TensorRT-LLM) and optimizations (continuous batching, KV-cache, quantization)