Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. As a Senior Frontier Agents Engineer, you'll bridge cutting-edge AI research and production deployment by designing, evaluating, and deploying intelligent systems that combine frontier models with structured knowledge, retrieval, traditional ML, and enterprise software. You'll work directly with enterprise customers across diverse industries to build production AI agents and multi-agent systems.
Responsibilities
Design and deploy production AI agents leveraging LLMs, reasoning, retrieval, memory, and tool use.
Architect intelligent systems combining LLMs, traditional ML, structured knowledge, and enterprise data.
Develop multi-agent systems coordinating reasoning, planning, tool execution, and human oversight.
Own experimentation lifecycle: design rigorous evaluation frameworks using offline benchmarks, A/B tests, LLM-as-a-Judge, and human evaluation.
Build production AI systems with emphasis on reliability, observability, latency, safety, and cost.
Partner with enterprise customers to translate ambiguous problems into production AI architectures.
Requirements
5+ years of software engineering, machine learning, or applied AI experience.
Strong Python programming skills.
Experience building production AI systems using LLMs.
Scale AI is an American artificial intelligence infrastructure and software company. It provides high-quality training data, annotations, and RLHF services to power AI models, and offers full-stack technologies for building and deploying AI applications.