Search
Go
Senior Software Engineer, Agent Oversight
SAN FRANCISCO · US
$216K–$270K
Full-time
SENIOR
About the Role
Scale AI is seeking a Senior Software Engineer for their Agent Oversight team to build platform infrastructure for observing, evaluating, and improving production agentic AI systems. The role involves designing APIs, data pipelines, and monitoring tools to ensure reliable AI deployments. Ideal candidates have backend/distributed systems experience, familiarity with ML/LLM production systems, and a track record of owning features end-to-end.
Responsibilities
- Design and build core platform capabilities for deploying, monitoring, and evaluating agentic applications in production
- Build reliable APIs and data pipelines that capture agent telemetry, evaluation signals, and performance metrics at scale
- Work alongside ML engineers where platform work intersects with evaluation or improvement systems
- Own the reliability, scalability, and observability of platform components serving multiple concurrent enterprise and government customers
- Work cross-functionally with product, forward deployed engineering, and customers to translate real-world deployment requirements into platform features
- Build features end-to-end: system design, implementation, debugging, and testing
- Participate in high-velocity experimentation to validate platform capabilities against real customer usage
Requirements
- 4+ years of professional software engineering experience, with strong fundamentals in backend/distributed systems, APIs, and data pipeline design
Scale AI
San Francisco · US · 1200+ employees
Scale AI is an American artificial intelligence infrastructure and software company. It provides high-quality training data, annotations, and RLHF services to power AI models, and offers full-stack technologies for building and deploying AI applications.
