Search
Go
Senior Software Engineer, ML Infrastructure
Summary by AIEngineer.careers
Senior Software Engineer, ML Infrastructure is a ML Infrastructure Engineer role (full-time). with Roku. in CAMBRIDGE, GB. Imported listing (source: ottoroles.com). Apply on the employer's site (ottoroles.com).
Imported listing (source: ottoroles.com) · Apply on ottoroles.com
CAMBRIDGE · GB
—
Full-time
SENIOR
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from ottoroles.com
Roku is seeking a Senior ML Infrastructure Engineer to build and maintain the production systems powering its Entertainment Assistant. The role focuses on LLM agent development, model serving pipelines, and observability for conversational AI experiences at scale.
Responsibilities
- Own fulfilment-ranking pipelines from training orchestration through deployment and online validation.
- Develop the Roku Entertainment Assistant's LLM agent, including tool routing, retrieval, guardrails, and caching.
- Build and operate offline-evaluation platforms combining LLM-as-judge harnesses with deterministic checks.
- Design observability for ML/LLM systems, tracking latency, quality metrics, tracing, and per-request cost.
Requirements
- Strong production software engineering experience with distributed services.
- Meaningful ownership of ML infrastructure or production models.
- Experience with low-latency services and scalable system design.
- Ability to work across ML, product, data, and platform teams.
Nice to Have
- Fluency in agentic engineering toolchains (Claude Code, Cursor, MCP servers).
- Experience driving AI agents to verify output and accelerate codebase ramp-up.
- Background in automated evaluation and retraining workflows.
Tech Stack
PythonLLMRAGMLOpsObservabilityDistributed SystemsC++CursorClaude CodeMCP
Roku
San Jose · US · 3600+ employees
Roku, Inc. is a leading American technology company that pioneered streaming to the TV, providing a purpose-built operating system (Roku OS) for streaming players and smart TVs. The company operates a platform that connects users to streaming content, enables content publishers to monetize audiences, and provides sophisticated advertising tools.
Related Jobs
GenAI & Agentic AI Architect H/F
Ernst & Young
PARIS · FR
PARIS · FR
Senior AI Engineer – Machine Learning (Computer Vision)
ASOS
GREATER LONDON · GB
GREATER LONDON · GB
Senior AI Deployment Engineer
Moneyboxapp
CITY OF WESTMINSTER · GB
CITY OF WESTMINSTER · GB
Senior AI Engineer, Generative AI & LLM Applications
Harnham
GREATER LONDON · GB
$119K–$119K (est.)
GREATER LONDON · GB
$119K–$119K (est.)
Forward Deployed Engineer, Agentic Platform (UK Public Sector)
Cohere
REMOTE · WORLDWIDE
REMOTE · WORLDWIDE