Search
Go
AI Infrastructure Engineer - Recommendation & LLM
Summary by AIEngineer.careers
AI Infrastructure Engineer - Recommendation & LLM is a AI Infrastructure Engineer role (full-time). with TikTok. in SAN JOSE, US. Compensation shown: $128K–$317K. Imported listing (source: themuse.com). Apply on the employer's site (themuse.com).
Imported listing (source: themuse.com) · Apply on themuse.com
SAN JOSE · US
$128K–$317K
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from themuse.com
Join TikTok's Model Infrastructure team to build and optimize the core AI systems powering its recommendation engine and Large Language Models. This role focuses on designing scalable distributed training and serving infrastructure, optimizing GPU performance, and productionizing state-of-the-art ML algorithms at massive scale.
Responsibilities
- Design and optimize large-scale AI training and online inference infrastructure for recommendation models and LLMs.
- Drive architecture and implementation of distributed training and serving systems ensuring high scalability and reliability.
- Optimize end-to-end model performance across GPU computation, memory, networking, and runtime systems.
- Develop LLM training/serving infrastructure including model parallelism, KV Cache, and Continuous Batching.
- Identify and resolve performance bottlenecks across the full AI stack from model frameworks to GPU kernels.
Requirements
- Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or equivalent experience.
- 3+ years of experience in software engineering, ML systems, or distributed systems.
- Strong programming skills in C++ or Python with a focus on production-quality software.
TikTok
Los Angeles · US · 36997+ employees
TikTok is a short-form video hosting social media platform owned by ByteDance. It provides tools for content creation, sharing, and social networking, serving a global audience.
