Search
Go
Senior Lead AI Engineer (FM Hosting, LLM Inference)
Summary by AIEngineer.careers
Senior Lead AI Engineer (FM Hosting, LLM Inference) is a AI Engineer role (full-time). with Capital One. in CAMBRIDGE, US. Compensation shown: $251K–$286K. Imported listing (source: capitalonecareers.com). Apply on the employer's site (capitalonecareers.com).
Imported listing (source: capitalonecareers.com) · Apply on capitalonecareers.com
CAMBRIDGE · US
$251K–$286K
Full-time
SENIOR
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from capitalonecareers.com
Capital One is seeking a Senior Lead AI Engineer to join the Intelligent Foundations and Experiences (IFX) team. You will design and deploy AI software components for foundation model training, LLM inference, and similarity search. Collaborate with cross-functional teams to build scalable AI infrastructure and optimize LLM performance.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, etc.
- Leverage open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, NeMo Guardrails, PyTorch.
- Invent and introduce LLM optimization techniques for scalability, cost, latency, throughput.
- Contribute to the technical vision and roadmap of foundational AI systems.
Requirements
- Bachelor's degree in CS, AI, EE, CE or related plus 6 years experience, or Master's plus 4 years experience.
- At least 6 years programming in Python, Go, Scala, or Java.
Nice to Have
- 7 years experience deploying AI on cloud (AWS, GCP, Azure).
Capital One
McLean · US · 51411+ employees
Capital One is a diversified financial services holding company headquartered in McLean, Virginia. It offers banking and non-banking subsidiaries and provides a broad array of financial products and services to consumers, small businesses, and commercial clients through digital channels, branch locations, cafés, and other distribution channels.
