Search
Go
Senior Lead AI Engineer (FM Hosting, LLM Inference)
CAMBRIDGE · US
$251K–$286K
Full-time
SENIOR
About the Role
Capital One is seeking a Senior Lead AI Engineer to join the Intelligent Foundations and Experiences (IFX) team. You will design and deploy AI software components for foundation model training, LLM inference, and similarity search. Collaborate with cross-functional teams to build scalable AI infrastructure and optimize LLM performance.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, etc.
- Leverage open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, NeMo Guardrails, PyTorch.
- Invent and introduce LLM optimization techniques for scalability, cost, latency, throughput.
- Contribute to the technical vision and roadmap of foundational AI systems.
Requirements
- Bachelor's degree in CS, AI, EE, CE or related plus 6 years experience, or Master's plus 4 years experience.
- At least 6 years programming in Python, Go, Scala, or Java.
Nice to Have
- 7 years experience deploying AI on cloud (AWS, GCP, Azure).
- Experience designing and supporting complex AI systems.
Capital One
Tysons · US · 76300+ employees
Capital One is a major American bank holding company specializing in credit cards, consumer banking, and commercial banking products. It is known for its information-based strategy and technology-driven approach to banking and has grown into one of the largest financial institutions in the United States.
