Capital One is seeking a Senior Lead AI Engineer to join its Intelligent Foundations and Experiences team, building scalable AI infrastructure and deploying foundation models in production. The role involves designing AI software components such as LLM inference, similarity search, guardrails, and model evaluation, while contributing to the technical vision for foundational AI systems. Ideal candidates have a deep engineering and mathematics background and experience with AI/ML algorithms.
Responsibilities
Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Leverage open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, and PyTorch.
Introduce state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput) of large-scale production AI systems.
Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
Requirements
Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus at least 6 years of experience developing AI/ML algorithms, or a Master's degree plus at least 4 years of experience.
Capital One is a major American bank holding company specializing in credit cards, consumer banking, and commercial banking products. It is known for its information-based strategy and technology-driven approach to banking and has grown into one of the largest financial institutions in the United States.