Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)

Capital One is seeking a Lead AI Engineer to join the Intelligent Foundations and Experiences team to build responsible and reliable AI systems. The role involves designing and deploying AI software components including foundation model training, LLM inference, and orchestration. You will work with a broad stack of open-source and SaaS AI technologies to improve performance and contribute to the technical vision of foundational AI systems.

• Partner with a cross-functional team of engineers, research scientists, and product managers to deliver AI-powered products. Design, develop, test, deploy, and support AI software components such as foundation model training, LLM inference, similarity search, guardrails, and model evaluation. Leverage technologies like AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch. Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput. Contribute to the technical vision and long-term roadmap of foundational AI systems.

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms, or Master's degree plus at least 2 years. At least 4 years of programming experience with Python, Go, Scala, or Java.

• 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, GCP, Azure). Experience designing, developing, and supporting AI services. Experience with LLM inference, similarity search, VectorDBs, guardrails, and memory. Passion for staying abreast of the latest AI research and applying novel techniques in production.