AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

Sourced from jobs.equest.com

Capital One's Intelligent Foundations and Experiences team is hiring a senior AI Engineer to build and deploy production Gen AI platform services, including agentic workflows, LLM inference, guardrails, and model evaluation. The role spans foundation model optimization, multi-model orchestration, and cost-performance governance for large-scale AI systems serving millions of customers. You will partner with cross-functional teams and mentor senior AI engineers while shaping the technical roadmap for foundational AI systems.

• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, similarity search, guardrails, and observability
• Optimize foundation models for scalability, cost, latency, and throughput in production AI systems
• Build and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models
• Lead cost-performance governance reviews tracking GPU utilization, model throughput, and inference cost efficiency
• Mentor Principal and Manager-level AI engineers and lead design review boards
• Contribute to the technical vision and long-term roadmap of foundational AI systems

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus 6+ years of experience developing AI/ML algorithms or technologies, or Master's degree plus 4+ years
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java
• Experience designing and deploying scalable AI systems on cloud platforms
• Strong foundation in engineering and mathematics with expertise across hardware, software, and AI

• 7+ years deploying scalable and responsible AI solutions on AWS, Google Cloud, Azure, or private cloud
• Experience with LLM inference, similarity search, VectorDBs, guardrails, and memory systems
• Experience building agentic AI systems and agentic workflows
• Experience optimizing training and inference software for hardware utilization, latency, throughput, and cost
• Experience defining standards for ethical AI deployment including explainability, fairness, and human-in-the-loop review
• Excellent communication and presentation skills