AI Engineer (Gen AI Platform Services, Agentic AI)

Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 6 years of experience developing AI/ML algorithms or technologies; alternatively, a masters degree in one of these fields and at least 4 years of relevant experience.
• At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
• Experience leading AI system development and making tradeoffs among cost, latency, throughput, and accuracy.
• 7+ years of experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
• Experience designing, developing, delivering, and supporting complex AI systems.
• Experience developing AI/ML algorithms or technologies, such as LLM inference, similarity search, vector databases, guardrails, or memory, using Python, C++, C#, Java, CUDA, or Go.
• Experience optimizing AI training and inference software to improve hardware utilization, latency, throughput, and cost.
• Experience building agentic AI systems and workflows.
• Strong interest in current AI research and the ability to apply novel techniques judiciously in production.
• Excellent communication and presentation skills, including the ability to explain complex AI concepts to peers.
• Experience integrating rule-based, retrieval-augmented, and generative AI components into unified production pipelines.
• Experience defining and enforcing ethical AI deployment standards, including explainability, fairness, and human-in-the-loop review.
• Ability to balance model performance and operating costs through dynamic inference strategies and model compression.
• Experience sizing models, instance counts, and hardware to meet requirements such as context length and input and output token volumes.
• Strong engineering and mathematics fundamentals, technical expertise across hardware, software, and AI, and the ability to investigate complex, ambiguous problems.
• For this position, we will consider sponsoring a new qualified applicant for employment authorization.

Responsibilities:

• Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers.
• Design, develop, test, deploy, and support AI software, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
• Develop foundation model optimization techniques to improve the scalability, cost, latency, and throughput of large-scale production AI systems.
• Help shape the technical vision and long-term roadmap for our foundational AI systems.
• Design, implement, and optimize multi-model orchestration pipelines that combine LLMs, vector search, and domain-specific models.
• Lead cost-performance governance reviews, monitoring GPU utilization, model throughput, and inference cost efficiency.
• Lead design councils or review boards to promote technical consistency and compliance with AI engineering standards.
• Mentor Principal- and Manager-level AI engineers, supporting cross-domain learning and organizational technical growth.

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Model Training
• PyTorch
• Python
• Scala
• Golang
• Machine Learning

More

We are Capital One, where we build responsible, reliable AI systems to improve banking and create personalized customer experiences. Our Intelligent Foundations and Experiences team partners across the company to advance AI science and engineering and deliver proprietary, scalable solutions that serve millions of customers. This AI Engineer 5 role is based in Cambridge, Massachusetts; McLean, Virginia; New York, New York; San Francisco, California; or San Jose, California. The listed annual salary ranges are $229,900–$262,400 in Cambridge and McLean, and $250,800–$286,200 in New York, San Francisco, and San Jose; pay for other locations varies. The role is eligible for performance-based incentives, and we offer comprehensive health, financial, and other benefits, with eligibility depending on employment status and level. We are an equal opportunity employer and provide an inclusive workplace.

last updated 43 week of 2026