AI Engineer (GenAI, Agentic AI)

Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 6 years of experience developing AI and ML algorithms or technologies; or a relevant masters degree plus at least 4 years of such experience.
• At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
• Preferred: 7+ years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or an equivalent private cloud.
• Preferred: Experience leading AI systems development and making tradeoffs among cost, latency, throughput, and accuracy.
• Preferred: Experience designing, developing, delivering, and supporting complex AI systems, including agentic AI systems and workflows.
• Preferred: Experience developing AI and ML technologies such as LLM inference, similarity search, vector databases, guardrails, or memory using Python, C++, C#, Java, CUDA, or Go.
• Preferred: Experience applying advanced training and inference optimization techniques to improve hardware utilization, latency, throughput, and cost.
• Preferred: Experience architecting unified production pipelines that integrate rule-based, retrieval-augmented, and generative AI components.
• Preferred: Experience setting and enforcing ethical AI standards, including explainability, fairness, and human-in-the-loop review.
• Preferred: Ability to balance model performance and operating costs through dynamic inference strategies and model compression, and to right-size models, instance counts, and hardware for workload requirements.
• Strong engineering and mathematics foundations, with the technical depth to identify optimization opportunities across hardware, software, and AI systems.
• Ability to assess current research and apply suitable new techniques in production; communicate complex AI concepts clearly; and bring clarity to ambiguous problems.
• A commitment to high-quality work, responsible practices, and advancing customer-focused banking experiences.

Responsibilities:

• Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
• Design, build, test, deploy, and support AI software components, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
• Develop and introduce foundation-model optimization techniques that improve the scalability, cost, latency, and throughput of production AI systems.
• Help shape the technical vision and long-term roadmap for foundational AI systems.
• Design and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models.
• Lead cost-performance governance reviews, tracking GPU utilization, model throughput, and inference cost efficiency.
• Lead design councils or review boards to promote technical consistency and compliance with AI engineering standards.
• Mentor Principal- and Manager-level AI engineers and support cross-domain learning and organizational technical growth.

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Machine Learning
• Model Training
• PyTorch
• Python
• Scala
• Golang

More

We are Capital One, where we use technology and machine learning to create personalized customer experiences and make banking simpler. Our Intelligent Foundations and Experiences team works with partners across the company to advance AI science and engineering and build proprietary, responsible, scalable AI platforms that support products used by millions of customers. This AI Engineer 5 role is based in Cambridge, Massachusetts; McLean, Virginia; New York, New York; San Francisco, California; or San Jose, California. Listed annual salary ranges are $229,900–$262,400 in Cambridge and McLean, and $250,800–$286,200 in New York, San Francisco, and San Jose; compensation for other locations varies. The role may also include performance-based incentives. We offer health, financial, and other benefits, with eligibility varying by employment status and level. We will consider sponsoring a new qualified applicant for employment authorization.

last updated 43 week of 2026