AI Engineer (Gen AI SDK, Agentic AI)

Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 6 years of experience developing AI/ML algorithms or technologies; or a masters degree in one of these fields plus at least 4 years of relevant experience
• At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java
• Preferred: Experience leading AI systems development and making tradeoffs among cost, latency, throughput, and accuracy
• Preferred: 7 or more years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
• Preferred: Experience designing, developing, delivering, and supporting complex AI systems
• Preferred: Experience developing AI/ML technologies such as LLM inference, similarity search, vector databases, guardrails, or memory using Python, C++, C#, Java, CUDA, or Go
• Preferred: Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Preferred: Experience building agentic AI systems and workflows
• Preferred: Strong interest in current AI research and applying new techniques judiciously in production
• Preferred: Excellent communication and presentation skills, including the ability to explain complex AI concepts to peers
• Preferred: Experience integrating rule-based, retrieval-augmented, and generative AI components into unified production pipelines
• Preferred: Experience establishing and enforcing ethical AI standards, including explainability, fairness, and human-in-the-loop review
• Preferred: Ability to balance model performance and operating costs through dynamic inference strategies and model compression
• Preferred: Experience selecting appropriate model sizes, instance counts, and hardware for requirements such as context length and input and output token volumes
• Strong engineering and mathematics foundation, technical depth across hardware, software, and AI, and an ability to identify optimization opportunities
• Ability to adapt to ambiguity, investigate root causes, communicate findings clearly, share new ideas, and find paths forward to meet business goals
• Commitment to high-quality work, responsible AI, and staying current with scientific research

Responsibilities:

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers
• Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch
• Develop foundation model optimization techniques that improve the scalability, cost, latency, and throughput of production AI systems
• Contribute to the technical vision and long-term roadmap for our foundational AI systems
• Design, implement, and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models
• Lead cost-performance governance reviews, monitoring GPU utilization, model throughput, and inference-cost efficiency
• Lead design councils or review boards to support technical consistency and compliance with AI engineering standards
• Mentor Principal- and Manager-level AI engineers, encouraging cross-domain learning and strengthening organizational technical capabilities

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Machine Learning
• Model Training
• PyTorch
• Python
• Scala
• Golang

More

At Capital One, we build responsible, reliable AI systems to improve banking, drawing on our experience in machine learning, technology infrastructure, and applied science. This AI Engineer 5 role is part of our Intelligent Foundations and Experiences team, which partners across the company to advance AI engineering and deliver proprietary, scalable solutions used by teams and customers. We are hiring in Cambridge, Massachusetts; McLean, Virginia; New York, New York; San Francisco, California; and San Jose, California. The listed annual salary ranges are $229,900–$262,400 in Cambridge and McLean, and $250,800–$286,200 in New York, San Francisco, and San Jose; pay ranges vary by work location. The role may also include performance-based incentives and is eligible for our health, financial, and other benefits, with eligibility depending on employment status and level. We will consider sponsoring a qualified new applicant for employment authorization.

last updated 43 week of 2026