AI Engineer (GenAI Platform, Agentic Systems)

Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 4 years of experience developing AI/ML algorithms or technologies; alternatively, a relevant masters degree and at least 2 years of that experience
• At least 4 years of programming experience with Python, Go, Scala, CUDA, or Java
• Preferred: Experience leading AI system development and making trade-offs among cost, latency, throughput, and accuracy
• Preferred: 6 or more years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or an equivalent private cloud
• Preferred: Experience designing, building, delivering, and supporting AI services
• Preferred: Experience developing AI/ML algorithms or technologies, such as LLM inference, similarity search, vector databases, guardrails, or memory, using Python, C++, C#, Java, CUDA, or Go
• Preferred: Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Preferred: Experience building agentic AI systems and workflows
• Preferred: Ability to follow current AI research and apply relevant techniques in production
• Preferred: Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale
• Preferred: Experience defining AI model governance processes, including producibility, lineage tracking, and automated retraining schedules
• Preferred: Ability to influence architectural decisions across multiple AI products or platforms
• Ideal candidates take pride in high-quality engineering, value responsible practices, follow AI research, and can apply new techniques thoughtfully
• Ideal candidates bring strong engineering, mathematics, hardware, software, and AI knowledge; adapt to ambiguous challenges; communicate findings clearly; and show resilience and initiative

Responsibilities:

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers
• Design, build, test, deploy, and support AI components, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch
• Develop advanced foundation-model optimization techniques to improve the scalability, cost, latency, and throughput of production AI systems
• Help shape our technical vision and long-term roadmap for foundational AI systems
• Own end-to-end architecture for complex AI systems, with attention to maintainability, observability, and ethical alignment
• Define and maintain AI reliability service-level objectives, including latency, uptime, and model-performance drift
• Work with infrastructure engineering to improve GPU/TPU utilization and accelerate model inference pipelines
• Lead cross-functional technical reviews of AI system deployments and ensure security, data governance, and compliance standards are met
• Mentor Principal and Senior Associates in scalable design, performance tuning, and translating research into production

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Model Training
• PyTorch
• Python
• Scala
• Security
• Golang
• Machine Learning

More

At Capital One, we build responsible, reliable AI systems to improve banking and create personalized customer experiences. Our Intelligent Foundations and Experiences team works across the company to advance AI science and engineering and deliver proprietary, scalable solutions used by teams and millions of customers. This AI Engineer 4 role is available in Cambridge, Massachusetts; McLean, Virginia; New York, New York; San Francisco, California; and San Jose, California. The listed annual salary ranges are $197,300–$225,100 in Cambridge and McLean, and $215,200–$245,600 in New York, San Francisco, and San Jose; compensation for other locations varies. The role may also include performance-based incentives. We offer health, financial, and other benefits, with eligibility varying by employment status and level. Capital One states that it will consider sponsoring qualified applicants for employment authorization and is an equal opportunity employer.

last updated 44 week of 2026