Sr. Manager, AI Engineer

Requirements:

• We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 6 years of experience developing AI and ML algorithms or technologies; or a masters degree in one of these fields plus at least 4 years of relevant AI and ML experience.
• We require at least 1 year of people leadership experience.
• We prefer 3 years of experience managing and leading an engineering team.
• We prefer 6 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
• We prefer experience developing AI and ML technologies such as LLM inference, similarity search and VectorDBs, guardrails, or memory using Python, C++, C#, Java, CUDA, or Golang.
• We prefer experience building agentic AI systems and agentic workflows.
• We prefer a strong interest in current AI research and the ability to apply new methods thoughtfully in production.
• We prefer excellent communication and presentation skills, with the ability to explain complex AI concepts clearly.
• We prefer experience leading technical strategy for a multidisciplinary AI team, balancing research exploration with production delivery.
• We prefer familiarity with MLOps and AI observability, including evaluation pipelines, drift monitoring, and model or version governance.
• We prefer a track record of mentoring engineers and scientists to turn prototypes into production systems and meet production SLOs.
• We prefer experience sizing models, instance counts, and hardware types based on requirements such as context length, token inputs, and token outputs.

Responsibilities:

• We partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers interact with Capital One.
• We oversee the design, development, testing, deployment, and support of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• We make high-judgment build-versus-buy decisions across a broad set of open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, VectorDBs, and PyTorch.
• We invent and introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput in large-scale production AI systems.
• We contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
• We attract and retain top AI talent while supporting team members personal and professional growth through a culture of learning and staying current with the state of the art.
• We translate enterprise AI goals into actionable team roadmaps with measurable outcomes and regular updates.
• We operationalize Responsible AI by establishing review gates, documentation and evaluation requirements, and rollout or rollback standards for all production AI systems.
• We build strong collaboration points with Research, Data, and Platform teams to accelerate the model lifecycle.

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Golang
• Hardware
• Support
• Java
• LLM
• MLOps
• Model Training
• PyTorch
• Python
• Machine Learning

More

At Capital One, we are building responsible and reliable AI systems to help change banking for good. Our Intelligent Foundations and Experiences team sits at the center of that vision, working closely with partners across the company to advance AI science and engineering, build proprietary solutions, and deliver value to millions of customers. We offer a comprehensive, competitive, and inclusive benefits package that supports overall well-being, along with performance-based incentive compensation that may include cash bonuses and long-term incentives. This role includes salary ranges that vary by location, with positions available in Cambridge, McLean, New York, San Francisco, and San Jose. We may also consider sponsorship for a new qualified applicant for employment authorization for this position.

last updated 43 week of 2026