AI Engineer (GenAI Platform and Agentic Systems)

Requirements:

• We require a bachelors degree in computer science, AI, electrical engineering, computer engineering, or a related field and at least 6 years of experience developing AI/ML algorithms or technologies; alternatively, a masters degree in one of these fields and at least 4 years of relevant experience.
• We require at least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
• We prefer experience leading AI systems development and making tradeoffs among cost, latency, throughput, and accuracy.
• We prefer 7 or more years of experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
• We value experience designing, developing, delivering, and supporting complex AI systems, including agentic systems and workflows.
• We prefer experience developing AI/ML technologies such as LLM inference, similarity search, vector databases, guardrails, and memory using Python, C++, C#, Java, CUDA, or Go.
• We value experience optimizing AI training and inference software for hardware utilization, latency, throughput, and cost, including model compression and right-sizing models, instances, and hardware.
• We prefer experience architecting and integrating rule-based, retrieval-augmented, and generative AI components into unified production pipelines.
• We value experience setting standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review.
• We seek strong communication and presentation skills, sound engineering and mathematical foundations, adaptability in ambiguous situations, and an ability to apply current AI research thoughtfully in production.
• We value resilience, initiative, a commitment to high-quality work, and a passion for building responsible AI systems that improve banking.

Responsibilities:

• We collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers.
• We design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• We use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
• We develop and apply foundation-model optimization techniques to improve the scalability, cost, latency, and throughput of production AI systems.
• We contribute to the technical vision and long-term roadmap for our foundational AI systems.
• We design, implement, and optimize multi-model orchestration pipelines that combine LLMs, vector search, and domain-specific models.
• We lead cost-performance governance reviews, tracking GPU utilization, model throughput, and inference-cost efficiency.
• We lead design councils or review boards to promote technical consistency and adherence to AI engineering standards.
• We mentor Principal- and Manager-level AI engineers and support cross-domain learning and organizational technical growth.

Technologies:

• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Model Training
• PyTorch
• Python
• Scala
• Agentic AI
• Golang
• Machine Learning

More

We are hiring an AI Engineer 5 for our Gen AI Platform Services: Agentic Systems work at Capital One. We build responsible, reliable AI systems to improve banking and customer experiences. Our Intelligent Foundations and Experiences team partners across the company to advance AI science and engineering and develop proprietary solutions and platforms used by teams and millions of customers. The role is listed in Cambridge, Massachusetts; McLean, Virginia; New York, New York; San Francisco, California; and San Jose, California. The stated annual salary ranges are $229,900–$262,400 in Cambridge and McLean, and $250,800–$286,200 in New York, San Francisco, and San Jose; pay ranges vary by work location, and the role may also include performance-based incentives. We offer health, financial, and other benefits, with eligibility varying by employment status and level. We will consider sponsoring a qualified applicant for employment authorization.

last updated 43 week of 2026