AI Engineer (Generative AI Platform, Agentic AI)

Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 4 years of experience developing AI/ML algorithms or technologies; or a relevant masters degree and at least 2 years of experience in this area.
• At least 4 years of programming experience with Python, Go, Scala, CUDA, or Java.
• Preferred: Experience leading AI system development and making tradeoff decisions involving cost, latency, throughput, and accuracy.
• Preferred: 6 or more years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
• Preferred: At least 3 years of Kubernetes experience.
• Preferred: Experience designing, developing, delivering, and supporting AI services.
• Preferred: Experience developing AI/ML technologies such as LLM inference, similarity search, vector databases, guardrails, or memory systems, using Python, C++, C#, Java, CUDA, or Go.
• Preferred: Experience optimizing AI training and inference software to improve hardware utilization, latency, throughput, and cost.
• Preferred: Experience building agentic AI systems and workflows.
• Preferred: Knowledge of current AI research and ability to apply new techniques in production.
• Preferred: Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale.
• Preferred: Experience defining AI model governance processes, including production readiness, lineage tracking, and automated retraining schedules.
• Preferred: Ability to influence architectural decisions across multiple AI product lines or platforms.
• Ideal candidates bring strong engineering and mathematics foundations, technical expertise across hardware, software, and AI, curiosity, adaptability, resilience, and a commitment to high-quality, responsible work.

Responsibilities:

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers.
• Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
• Develop foundation-model optimization techniques to improve the scalability, cost, latency, and throughput of production AI systems.
• Help shape the technical vision and long-term roadmap for our foundational AI systems.
• Own end-to-end architecture for complex AI systems, with attention to maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives for AI reliability, including latency, uptime, and model-performance drift.
• Work with infrastructure engineering to improve GPU/TPU utilization and accelerate model-inference pipelines.
• Lead technical reviews for AI system deployments, ensuring security, data governance, and compliance standards are met.
• Mentor Principal and Senior Associates in scalable design, performance tuning, and translating research into production.

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• Kubernetes
• LLM
• Machine Learning
• Model Training
• PyTorch
• Python
• Scala
• Security
• Golang

More

We are hiring an AI Engineer 4 for our Gen AI Platform Services: Agentic AI work at Capital One. We build responsible, reliable AI systems and use machine learning to create personalized customer experiences and improve how banking serves customers and businesses. The Intelligent Foundations and Experiences team works with partners across the company to advance AI science and engineering and deploy proprietary platforms that support products used by millions. The role is available in Cambridge, Massachusetts; McLean, Virginia; New York, New York; San Francisco, California; and San Jose, California. Listed annual salary ranges are $197,300–$225,100 in Cambridge and McLean, and $215,200–$245,600 in New York, San Francisco, and San Jose; pay for other locations varies. The role may also include performance-based incentives. We offer health, financial, and other benefits, with eligibility depending on employment status and level. We will consider sponsoring employment authorization for a qualified applicant. Capital One is an equal opportunity employer and provides accommodations for applicants who need them.

last updated 43 week of 2026