AI Engineer (MLX, Agentic AI) - New York

Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 4 years of experience developing AI/ML algorithms or technologies; or a relevant masters degree and at least 2 years of that experience
• At least 4 years of programming experience with Python, Go, Scala, CUDA, or Java
• Ability to build high-quality systems, apply sound judgment, and contribute to work aimed at improving banking
• Interest in current AI research and ability to assess scientific publications and apply relevant techniques in production
• Ability to navigate ambiguity, investigate complex problems, communicate findings clearly, and propose new ideas
• Strong engineering and mathematical foundations, with technical knowledge across hardware, software, and AI
• Resilience and resourcefulness in finding paths toward business goals
• Preferred: Experience leading AI system development and balancing cost, latency, throughput, and accuracy
• Preferred: 6 or more years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or private cloud
• Preferred: Experience designing, developing, delivering, and supporting AI services
• Preferred: Experience building AI/ML algorithms or technologies, such as LLM inference, similarity search, vector databases, guardrails, or memory, using Python, C++, C#, Java, CUDA, or Go
• Preferred: Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Preferred: Experience building agentic AI systems and workflows
• Preferred: Expertise in distributed systems for model training, evaluation, and online inference at petabyte scale
• Preferred: Experience defining AI model governance processes, including production readiness, lineage tracking, and automated retraining schedules
• Preferred: Demonstrated ability to influence architecture across multiple AI product lines or platforms

Responsibilities:

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers
• Design, develop, test, deploy, and support AI components, including foundation model training, LLM inference, agent and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch
• Develop advanced foundation-model optimization techniques to improve the scalability, cost, latency, and throughput of production AI systems
• Help shape the technical vision and long-term roadmap for foundational AI systems
• Own end-to-end architecture for complex AI systems, ensuring maintainability, observability, and ethical alignment
• Establish and maintain AI reliability service-level objectives, including latency, uptime, and model performance drift
• Work with infrastructure engineering to improve GPU/TPU utilization and accelerate model inference pipelines
• Lead cross-functional technical reviews of AI deployments, ensuring security, data governance, and compliance standards are met
• Mentor Principal and Senior Associates in scalable design, performance tuning, and translating research into production

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Model Training
• PyTorch
• Python
• Scala
• Security
• Golang
• Machine Learning

More

We are hiring an AI Engineer 4 for Capital Ones Intelligent Foundations and Experiences team, which works across the company to advance AI science and engineering and build proprietary solutions and platforms used by teams serving millions of customers. Our work focuses on responsible, scalable AI and on creating reliable systems and new product experiences. The role is available in McLean, Virginia; Cambridge, Massachusetts; New York, New York; San Francisco, California; and San Jose, California. Posted full-time annual salary ranges are $197,300–$225,100 in McLean and Cambridge, and $215,200–$245,600 in New York, San Francisco, and San Jose; pay for other locations varies. The position may also include performance-based cash bonuses and/or long-term incentives. We offer health, financial, and other benefits, with eligibility depending on employment status and level. We will consider sponsorship of a new qualified applicant for employment authorization.

last updated 44 week of 2026