ML Kernel Performance Engineer, AWS Neuron

Requirements:

• 3+ years of professional software development experience outside of internships
• 2+ years of experience designing or architecting new and existing systems, including design patterns, reliability, and scaling
• Experience programming in at least one software development language
• 3+ years of full software development lifecycle experience, including coding standards, code reviews, source control, build processes, testing, and operations
• Bachelors degree in computer science or an equivalent background

Responsibilities:

• Design and build high-performance compute kernels for machine learning operations using the Neuron architecture and programming models
• Evaluate and improve kernel-level performance across multiple generations of Neuron hardware
• Use profiling tools to perform detailed performance analysis and remove bottlenecks
• Apply compiler optimizations such as fusion, sharding, tiling, and scheduling
• Work directly with customers to enable and tune their machine learning models on AWS accelerators
• Partner with compiler, runtime, framework, and hardware teams to create new kernel optimization techniques
• Build metrics, automation, and other improvements to strengthen software architecture and resolve root-cause defects
• Deliver impactful solutions for our customer base
• Take part in design discussions and code reviews while communicating with internal and external stakeholders
• Collaborate cross-functionally to support business decisions with technical input
• Work in a fast-moving, startup-like development environment

Technologies:

• AWS
• Hardware
• Support
• Machine Learning
• Web
• Cloud
• AI
• Architect
• Backbone
• Flow
• PyTorch

More

We are the Annapurna Labs team at Amazon Web Services, building AWS Neuron, the software development kit that accelerates deep learning and GenAI workloads on our custom machine learning accelerators, Inferentia and Trainium. Our Acceleration Kernel Library team works at the hardware-software boundary to develop performance-focused kernels and help customers get the most out of AWS ML accelerators. We operate across the broader Neuron Compiler organization, spanning frameworks, compilers, runtime, and collectives, and we also contribute to future architecture design. This role offers the chance to work on cutting-edge products at the intersection of machine learning, high-performance computing, and distributed systems in a culture that values experimentation, inclusion, and work-life balance. The position is based in Cupertino, California, and Amazon offers a comprehensive benefits package including health coverage, retirement matching, paid time off, parental leave, sign-on payments, and RSUs.

last updated 43 week of 2026