Lead Platform Engineer/Architect - HPC, Kubernetes
EPAM Systems
- Location
- New York, US
- Workplace
- On-site
- Job type
- Full-time
- Salary
- $65k–$102k
- Posted
- 2 weeks ago
- Source
- DevITJobs
Requirements:
- 10+ years of experience in infrastructure engineering, cloud platforms, or high-performance computing environments
- Expert-level Kubernetes experience at meaningful scale, including node pool sizing, scheduler debugging, CNI troubleshooting, and rolling upgrades across large fleets
- Advanced Python skills and a track record of building production-grade tools; experience with Go, Rust, or C++ is a strong plus
- Daily proficiency with Terraform for writing and reviewing infrastructure as code
- Working knowledge of core AWS services, including EC2, S3, EFS, and FSx for Lustre
- Strong site reliability engineering background, including experience establishing monitoring, alerting, and incident response practices
- CKA and CKS certifications are highly preferred
Responsibilities:
- Operate and scale Kubernetes platforms, including EKS, GKE, and other distributions, managing cluster lifecycles, optimizing node pools, and configuring networking policies during rapid growth
- Provision and manage HPC infrastructure through CI/CD pipelines across AWS, CoreWeave, Google Cloud Platform, OCI, and other cloud providers
- Design and maintain job scheduling systems that allocate GPU compute resources efficiently across training and inference workloads
- Define SLIs and SLOs, develop monitoring and alerting systems, and take part in incident response and post-incident reviews
- Develop production-quality tooling and automation for large-scale, multi-cloud infrastructure operations
- Collaborate with Networking, Storage, Security, and AI/ML platform teams to deliver infrastructure across functions
Technologies:
- AI
- AWS
- CI/CD
- Cloud
- EC2
- Kubernetes
- Python
- Rust
- Security
- Terraform
- NodeJS
- Architect
- Support
More
Join our high-growth infrastructure team, where we operate Kubernetes platforms across multiple cloud providers at massive scale. In this role, your code and configurations will help protect thousands of GPU-hours from costly failures. At EPAM, we help technology talent grow through groundbreaking work, world-class learning platforms, and collaboration with a global community of problem-solvers.
last updated 43 week of 2026