Senior Software Engineer (AI Infrastructure)

Requirements:

• At least 5 years of relevant experience
• Strong backend development skills in Python and Scala
• Experience designing, building, and maintaining production distributed systems and microservices
• Hands-on experience with Kubernetes, containerized applications, and cloud infrastructure
• Ability to identify and resolve performance bottlenecks related to latency, concurrency, and throughput
• Experience deploying or operating machine learning models through production APIs, with an understanding of inference performance
• Practical knowledge of MLOps, including model serving, monitoring, deployment, and operational reliability
• Familiarity with LLM-powered applications and the backend architecture used for generative AI
• Understanding of production observability, including logging, metrics, tracing, and performance monitoring

Responsibilities:

• Build and optimize production microservices in Python and Scala for AI integrations, application APIs, and distributed backend systems
• Improve scalability and performance by addressing latency, concurrency, throughput, and resource utilization bottlenecks
• Assess and implement model-serving approaches, including self-hosted inference, GPU utilization, autoscaling, and cost optimization
• Oversee the performance, monitoring, deployment, and operational health of AI services running in Kubernetes
• Work with engineering teams to improve system architecture, measure performance, and deliver scalable AI capabilities

Technologies:

• AI
• Backend
• Cloud
• Kubernetes
• LLM
• Machine Learning
• MLOps
• Model Serving
• Python
• Scala
• microservices

More

We are an early-stage, well-funded AI startup working to reshape how people interact with intelligent systems, and we are growing our platform services. This role focuses on production AI infrastructure and model-serving capabilities, including evaluating a move from managed AI services to self-hosted models. The position is fully remote, with a salary range of $170,000–$200,000 per year, competitive compensation, equity, healthcare benefits, autonomy, and opportunities for career growth. Our team includes experienced engineers, and we provide an inclusive work environment.

last updated 43 week of 2026