Lavora.

Back to search

Lead Python AI Engineer

EPAM Systems

Location
New York, US
Workplace
On-site
Job type
Full-time
Salary
$65k–$102k
Posted
1 week ago
Source
DevITJobs

Requirements:

  • 7+ years of backend engineering experience, particularly with microservices and distributed systems, using Python to build high-performance services and cloud-native APIs.
  • Hands-on experience with AWS, Docker, ECS or EKS, and RESTful APIs.
  • Proven secure-coding experience and strong knowledge of authentication and authorization fundamentals.
  • Practical experience with agent frameworks such as LangChain, LlamaIndex, or LangGraph.
  • 1–2+ years of production experience integrating AI SDKs such as OpenAI, Anthropic/Claude, or AWS Bedrock.
  • Familiarity with AI evaluation tools or real-time application performance monitoring platforms such as LangSmith, Langfuse, or Arize.
  • Practical experience with vector databases, advanced embedding strategies, and retrieval systems, such as Amazon Kendra or OpenSearch.
  • Nice to have: 1–2+ years of experience with React and TypeScript.
  • Nice to have: Experience deploying applications to EKS at scale.
  • Nice to have: Knowledge of agent interoperability patterns such as MCP, identity and security domain models such as IAM or CIAM, and professional proficiency in Java, Node.js, or Go.

Responsibilities:

  • Own API contracts and service reliability end to end, ensuring AI-related edge cases fail gracefully without compromising system integrity.
  • Integrate language models using rigorous engineering practices, including evaluation, observability, fallback handling, and cost awareness.
  • Create reliable, reusable orchestration frameworks and logic for downstream developers.
  • Design and build scalable backend API services and advanced LLM orchestration layers.
  • Develop and maintain complex RAG pipelines, including document ingestion, chunking, embedding, and retrieval optimization.
  • Develop and connect agent tools using LangChain, LangGraph, and potentially MCP.
  • Ensure strong security and privacy, enterprise-grade observability, and comprehensive test coverage across backend workflows.
  • Contribute to architecture decisions and engineering standards within the pod.
  • Collaborate with frontend engineers, data engineers, and infrastructure teams.

Technologies:

  • AI
  • API
  • AWS
  • OpenSearch
  • Backend
  • Cloud
  • Docker
  • Frontend
  • IAM
  • Java
  • LLM
  • Langfuse
  • MCP
  • Python
  • RAG
  • React
  • Security
  • TypeScript
  • microservices
  • NodeJS

More

We are seeking a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows that connect traditional backend systems with modern language models, internal systems, vector databases, and external tools. We approach LLMs as components of secure, scalable distributed systems, with a focus on reliable APIs, graceful failure handling, and production-grade AI integration. The role involves building secure, scalable services and orchestration capabilities for our engineering teams.

last updated 43 week of 2026