Hadoop Developer

Requirements:

• Proven experience as a dedicated Big Data or Hadoop Developer
• Mastery of the core Hadoop ecosystem, including HDFS, YARN, MapReduce, Hive, and Oozie
• Strong proficiency with Apache Spark using Java, Scala, or Python
• Deep understanding of distributed storage, cluster performance tuning, and Linux environments
• Hands-on experience with build tools such as Maven or Gradle
• Strong understanding of distributed systems and big data architecture
• Experience with streaming frameworks such as Spark Streaming and Kafka Streams
• This on-premise role is not suited to cloud-native engineers working with AWS EMR or Glue, or Azure Synapse or ADF

Responsibilities:

• Develop and optimize data pipelines using native HDFS, MapReduce, and YARN
• Create high-performance distributed processing jobs with Apache Spark Core or SQL and Hive
• Manage cluster resource allocation, troubleshoot bottlenecks, and tune query performance at the core infrastructure level

Technologies:

• AWS
• Azure
• Big Data
• Cloud
• GCP
• Gradle
• Hadoop
• Hive
• Java
• Kafka
• Linux
• Maven
• Python
• SQL
• Scala
• Spark
• Yarn
• DevOps

More

We are hiring a Hadoop Developer for a contract role based in Scottsdale, Arizona, with onsite work required from day one. This position focuses exclusively on the core Apache Big Data ecosystem running on bare metal; it is not a cloud data engineering role, and we do not use AWS, Azure, or GCP.

last updated 43 week of 2026