Senior Azure Databricks Engineer

Requirements:

• 8–10 years of experience designing and implementing enterprise data platforms
• At least 5 years of hands-on experience with Azure Databricks in enterprise environments
• Experience architecting modern Lakehouse solutions using Azure Databricks and Delta Lake
• Experience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security
• Experience developing data engineering solutions with Apache Spark, using PySpark and/or Spark SQL
• Experience implementing enterprise data governance, including metadata management, data lineage, and fine-grained access controls
• Experience designing enterprise security architectures involving RBAC, managed identities, private endpoints, Key Vault, encryption, and network security
• Experience implementing data quality frameworks, monitoring, observability, and operational dashboards
• Strong understanding of data modeling, including dimensional modeling, Data Vault, medallion architecture, and enterprise data warehouse concepts
• Strong knowledge of Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Microsoft Entra ID, and Azure networking
• Strong SQL skills and proficiency in Python and PySpark
• Strong experience implementing CI/CD pipelines with Azure DevOps, automated testing, release management, and deployment automation

Responsibilities:

• Collaborate with our Data Platforms and Integration team to architect and implement scalable enterprise data platforms using Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, and related Azure services
• Design and develop data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics workloads
• Administer and maintain Azure Databricks workspaces, including clusters, job scheduling, Unity Catalog, secrets, compute and cluster policies, and workspace governance
• Define and implement security architecture covering identity integration, access controls, privileged identity management, encryption, private networking, managed identities, Key Vault, and secure access
• Establish data governance standards for lineage, data quality, metadata, catalog organization, access policies, and auditing
• Optimize Databricks workloads through Spark and performance tuning, cluster sizing, workload isolation, caching, partitioning, Delta optimization, Photon, and cost management
• Design monitoring, logging, operational dashboards, alerting, and platform health monitoring using Azure Monitor, Log Analytics, Application Insights, and Databricks system tables
• Develop reusable architecture patterns, reference implementations, development standards, naming and coding conventions, operational procedures, and platform documentation
• Support migrations of legacy data warehouses, ETL solutions, and reporting platforms to Azure Databricks and Lakehouse architecture
• Troubleshoot and provide technical support for production incidents involving Databricks, Spark workloads, data pipelines, and platform infrastructure

Technologies:

• Architect
• Azure
• CI/CD
• Data Vault
• Data Warehouse
• Databricks
• DevOps
• ETL
• Support
• Network
• Python
• PySpark
• RBAC
• SQL
• Security
• Spark
• Unity
• Cloud
• GameDev

More

We offer a pay range of $51.40–$66.71 per hour. Our benefits include medical, dental, and vision insurance; a 401(k), health savings account, disability and life insurance, paid sick leave where required by law, supplemental insurance, identity theft protection, pet insurance, wellness programs, an employee assistance program, and career development opportunities. Eligibility and plan terms may vary by employment status, service length, and work location, and benefits may be changed in accordance with applicable laws. Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. provides technology staffing and workforce solutions to Fortune 500 companies, government agencies, and enterprises across the United States and Canada. We support staffing across IT, engineering, life sciences, clinical, and professional fields, with recruiting operations in North America and Asia. We are a certified Minority Business Enterprise and hold ISO 9001, ISO 14001, ISO 27001, and SOC 2 Type II certifications.

last updated 43 week of 2026