Lead Data DevOps Engineer
We are seeking a Lead Data DevOps Engineer to join a team that implements and supports essential components of an Azure data platform. This includes infrastructure changes, monitoring, end-to-end tracking, automation and self-healing, anomaly detection, event correlation and analysis, performance analysis, and access permissions management.
Responsibilities
- Build and maintain advanced Terraform configurations and Azure DevOps pipelines spanning multiple subscriptions and environments
- Engage with various stakeholders to ensure technical solutions meet business requirements
- Enhance performance while monitoring, troubleshooting, and preventing issues across data workloads
- Work alongside Architecture teams to confirm that platform architecture and design standards align with the support model
- Pinpoint ways to optimize data platform activities, support processes, and operational workflows
- Streamline and automate administrative tasks, infrastructure, and application deployments
- Team up with the SRE group to maintain platform reliability and stability
Requirements
- 5+ years working with Azure Cloud services, Azure DevOps, Azure PowerShell, and Terraform
- 1+ years of relevant leadership experience
- Hands-on expertise in infrastructure automation using Terraform and Azure DevOps pipelines across multiple subscriptions and environments
- Strong communication skills for engaging with technical and business stakeholders alike
- Solid grasp of platform architecture and design standards to enable effective collaboration with Architecture teams
- Ability to spot and execute automation opportunities across administrative, infrastructure, and deployment tasks
- English proficiency at a B2+ level
Nice to have
- Familiarity with Azure Data Factory, Azure Data Lake Storage, and Azure Databricks
- Working knowledge of Azure Monitor and Azure SQL Database
- Experience with Azure Storage and Azure Synapse Analytics
