We are seeking a Senior Azure Data Platform & DevOps Engineer to support the project, focusing on building and operating the Azure data infrastructure and the CI/CD platform that underpins it.
Responsibilities
Design, build and maintain data pipelines and platform components using Azure Databricks, Event Hubs, MongoDB and Unity Catalog
Manage Azure Storage Accounts and lead cross-region data migration efforts within Azure, ensuring data integrity, minimal downtime and compliance during transfers between regions
Provision and manage cloud infrastructure as code using Terraform across Azure Cloud
Containerize and orchestrate workloads using Docker and Azure Kubernetes Service (AKS)
Build and maintain CI/CD pipelines using GitHub Actions and Git, and manage GitOps-based deployments with ArgoCD
Set up and maintain observability and monitoring using New Relic
Collaborate with data engineering and platform teams to ensure secure, scalable and reliable delivery of data and infrastructure changes
Requirements
3+ years of experience in DevOps or Site Reliability Engineering
Proficiency in Azure Databricks, Event Hubs and MongoDB
Expertise in Unity Catalog and Azure Storage Accounts
Experience with cross-region data migration within Azure
Skills in Terraform, Azure Cloud and Docker
Familiarity with Azure Kubernetes Service
Knowledge of GitHub Actions, Git and ArgoCD
Background in New Relic for monitoring and observability