Senior Azure Data Platform & DevOps Engineer
We are looking for a Senior Azure Data Platform & DevOps Engineer to support the project, focusing on building and operating the Azure data infrastructure and the CI/CD platform that underpins it.
Responsibilities
- Design, build and maintain data pipelines and platform components using Azure Databricks, Event Hubs, MongoDB and Unity Catalog
- Manage Azure Storage Accounts and lead cross-region data migration efforts within Azure, ensuring data integrity, minimal downtime and compliance during transfers between regions
- Provision and manage cloud infrastructure as code using Terraform across Azure Cloud
- Containerize and orchestrate workloads using Docker and Azure Kubernetes Service
- Build and maintain CI/CD pipelines using GitHub Actions and Git, and manage GitOps-based deployments with ArgoCD
- Set up and maintain observability and monitoring using New Relic
- Collaborate with data engineering and platform teams to ensure secure, scalable and reliable delivery of data and infrastructure changes
Requirements
- 3+ years of experience working as a Data Platform or DevOps Engineer in cloud environments
- Expertise in Azure Databricks, Event Hubs and Unity Catalog
- Proficiency in MongoDB and Azure Storage Account management
- Experience with cross-region data migration within Azure
- Skills in Terraform and Azure Cloud infrastructure provisioning
- Familiarity with Docker and Azure Kubernetes Service
- Knowledge of GitHub Actions, Git and ArgoCD for CI/CD and GitOps-based deployments
- Understanding of New Relic for monitoring and observability
