Senior Platform Engineer (Azure Infrastructure & Administration)
We are seeking a Senior Platform Engineer to lead the administration, governance, and automation of our Data Lake and Azure Databricks environments. In this role, you will build solutions that streamline platform operations, enable secure data access, and support analytics and machine learning initiatives across the enterprise.
Responsibilities
- Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces
- Implement and enforce access management using RBAC and Entra ID
- Apply Databricks governance concepts, including Unity Catalog, access control, and data lineage
- Develop automation scripts and REST API integrations for platform configuration and monitoring
- Monitor platform health, respond to incidents, and ensure operational reliability
- Collaborate with stakeholders to align platform standards and contribute to governance frameworks
- Troubleshoot and resolve platform issues, optimizing performance and efficiency
- Document platform processes and best practices
Requirements
- 5+ years of experience with Microsoft Azure cloud services, particularly Azure Databricks and Azure Data Lake Storage Gen2
- Proficiency in Azure access management, including RBAC and Entra ID
- Expertise in Databricks governance, particularly Unity Catalog, covering catalog/schema management, access control, and data lineage
- Experience using Terraform to automate infrastructure deployment and management
- Familiarity with Python for automation and scripting
- Skills in working with REST APIs for platform administration and configuration
- Understanding of DevOps principles, including monitoring, observability, incident response, and operational health
- Experience working in enterprise environments, ideally within diverse and globally distributed organizations
- Strong analytical and problem-solving skills
- Proficiency in English at a B2+ level
Nice to have
- Knowledge of Agile methodologies, such as Scrum and SAFe
- Experience with Databricks administration, including workspace configuration, job orchestration, and cluster policies
- Showcase of contributions to shared platform standards, governance frameworks, or automation libraries
- Familiarity with infrastructure-as-code tools, such as Terraform and ARM templates
- Exposure to CI/CD pipelines and DevOps toolchains
