We are seeking a Senior Platform Engineer to lead the administration, governance, and automation of our Data Lake and AWS Databricks environments. In this role, you will build solutions that streamline platform operations, enable secure data access, and support analytics and machine learning initiatives across the enterprise.
Responsibilities
- Administer and manage AWS Databricks and Data Lake environments
- Implement and enforce access management using RBAC and Entra ID
- Apply Databricks governance concepts, including Unity Catalog, access control, and data lineage
- Develop automation scripts and REST API integrations for platform configuration and monitoring
- Monitor platform health, respond to incidents, and ensure operational reliability
- Collaborate with stakeholders to align platform standards and contribute to governance frameworks
- Troubleshoot and resolve platform issues while optimizing performance and efficiency
- Document platform processes and best practices
Requirements
- 5+ years of experience with AWS cloud services, especially AWS Databricks
- Proficiency in AWS access management, including RBAC and Entra ID
- Hands-on knowledge of Databricks governance, particularly Unity Catalog, covering catalog/schema management, access control, and data lineage
- Experience using Terraform to automate infrastructure deployment and management
- Basic Python development skills for automation and scripting
- Familiarity with REST APIs for platform administration and configuration
- Understanding of DevOps principles, including monitoring, observability, incident response, and operational health
- Experience working in enterprise environments, ideally within diverse and globally distributed organizations
- Strong analytical and problem-solving skills
- English proficiency at B2 level or higher
Nice to have
- Knowledge of Agile methodologies (Scrum, SAFe)
- Experience with Databricks administration, including workspace configuration, job orchestration, and cluster policies
- Background in contributing to shared platform standards, governance frameworks, or automation libraries
- Familiarity with infrastructure-as-code tools, such as Terraform and ARM templates
- Exposure to CI/CD pipelines and DevOps toolchains