Senior Azure Data Engineer
We are looking for a Senior Azure Data Engineer to join our team and drive the development and optimization of scalable data solutions in the cloud.
The ideal candidate will have deep expertise in PySpark, strong experience with Azure Data Factory and Synapse, and a solid background in modern DevOps practices.
Responsibilities
- Design, develop and optimize large-scale data processing solutions with PySpark
- Implement and maintain advanced data pipelines and workflows in Azure Data Factory and Azure Synapse
- Develop, automate and monitor development and build pipelines for robust data engineering solutions
- Collaborate with cross-functional teams to deliver scalable and reliable data solutions
- Apply best practices for code optimization, version control with Git and infrastructure automation
- Integrate Azure Functions for data orchestration and transformation tasks
- Contribute to infrastructure setup and automation using Terraform
- Document solutions and mentor junior team members
Requirements
- Minimum 8 years’ experience in data engineering
- Expertise in PySpark with a focus on writing optimized and scalable code
- Background in Azure Data Factory and Azure Synapse for data integration and orchestration
- Skills in Azure services and Azure Functions
- Experience designing and managing development and build pipelines in cloud environments
- Proficiency in Git for version control and collaboration
- Familiarity with Terraform for infrastructure automation
- Qualifications in integrating Azure Functions into data workflows
- Knowledge of building development and build pipelines
- Advanced knowledge of Azure DevOps, CI/CD and infrastructure as code tools
- Competency in problem-solving, communication and documentation skills
