Lead Python Data Engineer

We are in search of a skilled Lead Python Data Engineer to join our team. The successful candidate will play a crucial role in developing data pipelines in Azure, with a primary focus on building a Data Quality framework.

Responsibilities

• Develop and maintain data pipelines in Azure, with a specific focus on DQ framework development
• Collaborate with cross-functional teams to design, develop, and implement data solutions
• Create and implement data models and processes for data extraction, transformation, and loading
• Optimize and monitor data pipeline performance and reliability
• Ensure data quality and integrity throughout the data pipeline process
• Troubleshoot and resolve data pipeline issues in a timely manner
• Contribute to the continuous improvement of data engineering best practices
• Provide technical guidance and support to team members as necessary

Requirements

• Minimum of 5 years of experience in Data Software Engineering
• 1+ years of relevant leadership experience
• Proficiency in Python and hands-on experience with Azure Data Factory
• Strong understanding and practical knowledge of Databricks
• Ability to design, develop, and maintain scalable data pipelines
• Solid understanding of data modeling, data access, and data storage techniques
• Experience with data pipeline orchestration and workflow management
• Strong analytical and problem-solving abilities
• Excellent written and verbal communication skills
• B2+ English level proficiency