Lead Data Software Engineer (Python, Azure, Databricks)
We are seeking an experienced Lead Data Software Engineer to drive the design, development, and optimization of scalable data solutions. In this role, you will lead a talented team of engineers, architect robust data pipelines, and collaborate with cross-functional stakeholders to deliver high-impact data products that support business objectives.
Responsibilities
- Lead the design, development, and deployment of scalable data engineering solutions
- Architect and implement efficient data pipelines and ETL processes
- Mentor and guide a team of data engineers, fostering best practices and technical growth
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
- Ensure data quality, integrity, and governance across all engineering initiatives
- Optimize performance, reliability, and cost-efficiency of cloud-based data platforms
- Drive code reviews, technical documentation, and engineering standards
- Troubleshoot complex data issues and provide timely resolutions
- Stay current with emerging data technologies and recommend improvements
- Partner with leadership to define the data engineering roadmap and strategy
Requirements
- 5+ years of experience in data engineering or software engineering roles, with at least 1 year in a lead capacity
- Proficiency in Python for data processing and automation
- Expertise in Microsoft Azure cloud services and ecosystem
- Skills in Databricks for large-scale data processing and analytics
- Background in designing and maintaining scalable data pipelines and ETL workflows
- Understanding of data modeling, warehousing concepts, and performance optimization
- Capability to lead technical teams and mentor junior engineers
- Strong communication and collaboration skills to work effectively with cross-functional teams
- Proficiency in English (both written and spoken) at a minimum of B2 level
