Lead Data Engineer
We are seeking an experienced and innovative Lead Data Engineer to play a critical role in our Data Transformation program.
You will be at the forefront of designing and implementing scalable, cutting-edge data solutions, leveraging advanced technologies to optimize our cloud-based analytics platform. This role offers a unique opportunity to contribute to the transformation of our data platform and develop expertise in emerging technologies.
Responsibilities
- Design and develop automated data pipelines and data structures for modern data solutions
- Deliver business tenancies as part of the data platform strategy
- Build and optimize cloud data platforms leveraging AWS and Snowflake
- Collaborate with product teams to ensure alignment with business goals and objectives
- Migrate data from legacy platforms to cloud-based solutions
- Design and operate event‑driven or streaming systems on Kafka with focus on delivery semantics and tuning throughput
- Implement robust CI/CD pipelines using GitLab to support development processes
- Create and maintain automated testing frameworks for data pipelines
- Adapt ITIL processes into a 2nd/3rd line support environment to ensure system reliability
- Drive innovation by staying updated with technology standards and emerging trends in software and data engineering
- Contribute to Agile delivery teams utilizing methodologies such as Scrum and Kanban
Requirements
- 5+ years of Python engineering experience with a focus on performance optimization, object-oriented design, and production-grade reliability
- 2+ years of hands-on expertise in Snowflake, SQL, and data engineering tools like dbt and Airflow
- 2+ years designing and managing Kafka systems with an understanding of message delivery guarantees and DLQs
- 1+ years implementing CI/CD pipelines using GitLab in production environments
- Familiarity with Agile methodologies, including Scrum or Kanban, and JIRA for workflow management
- Knowledge of automated testing frameworks for validating data pipelines
- Expertise in modern cloud computing technologies, with a focus on AWS and Snowflake
- Demonstrated proficiency in ITIL processes within a support setting
- Strong written and verbal English communication skills (B2+)
