Senior Data Engineer (Azure)
About the Position
We are seeking an experienced Senior Data Engineer to join a high‑performing data team working on a large‑scale, cloud‑based platform. In this role, you will design, build, and maintain robust data pipelines and data warehousing solutions that enable analytics, reporting, and business intelligence initiatives. This role requires regular collaboration with stakeholders and on-site presence at the client’s Central London office 3–4 days per week.
About the Project
The project focuses on building a modern, enterprise‑grade data platform that serves as a core foundation for data‑driven decision‑making across multiple lines of business.
Responsibilities
- Design, build, and maintain scalable data pipelines using Azure and Snowflake
- Develop and optimize ETL / ELT processes for batch and micro-batch data workloads
- Work with Azure Data Factory, Azure SQL, Azure Storage, and Azure Functions
- Design and maintain data warehouse models (dimensions, facts, star/snowflake schemas)
- Apply best practices in Kimball and Inmon data warehousing methodologies
- Write, optimize, and maintain complex SQL queries supporting analytics and reporting
- Ensure data quality, consistency, and reconciliation across multiple data sources
- Collaborate with Business Intelligence teams to support dashboards and reporting tools
- Participate in technical requirements gathering and solution design discussions
- Contribute to data platform architecture design, including performance and infrastructure considerations
- Troubleshoot issues and continuously improve system performance and reliability
Requirements
- 7+ years of experience in software development
- 5+ years of experience working with data-intensive systems
- At least 2 years of hands-on experience with cloud-based data platforms (Azure preferred)
- Strong hands-on experience with the Azure Data Platform, including: Azure Data Factory, Azure SQL, Azure Storage, Azure Functions
- Strong SQL expertise, including data modeling and complex ETL-based SQL development
- Proven experience building periodic and micro-batch pipelines
- Solid understanding of data warehouse architecture and data loading strategies
- 1+ year of hands-on experience with Snowflake
- Strong analytical and problem-solving skills with a focus on data quality
- Experience working with large datasets in enterprise environments
Nice to Have
- Advanced experience with Snowflake (performance tuning, optimization, cost management)
- Proficiency in Python and/or Databricks
- Experience designing end-to-end data platform architectures
- Previous experience supporting enterprise BI platforms
- Exposure to CI/CD pipelines and infrastructure-as-code concepts
