Lead Data Integration Engineer with Azure Data Factory and Databricks
We are seeking a Lead Data Integration Engineer to design, build, and maintain scalable data integration pipelines across cloud and enterprise systems. The role focuses on data ingestion, transformation, orchestration, and automation using Azure Data Factory, Databricks, and the broader Azure data ecosystem.
Responsibilities
- Design and develop ETL/ELT pipelines using Azure Data Factory
- Integrate data from databases, APIs, files, SaaS platforms, and cloud storage
- Build and manage data workflows, triggers, linked services, datasets, and pipelines
- Implement data validation, monitoring, error handling, and performance optimization
- Leverage Azure Data Lake, Azure SQL, Synapse, and Databricks as needed
- Partner with data engineers, analysts, and business teams to deliver reliable data solutions
- Support deployment, CI/CD, security, and access controls for data pipelines
Requirements
- 5+ years of hands-on experience with Azure Data Factory
- Proficiency in SQL and data integration concepts
- Experience with Azure data services such as ADLS, Azure SQL, and Synapse
- Background in Databricks for data processing and transformation
- Proficiency in English at a B2+ level
