Senior Data Engineer
About the Position
We are looking for an experienced Senior Data Engineer to design, build, and maintain scalable data solutions in the Azure cloud.
Responsibilities
- Develop and maintain data solutions on Azure and Databricks platforms
- Contribute to new project development and support and maintenance of existing solutions
- Implement data pipelines, transformations, and business logic in Databricks
- Collaborate with cross-functional teams to ensure data accuracy, integrity, and optimal performance
- Manage version control, deployments, and CI/CD processes using Git
- Ensure adherence to best practices in data management and governance
Requirements
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
- Engineering or Mathematics background is preferred
- 5+ years of experience with SQL and Python
- 3+ years of experience with Azure cloud services
- Strong hands-on experience with Azure SQL Server, Azure Data Factory (ADF), Azure Databricks (highlighted expertise), Azure Data Lake Storage (ADLS), Azure Key Vault, Azure Functions, and Logic Apps
- 3+ years of experience with Git
- Experience deploying code using CI/CD pipelines
- Experience with Power BI
Technologies
Azure SQL Server, Azure Data Lake, Azure Data Factory, MS SQL DB, Power BI, Power App, Power Platform, StarRocks DB, Apache Flink
