Lead with MS SQL Server and Snowflake
We are looking for an experienced Lead Data Integration Engineer to represent EPAM with our client and oversee the transition of a ~17-person stream from another vendor.
This role combines leadership responsibilities with hands-on work, requiring proficiency in MS SQL, Snowflake, and related technologies to ensure efficient data integration and transformation processes.
Responsibilities
- Lead a new team of ~5-7 EPAM Database Engineers and QAs during the vendor transition process
- Dedicate 50-70% of the time working directly with code and tools
- Design ETL jobs using MSSQL, Snowflake SQL, and Talend to migrate and transform data to Data Lakes
- Develop automated workflows for data cleaning, transformation, and relocation to predefined destinations
- Identify process enhancements to improve automation, scalability, and data delivery efficiency
- Collaborate with data and analytics teams to optimize systems for functionality and user experience
- Streamline data access processes for team consumption and analytics display purposes
- Handle database performance issues on occasion, ensuring smooth operations
Requirements
- 5+ years of experience with MS SQL Server, including extensive knowledge of database development and optimization
- 1+ years of Snowflake experience, including designing and implementing data integration workflows
- 1+ years of leadership experience in related positions
- Proficiency in ETL tools and frameworks such as Talend
- Familiarity with cloud environments like AWS and storage solutions such as S3
- Strong English communication skills, at least at a B2+ level
Nice to have
- Background in Data Warehouse Management with strong knowledge of the data lifecycle
- Proficiency in visualization tools like Microsoft Power BI
- Competency in conducting audits within cloud warehouses
- Understanding of Data Governance Tools such as Oval Edge or similar for metadata profiling and cataloging
- Capability to utilize Change Data Capture Tools for real-time synchronization configuration and management
