Lead Data Integration Engineer (MS SQL, Snowflake)
We are seeking a highly skilled and experienced Lead Data Integration Engineer who will play a critical role in representing EPAM with our client and leading the transition of a ~17-person stream from another vendor. This is a hands-on position requiring expertise in MS SQL, Snowflake, and related technologies to drive seamless data integration and transformation processes.
Responsibilities
- Build and lead a new team of ~5-7 EPAM Database Engineers and QAs to transition responsibilities from another vendor
- Work with code and tools 50-70% of the time in a hands-on capacity
- Design and develop ETL jobs using MSSQL, Snowflake SQL, and Talend to move and transform data from OLTP databases to Data Lakes
- Create automated jobs for data cleaning, transformation, and relocation to designated destinations
- Identify, design, and implement process optimizations for automation, scalability, and efficient data delivery
- Collaborate with data and analytics teams to enhance functionality and usability within data systems
- Simplify and streamline data consumption processes for internal teams and end-user analytics display
- Monitor occasionally database processes and resolve performance issues as needed
Requirements
- 5+ years of working experience with MS SQL Server, including in-depth knowledge of database development and optimization
- 1+ years of working experience with Snowflake, including design and implementation for data integration workflows
- 1+ years of leadership experience in relevant roles
- Expertise in ETL and data transformation tools such as Talend or similar frameworks
- Familiarity with cloud environments such as AWS and storage solutions like S3
- Strong verbal and written communication skills in English, at least at a B2+ level
Nice to have
- Background in Data Warehouse Management, with an understanding of end-to-end data lifecycle processes
- Experience with visualization tools such as Microsoft Power BI
- Experience conducting audits in cloud warehouses
- Familiarity with Data Governance Tools like Oval Edge or similar for cataloging and metadata profiling
- Capability to implement Change Data Capture Tools for configuration, management, and support of real-time data synchronization
