Lead Data Integration Specialist
We are seeking an experienced Lead Data Integration Specialist to join our team.
The preferred candidate brings at least 5 years of experience in data management, storage, modeling, analytics, migration, and database design. As a Tech Lead/Team Lead, you will craft innovative data integration solutions, contribute to cloud solution architecture, and guide a high-performing team to uphold best practices. Your strong expertise in cloud environments, data warehousing solutions, and data security will drive the success of our initiatives.
Responsibilities
- Lead a team of engineers, offering technical direction and mentorship
- Design data integration solutions, model databases, and build scalable data platforms
- Combine classic data technologies with modern cloud or hybrid data solutions
- Contribute to cloud solution architecture while serving as a role model for the team
- Partner with product and engineering teams to specify technical requirements and support architectural decisions
- Develop relationships with architects and stakeholders across the organization
- Conduct in-depth analysis of business challenges and technical ecosystems to craft superior solutions
- Participate in code reviews and testing to confirm adherence to standards
- Drive a culture of high performance and offer technical guidance to the team
- Prepare and maintain essential project documentation, such as technical descriptions and use cases
Requirements
- A minimum of 5 years of experience in data management, storage, analytics, migration, and database design
- Demonstrated ability to guide technical teams and mentor engineers
- Expertise in cloud environments like AWS, Azure, or GCP and data warehousing platforms, including Redshift, Snowflake, Azure Synapse Analytics, or Google BigQuery
- Knowledge of data integration tools such as Azure Data Factory, AWS Glue, GCP Dataflow, Talend, Informatica, Apache NiFi, KNIME, or SSIS
- Familiarity with relational databases like MS SQL Server, Oracle, MySQL, or PostgreSQL and experience coding in SQL, Python, SparkSQL, PySpark, R, Bash, or Scala
- Proficiency in data security, data modeling, and data integration frameworks like OLAP, OLTP, ETL, DWH, Data Lake, Delta Lake, or Data Mesh
- Background in integration approaches, including CDC methods, micro-batching, delta extracts, and housekeeping processes
- Understanding of data lineage, metadata management, data traceability, and the capability to produce high-quality design documentation
- Awareness of compliance standards (PI, GDPR, HIPAA) and professional-level English communication skills
- Competency in direct customer communication and the capability to present technical solutions effectively
Technologies
- Cloud Platforms (AWS, Azure, GCP): Storage, Compute, Networking, Identity & Security, Data Warehousing (Redshift, Snowflake, BigQuery, Azure Synapse)
- Data Integration Tools (Azure Data Factory, AWS Glue, GCP Dataflow, Talend, Informatica, Apache NiFi, KNIME, SSIS, etc.)
- Programming Languages: SQL, Python, SparkSQL, PySpark, R, Bash, Scala
- Relational Databases (MS SQL Server, Oracle, MySQL, PostgreSQL)
- Dataflow orchestration, replication, and data preparation tools
- Version Control Systems (Git, SVN)
- Testing: Component, Integration Testing, and Data Reconciliation
