Senior Data Engineer (Snowflake)
Project description
Our Client is a leading global financial markets infrastructure and data provider. Their purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Team is responsible for managing a secure, scalable, and highly available cloud platform built on AWS, Azure, and Snowflake. Our mission is to deliver a strategic Common Data and Reporting solution for clients, members, and regulators by consolidating multiple data sources into a centralized reporting data store. This role offers the opportunity to work on cutting-edge cloud technologies and contribute to building a platform that transforms how data is leveraged across the business.
Responsibilities
- Design, build, and optimize scalable data pipelines using Python, SQL, DBT, and Apache Airflow
- Develop and manage DBT models and ensure reliable workflow orchestration in Airflow
- Monitor and maintain Snowflake platform performance, availability, and cost efficiency
- Troubleshoot and resolve issues across data ingestion, transformation, and pipelines
- Implement and maintain end-to-end data quality testing and validation frameworks
- Automate deployments and workflows using GitLab CI/CD and support release processes
- Provide support to users and collaborate with teams on Snowflake, Airflow, and data solutions
- Document architecture and best practices while contributing to technical design, mentoring, and continuous improvement
SKILLS
Must have
- 7+ years of proven experience as a Senior Data Engineer
- Hands-on experience with Snowflake (preferred) or Databricks/Oracle
- Solid experience with DBT (data modeling and transformation)
- Experience with cloud platforms – AWS (preferred) or Azure
- Strong SQL - advanced query writing and optimization skills
- Strong Python - experience in data processing and automation
- Basic CI/CD knowledge (GitLab or similar) - understanding of deployment pipelines
- Apache Airflow - workflow orchestration
- Data Build Tool - data transformation and modeling
Nice to have
• Terraform - infrastructure as code • Kafka - event streaming and messaging
