Senior Data Engineer with Snowflake OpenFlow

About the Position

We are looking for a Senior Data Engineer to implement and validate change data capture from AWS Aurora PostgreSQL into Snowflake. You will help build metadata driven integration frameworks, support schema adoption in the Medallion architecture, and contribute to performance, reliability, and governance across the data flow.

About the Project

The Analytics Warehouse project supports a large portfolio of business applications with a centralized data environment. The initial milestone focuses on implementing and validating managed ingestion from Aurora PostgreSQL to Snowflake, with production rollout and full dimensional modeling planned for later phases.

About the Team

You will work with data platform, infrastructure, and architecture teams in a collaborative cross functional setup. The team operates in an Agile environment with coordination across distributed stakeholders.

Responsibilities

• Configure and operate Snowflake OpenFlow from Aurora PostgreSQL to Snowflake
• Tune and troubleshoot Aurora PostgreSQL for logical replication
• Provision infrastructure using Terraform and AWS IAM with least privilege access controls
• Run structured proof of concept tests for large tables high volume CDC concurrency and outage recovery scenarios
• Document outcomes of proof of concept testing and validation activities
• Monitor replication health using Snowflake native observability and Amazon CloudWatch
• Define success criteria with stakeholders for replication and ingestion validation
• Support Snowflake side setup for managed ingestion including warehouses grants schedules and reconciliation checks
• Apply security and governance practices appropriate to a regulated financial and member services context
• Perform schema DBT and Snowflake native pipeline renewal while preserving business and data continuity
• Execute performance and cost improvements
• Follow agreed teardown procedures to remove replication and access artifacts

Requirements

• Hands on experience with Snowflake OpenFlow or Apache NiFi
• Strong experience with PostgreSQL or Aurora including logical replication WAL slots and access control
• Experience with Terraform on AWS including networking security groups IAM and role pass through for managed services
• Experience with DBT for data transformations
• Proficiency in SQL for transformations validation and reconciliation
• Working knowledge of Snowflake including warehouses roles and loading patterns
• Understanding of CDC and ELT fundamentals
• Experience with data quality validation and reconciliation practices
• Strong communication skills for Agile cross team collaboration in distributed teams
• Experience with GitHub

Nice to Have

• Experience with PostgreSQL sources and Snowflake targets using OpenFlow NiFi or similar services
• Experience with Python or similar languages for checks automation and reporting
• Experience with Snowflake OpenFlow or similar managed CDC offerings
• Experience with Airflow or equivalent tools for production orchestration
• Experience in financial services or similar regulated domains
• Experience with cloud cost estimation for replication at scale
• Experience with Amazon EKS or Kubernetes for monitoring and issue resolution in the OpenFlow or NiFi environment
• Experience with Cursor or Claude
• Experience with specification driven development

Technologies

Snowflake OpenFlow, AWS Aurora PostgreSQL, Snowflake, Terraform, AWS IAM, DBT, SQL, Amazon CloudWatch, GitHub, Apache NiFi, Airflow, Python, Amazon EKS, Kubernetes