Data DevOps Engineer
We are seeking a skilled Data DevOps Engineer to configure CI/CD for data pipeline rollouts and build robust AWS infrastructure using Terraform, ensuring reliable and scalable data operations. If you are ready to take on this exciting opportunity, apply now!
Responsibilities
- Collaborate with architects and data engineers to gather requirements and translate them into CI and infrastructure setups
- Create and manage AWS infrastructure through Terraform to support data operations
- Document CI/CD processes meticulously to ensure repeatability and maintain standards
Requirements
- 2+ years of experience building and maintaining complex CI/CD pipelines on AWS, including automated testing, artifact management and multi-environment deployments with quality gates, security scanning and infrastructure validation
- Expertise in AWS core services including S3, VPC and EC2, with particular need for operating production-grade systems on Amazon Elastic Kubernetes Service
- Proficiency in Terraform including modular infrastructure design, reusable modules, environment isolation and integration with CI/CD pipelines for automated infrastructure provisioning and updates
Nice to have
- Familiarity with Redshift, Glue, Spark and Athena for data processing and analytics workloads
- Familiarity with AWS Cloud Development Kit, AWS CloudFormation and Amazon Managed Workflows for Apache Airflow
- Skills in Jira and Confluence
