Senior Apache Airflow Engineer
We are seeking a Senior Apache Airflow Engineer to join our team and lead the development, maintenance and optimization of scalable workflow orchestration solutions built on Apache Airflow.
Responsibilities
- Develop and maintain custom Airflow Operators, Hooks and Sensors
- Integrate new Airflow versions with Cloud Composer
- Fix bugs and implement improvements within Airflow
- Implement unit and solution testing for Airflow workflows
- Create internal documentation for work artifacts
- Coordinate development activities within the team and support delivery planning
- Collaborate with cross-functional and distributed teams to support delivery and resolve technical issues
- Support junior team members through knowledge sharing, technical guidance and code review
- Participate in technical discussions with clients and coordinate prioritization of development activities
Requirements
- 5+ years of experience in Python development
- Proficiency in Cloud APIs (REST/RPC)
- Knowledge of DevOps and SysAdmin practices
- Familiarity with Linux and Kubernetes including container image building
- Understanding of Cloud platforms particularly Google Cloud Platform
- Skills in English communication both spoken and written
Nice to have
- Expertise in Airflow or similar workflow tools such as Luigi, Oozie, Argo or Apache NiFi
- Background in working with Open Source communities
- Understanding of Cloud Architecture including scalability and IaaS principles
- Google Cloud Certification (e.g. GCP Architect or Data Engineer)
