Senior Data Engineer
We are looking for a highly skilled Senior Data Engineer to join our team and drive the development and optimization of our scalable data platform. This role is ideal for someone experienced in data engineering and enthusiastic about working in innovative, evolving environments, with a focus on integrating diverse technologies and shaping the technical direction.
Responsibilities
- Drive the end-to-end development of a data platform using Databricks and Kubernetes
- Integrate new data sources, including test automation results, deployments, and vulnerabilities
- Utilize data sources to develop accurate, reliable, and automated metrics with SQL and/or DBT
- Contribute to the design and implementation of scalable data platform architecture on Azure
- Facilitate an open-source mindset within a corporate environment, championing innersourcing
- Collaborate within the enablement community to drive improvements across processes and technologies
- Optimize performance, reliability, and cost-efficiency for data solutions, following best practices
Requirements
- 3+ years of relevant work experience in data engineering, data warehousing, or software development
- Good understanding of data engineering concepts with hands-on experience in data pipelines and analytics workloads
- Experience working in a cloud environment, preferably Azure
- Proficiency in programming languages such as Python, Go, and SQL
- Expertise in data engineering tools like DBT and PySpark
- Skills in automation scripting and Infrastructure as Code (IaC) to ensure consistent deployment processes, with experience in tools such as Terraform and GitHub Actions
- Background in ETL/ELT solutions with the ability to streamline processes
- Interest in contributing to the team's technical direction while learning architectural principles
- Collaborative mindset with strong interpersonal skills and openness to feedback
- Comfortable navigating complex environments with a proactive approach to problem-solving
- Strong passion for technology, continuous learning, and improvement
- English proficiency at a B1+ level
Nice to have
- Familiarity with CI/CD processes
- Knowledge of Databricks
