We are looking for an experienced Senior Data Software Engineer with a deep understanding of Apache Spark, Python/Java/Scala and proficiency with any cloud providers.
In this role, you will develop and maintain data pipelines, working closely with cross-functional teams.
If you are passionate about using your data engineering skills to make a significant impact and excel in a collaborative, growth-oriented environment, we encourage you to apply and join us.
Responsibilities
- Develop and maintain data pipelines for efficient data processing and analysis
- Collaborate with cross-functional teams to identify business requirements and translate them into technical solutions
- Create and maintain technical documentation for all data engineering projects
- Work with data scientists to ensure models are production-ready
- Ensure all data engineering solutions are high-quality, reliable and scalable
- Troubleshoot and resolve data-related issues promptly and efficiently
- Stay up-to-date with emerging data engineering technologies and trends
- Participate in code reviews to ensure code quality and adherence to standards
Requirements
- 3+ years of experience in Data Software Engineering
- Expertise in Apache Spark, Python/Java/Scala
- Background in developing and maintaining data pipelines
- Proficiency in SQL and relational tables
- Understanding of SDLC, quality gates and Agile methodologies
- B2+ English level, both verbal and written
- Hands-on experience with any major cloud provider: Azure, AWS or GCP
Nice to have
- Competency in statistical models and their practical applications
- Familiarity with Databricks and MLOps for efficient model deployment and management
- Hands-on experience with streaming processing technologies like Kafka, Spark Streaming and Flume
- Practical or theoretical knowledge of NoSQL databases