Data Engineer

Responsibilities

• Data organization and analysis: handling structured, semi-structured, unstructured, and image-based data.
• Building data systems and pipelines
• Preparing data for prescriptive and predictive modeling
• Designing end-to-end pipelines within a hybrid big data architecture, using Cloud Native Azure, Databricks, Spark, Scala, sbt, Airflow, Python, SQL, etc.
• Leveraging Azure Cloud services for building data pipelines and ensuring effective monitoring

Requirements

• 3+ years of relevant experience in the Data Engineering field
• Expertise in Spark
• Expertise in Databricks
• Experience in working with Azure Cloud
• Ability to write robust code with Scala
• Strong SQL skills
• Experience with building Data lakes, Data warehouses, and ETL solutions
• Understanding of data structures, data modeling, and software architecture
• Analytic and problem solving skills

We offer

• Competitive compensation
• Fully remote work
• Flexible working hours
• Continuous education, mentoring, and professional development programs
• A team with an excellent tech expertise