Senior Data Engineer

EPAM·Argentina, Colombia, Mexico, Brazil, Chile·Удалённо·сегодня

We are looking for a Senior Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks-based data products. You will combine hands-on delivery, technical leadership, and architecture to enable trusted, scalable, and AI-enabled data capabilities.

Responsibilities

  • Design scalable data ingestion and transformation frameworks for analytics use cases
  • Build batch, near real-time, and streaming pipelines using Databricks and Apache Spark
  • Define Databricks best practices for Medallion layers, performance, and operations
  • Deliver end-to-end data products from raw ingestion through governed consumption layers
  • Develop trusted analytical datasets and semantic models for reporting and self-service
  • Implement data quality, lineage, monitoring, and observability across pipelines
  • Lead proof-of-concepts and evaluate new capabilities within the Databricks ecosystem
  • Enable AI-assisted engineering patterns and reusable accelerators for faster delivery
  • Coordinate with engineering and analytics stakeholders to align on delivery plans
  • Mentor engineers and promote consistent platform standards across teams

Requirements

  • 3+ years of data engineering experience with modern data platforms
  • Strong leadership skills to drive engineering standards and mentor other engineers
  • Proven project delivery experience building enterprise analytics solutions end to end
  • Advanced Apache Spark and PySpark skills for large-scale processing
  • Advanced Databricks skills in production environments, including performance tuning
  • Strong SQL skills for transformation logic and analytics-ready datasets
  • Solid data architecture knowledge, including Lakehouse and Medallion patterns
  • Hands-on CI/CD and data engineering SDLC experience using Git-based workflows
  • Strong data governance skills covering security, quality, and operational controls
  • Excellent communication skills to lead technical discussions with cross-functional teams
  • Upper-Intermediate English proficiency (B2) for effective collaboration

Nice to have

  • Data Architecture experience designing scalable Lakehouse patterns
  • Data Solution Architecture experience translating business needs into platform designs
  • Scala experience for Spark-based pipeline development

Похожие вакансии

Другие вакансии EPAM