Senior Data Engineer (Python)
We are looking for a Data Engineer to join the Platform Engineering team. The team is responsible for supporting, operating, and evolving the data platform used by engineering and data science teams.
Essential functions
- Partner with engineers across the team to support and improve data platform operations.
- Work closely with Data Scientists to provide technical support and ensure smooth day-to-day platform usage.
- Establish and improve processes related to platform stability, reliability, and maintainability.
- Support Spark infrastructure and ensure efficient execution of large-scale data processing jobs.
- Contribute to observability, monitoring, alerting, and on-call processes.
- Help maintain data platform components across Kubernetes, Airflow, Trino/Presto, and related infrastructure.
Qualifications
- Strong experience with CI/CD pipelines.
- Strong experience with Python.
- Experience with Spark infrastructure and large-scale data processing.
- Background in distributed systems.
- Experience with Kubernetes resource management.
- Understanding of authentication, data governance, and platform security concepts.
- Familiarity with file compaction and maintenance on HDFS and/or object stores.
- Solid understanding of data engineering fundamentals, including partitioning, schema design, type safety, and table formats such as Iceberg and Hive.
- Experience with observability and monitoring tools such as Prometheus, Grafana, OpenTelemetry, and alerting systems.
- Strong collaboration skills and ability to work effectively in a cross-functional team.
- Availability to join evening calls (till 21:00)
Would be a plus
- Scala experience.
- Previous on-call experience in a data platform or infrastructure environment.
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
