We are seeking an experienced Data Engineer to join a cross-functional delivery team supporting a leading global retail and quick-service restaurant brand. In this role, you will modernize cloud data platforms, build scalable medallion-architecture pipelines, and engineer automated data lifecycle and privacy compliance solutions. Depending on your strengths and project track, you will focus either on high-throughput OLAP analytical modeling and data retention or API-driven privacy workflows (DSAR) and transactional lakehouse operations.
Essential functions
- Data Pipelines & Lakehouse Engineering: Design, build, and maintain production-grade batch, streaming, and transactional data pipelines across medallion layers (Silver to Gold) using Python, SQL, and Apache Spark / PySpark.
- Data Lifecycle & Governance Automation: Engineer configuration-driven workflows for automated data retention, cold-storage archiving, partition management, and auditable PII discovery and deletion (DSAR) across cloud data stores.
- Performance & Analytical Modeling (OLAP Track): Design dimensional data marts (Star/Snowflake schemas), materialized views, and partitioning/clustering strategies to optimize query performance for downstream analytics.
- API & Platform Integrations (Privacy/Backend Track): Build and maintain RESTful backend services, webhooks, and connectors integrating enterprise privacy platforms (such as OneTrust) with lakehouse tables and relational databases.
- Data Quality & Observability: Implement automated reconciliation jobs, regression tests, immutable audit logging, and dead-letter error handling to ensure data integrity and regulatory compliance.
- Orchestration & DevOps: Manage and monitor complex workflows using modern orchestrators (Apache Airflow, Dagster, or AWS Step Functions) within containerized CI/CD environments.
Qualifications
- 4–8 years of hands-on experience in Data Engineering or Data-focused Backend Engineering within enterprise cloud environments.
- Strong proficiency in Python (or Scala/Java) and advanced SQL for complex transformations, performance tuning, and data modeling.
- Practical experience with Apache Spark / PySpark and modern open table formats or distributed SQL engines (Databricks, Delta Lake, Apache Iceberg, Snowflake, Trino, or AWS Athena).
- Solid understanding of partitioning, indexing, clustering, and executing row-level updates/deletes (MERGE, VACUUM, partition rewrites) in cloud object storage (S3/GCS/ADLS) and relational databases (PostgreSQL/MySQL).
- Hands-on experience with workflow orchestrators (Airflow, Dagster, or Step Functions), containerization (Docker, Kubernetes/ECS), IAM security, and CI/CD pipelines.
Would be a plus
- Experience building RESTful APIs and webhook consumers (FastAPI, Flask, or Spring Boot).
- Familiarity with enterprise data governance or privacy platforms (OneTrust, Collibra, TrustArc) and GDPR/CCPA compliance workflows.
- Experience designing dimensional OLAP data marts or supporting lightweight internal configuration/audit UIs.
- Active cloud certifications (AWS, GCP, or Azure).
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI,
and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical
challenges and enable positive business outcomes for enterprise companies undergoing business transformation.
A key differentiator for Grid Dynamics is our 8 years of experience and leadership in
enterprise AI, supported by profound expertise and ongoing investment in
data,
analytics,
cloud & DevOps,
application modernization
and
customer experience.
Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.